Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-06-17T07:52:56Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-06-17T07:52:56Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260617 07:52:56.390086 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
/tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.190:41615
--webserver_interface=127.0.105.190
--webserver_port=0
--builtin_ntp_servers=127.0.105.148:37851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260617 07:52:56.724944 430 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 07:52:56.725378 430 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 07:52:56.725449 430 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 07:52:56.734086 430 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260617 07:52:56.734181 430 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 07:52:56.734243 430 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 07:52:56.734283 430 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 07:52:56.744333 430 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:37851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.190:41615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 17 Jun 2026 07:43:25 UTC on bdcb31816ec0
build id 12434
ASAN enabled
I20260617 07:52:56.746054 430 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 07:52:56.747859 430 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 07:52:56.757314 435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:56.758008 436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:56.758409 438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:52:56.758915 430 server_base.cc:1061] running on GCE node
I20260617 07:52:56.760080 430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 07:52:56.762341 430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 07:52:56.763602 430 hybrid_clock.cc:648] HybridClock initialized: now 1781682776763508 us; error 109 us; skew 500 ppm
I20260617 07:52:56.763931 430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 07:52:56.767149 430 webserver.cc:533] Webserver started at http://127.0.105.190:46253/ using document root <none> and password file <none>
I20260617 07:52:56.767879 430 fs_manager.cc:362] Metadata directory not provided
I20260617 07:52:56.767969 430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 07:52:56.768290 430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 07:52:56.770768 430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/data/instance:
uuid: "becdd6b4fad846399c95f04697e01d0f"
format_stamp: "Formatted at 2026-06-17 07:52:56 on dist-test-slave-v0n2"
I20260617 07:52:56.771531 430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/wal/instance:
uuid: "becdd6b4fad846399c95f04697e01d0f"
format_stamp: "Formatted at 2026-06-17 07:52:56 on dist-test-slave-v0n2"
I20260617 07:52:56.777401 430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260617 07:52:56.781059 444 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:56.782560 430 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260617 07:52:56.782760 430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/data,/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/wal
uuid: "becdd6b4fad846399c95f04697e01d0f"
format_stamp: "Formatted at 2026-06-17 07:52:56 on dist-test-slave-v0n2"
I20260617 07:52:56.782989 430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 07:52:56.805548 430 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 07:52:56.806486 430 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 07:52:56.806784 430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 07:52:56.828603 430 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.190:41615
I20260617 07:52:56.828625 495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.190:41615 every 8 connection(s)
I20260617 07:52:56.830178 430 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/data/info.pb
I20260617 07:52:56.834892 496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:52:56.839512 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu as pid 430
I20260617 07:52:56.839814 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-0/wal/instance
I20260617 07:52:56.841349 496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } has no permanent_uuid. Determining permanent_uuid...
I20260617 07:52:56.843142 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
/tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:36505
--webserver_interface=127.0.105.189
--webserver_port=0
--builtin_ntp_servers=127.0.105.148:37851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 07:52:56.858348 496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } has no permanent_uuid. Determining permanent_uuid...
W20260617 07:52:56.859735 446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111)
W20260617 07:52:56.861882 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:36505: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111)
I20260617 07:52:56.911268 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } attempt: 1
W20260617 07:52:56.913426 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:36505: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111)
I20260617 07:52:56.981746 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } attempt: 2
W20260617 07:52:56.983776 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:36505: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111)
I20260617 07:52:57.075052 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } attempt: 3
W20260617 07:52:57.077198 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:36505: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111)
W20260617 07:52:57.180222 500 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 07:52:57.180591 500 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 07:52:57.180686 500 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 07:52:57.189749 500 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260617 07:52:57.189841 500 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 07:52:57.189894 500 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 07:52:57.189934 500 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 07:52:57.201252 500 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:37851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:36505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.189
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 17 Jun 2026 07:43:25 UTC on bdcb31816ec0
build id 12434
ASAN enabled
I20260617 07:52:57.202834 500 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 07:52:57.204602 500 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 07:52:57.212854 507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:57.212893 506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:57.213676 509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:52:57.214594 500 server_base.cc:1061] running on GCE node
I20260617 07:52:57.215363 500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 07:52:57.216758 500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 07:52:57.217984 500 hybrid_clock.cc:648] HybridClock initialized: now 1781682777217922 us; error 60 us; skew 500 ppm
I20260617 07:52:57.218343 500 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 07:52:57.220508 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } attempt: 4
I20260617 07:52:57.220681 500 webserver.cc:533] Webserver started at http://127.0.105.189:38635/ using document root <none> and password file <none>
I20260617 07:52:57.221781 500 fs_manager.cc:362] Metadata directory not provided
I20260617 07:52:57.221906 500 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 07:52:57.222360 500 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
W20260617 07:52:57.222492 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:36505: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111)
I20260617 07:52:57.228662 500 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/instance:
uuid: "29a94ff9f875443ab6aeac00922cda0d"
format_stamp: "Formatted at 2026-06-17 07:52:57 on dist-test-slave-v0n2"
I20260617 07:52:57.229910 500 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal/instance:
uuid: "29a94ff9f875443ab6aeac00922cda0d"
format_stamp: "Formatted at 2026-06-17 07:52:57 on dist-test-slave-v0n2"
I20260617 07:52:57.237423 500 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260617 07:52:57.241369 515 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:57.242719 500 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260617 07:52:57.242905 500 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data,/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
uuid: "29a94ff9f875443ab6aeac00922cda0d"
format_stamp: "Formatted at 2026-06-17 07:52:57 on dist-test-slave-v0n2"
I20260617 07:52:57.243119 500 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 07:52:57.258963 500 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 07:52:57.259873 500 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 07:52:57.260169 500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 07:52:57.283068 500 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.189:36505
I20260617 07:52:57.283088 566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.189:36505 every 8 connection(s)
I20260617 07:52:57.284651 500 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/info.pb
I20260617 07:52:57.285512 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu as pid 500
I20260617 07:52:57.285780 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal/instance
I20260617 07:52:57.286803 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
/tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:33087
--webserver_interface=127.0.105.188
--webserver_port=0
--builtin_ntp_servers=127.0.105.148:37851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 07:52:57.289219 567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:52:57.295416 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } has no permanent_uuid. Determining permanent_uuid...
I20260617 07:52:57.309078 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } has no permanent_uuid. Determining permanent_uuid...
I20260617 07:52:57.318951 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } has no permanent_uuid. Determining permanent_uuid...
W20260617 07:52:57.320147 518 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111)
W20260617 07:52:57.321833 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111)
I20260617 07:52:57.371179 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } attempt: 1
W20260617 07:52:57.373203 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111)
I20260617 07:52:57.441498 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } attempt: 2
W20260617 07:52:57.443745 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111)
I20260617 07:52:57.521823 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } attempt: 5
I20260617 07:52:57.528620 496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } has no permanent_uuid. Determining permanent_uuid...
W20260617 07:52:57.531165 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111)
I20260617 07:52:57.535000 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } attempt: 3
W20260617 07:52:57.536729 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111)
I20260617 07:52:57.582389 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } attempt: 1
W20260617 07:52:57.585021 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111)
W20260617 07:52:57.646111 569 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 07:52:57.646445 569 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 07:52:57.646625 569 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260617 07:52:57.653314 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } attempt: 2
W20260617 07:52:57.655289 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111)
W20260617 07:52:57.656194 569 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260617 07:52:57.656272 569 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 07:52:57.656363 569 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 07:52:57.656447 569 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 07:52:57.667147 569 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:37851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:33087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.188
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 17 Jun 2026 07:43:25 UTC on bdcb31816ec0
build id 12434
ASAN enabled
I20260617 07:52:57.668782 569 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 07:52:57.670711 569 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 07:52:57.679266 577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:57.679301 578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:52:57.679948 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } attempt: 4
W20260617 07:52:57.682567 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111)
W20260617 07:52:57.683411 580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:52:57.683879 569 server_base.cc:1061] running on GCE node
I20260617 07:52:57.684635 569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 07:52:57.686143 569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 07:52:57.687358 569 hybrid_clock.cc:648] HybridClock initialized: now 1781682777687296 us; error 55 us; skew 500 ppm
I20260617 07:52:57.687736 569 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 07:52:57.690032 569 webserver.cc:533] Webserver started at http://127.0.105.188:43207/ using document root <none> and password file <none>
I20260617 07:52:57.690743 569 fs_manager.cc:362] Metadata directory not provided
I20260617 07:52:57.690855 569 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 07:52:57.691179 569 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 07:52:57.693508 569 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data/instance:
uuid: "3b274c37ad4445ba8b41d6784b3cd336"
format_stamp: "Formatted at 2026-06-17 07:52:57 on dist-test-slave-v0n2"
I20260617 07:52:57.694342 569 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal/instance:
uuid: "3b274c37ad4445ba8b41d6784b3cd336"
format_stamp: "Formatted at 2026-06-17 07:52:57 on dist-test-slave-v0n2"
I20260617 07:52:57.699633 569 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260617 07:52:57.703613 586 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:57.705084 569 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260617 07:52:57.705277 569 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data,/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
uuid: "3b274c37ad4445ba8b41d6784b3cd336"
format_stamp: "Formatted at 2026-06-17 07:52:57 on dist-test-slave-v0n2"
I20260617 07:52:57.705456 569 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 07:52:57.736881 569 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 07:52:57.738286 569 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 07:52:57.738624 569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 07:52:57.761550 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } attempt: 3
I20260617 07:52:57.761765 569 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.188:33087
I20260617 07:52:57.761691 637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.188:33087 every 8 connection(s)
I20260617 07:52:57.764360 569 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data/info.pb
I20260617 07:52:57.765697 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu as pid 569
I20260617 07:52:57.765956 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal/instance
I20260617 07:52:57.769966 639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:52:57.780220 639 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } has no permanent_uuid. Determining permanent_uuid...
I20260617 07:52:57.785790 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Bootstrap starting.
I20260617 07:52:57.792196 496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Neither blocks nor log segments found. Creating new log.
I20260617 07:52:57.794325 496 log.cc:826] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Log is configured to *not* fsync() on all Append() calls
I20260617 07:52:57.802384 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: No bootstrap required, opened a new log
I20260617 07:52:57.810976 639 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } has no permanent_uuid. Determining permanent_uuid...
I20260617 07:52:57.811651 496 raft_consensus.cc:359] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:57.812038 496 raft_consensus.cc:385] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:52:57.813019 496 raft_consensus.cc:740] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becdd6b4fad846399c95f04697e01d0f, State: Initialized, Role: FOLLOWER
I20260617 07:52:57.813752 496 consensus_queue.cc:260] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:57.814690 646 sys_catalog.cc:455] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:57.815022 646 sys_catalog.cc:458] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:52:57.815977 496 sys_catalog.cc:565] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: configured and running, proceeding with master startup.
I20260617 07:52:57.818670 639 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } has no permanent_uuid. Determining permanent_uuid...
I20260617 07:52:57.830313 639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: Bootstrap starting.
I20260617 07:52:57.832336 430 master_runner.cc:187] Error getting master registration for 127.0.105.189:36505: OK, instance_id { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" instance_seqno: 1781682777277086 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260617 07:52:57.838485 430 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260617 07:52:57.838508 639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: Neither blocks nor log segments found. Creating new log.
I20260617 07:52:57.839825 639 log.cc:826] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: Log is configured to *not* fsync() on all Append() calls
W20260617 07:52:57.842007 657 catalog_manager.cc:1593] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260617 07:52:57.842159 657 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260617 07:52:57.847556 639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: No bootstrap required, opened a new log
I20260617 07:52:57.857476 639 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:57.857867 639 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:52:57.857985 639 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b274c37ad4445ba8b41d6784b3cd336, State: Initialized, Role: FOLLOWER
I20260617 07:52:57.858690 639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:57.859653 660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:57.860847 639 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: configured and running, proceeding with master startup.
I20260617 07:52:57.861531 660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: This master's current role is: FOLLOWER
W20260617 07:52:57.875377 671 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260617 07:52:57.875509 671 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260617 07:52:57.872751 569 master_runner.cc:187] Error getting master registration for 127.0.105.189:36505: OK, instance_id { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" instance_seqno: 1781682777277086 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260617 07:52:57.879863 569 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260617 07:52:57.981801 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } attempt: 5
W20260617 07:52:57.990981 592 tablet.cc:2406] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 07:52:57.994817 567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Bootstrap starting.
I20260617 07:52:57.998891 567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Neither blocks nor log segments found. Creating new log.
I20260617 07:52:58.000219 567 log.cc:826] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Log is configured to *not* fsync() on all Append() calls
I20260617 07:52:58.003681 567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: No bootstrap required, opened a new log
I20260617 07:52:58.011080 567 raft_consensus.cc:359] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:58.012243 567 raft_consensus.cc:385] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:52:58.012380 567 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29a94ff9f875443ab6aeac00922cda0d, State: Initialized, Role: FOLLOWER
I20260617 07:52:58.013175 567 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:58.014509 674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:58.014866 674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:52:58.015820 567 sys_catalog.cc:565] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: configured and running, proceeding with master startup.
I20260617 07:52:58.030541 500 master_runner.cc:264] No leader master found from master 29a94ff9f875443ab6aeac00922cda0d
I20260617 07:52:58.030668 500 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260617 07:52:58.037587 685 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260617 07:52:58.037874 685 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260617 07:52:58.041139 674 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:52:58.041383 674 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:58.043537 674 leader_election.cc:290] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becdd6b4fad846399c95f04697e01d0f (127.0.105.190:41615), 3b274c37ad4445ba8b41d6784b3cd336 (127.0.105.188:33087)
I20260617 07:52:58.045116 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29a94ff9f875443ab6aeac00922cda0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becdd6b4fad846399c95f04697e01d0f" is_pre_election: true
I20260617 07:52:58.045624 471 raft_consensus.cc:2468] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29a94ff9f875443ab6aeac00922cda0d in term 0.
I20260617 07:52:58.046276 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29a94ff9f875443ab6aeac00922cda0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b274c37ad4445ba8b41d6784b3cd336" is_pre_election: true
I20260617 07:52:58.046706 613 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29a94ff9f875443ab6aeac00922cda0d in term 0.
I20260617 07:52:58.047518 518 leader_election.cc:304] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29a94ff9f875443ab6aeac00922cda0d, 3b274c37ad4445ba8b41d6784b3cd336; no voters:
I20260617 07:52:58.048501 674 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:52:58.048640 674 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:52:58.048741 674 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:52:58.052105 674 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:58.053596 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29a94ff9f875443ab6aeac00922cda0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becdd6b4fad846399c95f04697e01d0f"
I20260617 07:52:58.053819 471 raft_consensus.cc:3060] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:52:58.056957 471 raft_consensus.cc:2468] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29a94ff9f875443ab6aeac00922cda0d in term 1.
I20260617 07:52:58.057456 516 leader_election.cc:304] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29a94ff9f875443ab6aeac00922cda0d, becdd6b4fad846399c95f04697e01d0f; no voters:
W20260617 07:52:58.060650 450 tablet.cc:2406] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 07:52:58.060771 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29a94ff9f875443ab6aeac00922cda0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b274c37ad4445ba8b41d6784b3cd336"
I20260617 07:52:58.060954 613 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:52:58.064662 613 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29a94ff9f875443ab6aeac00922cda0d in term 1.
I20260617 07:52:58.065529 674 leader_election.cc:290] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [CANDIDATE]: Term 1 election: Requested vote from peers becdd6b4fad846399c95f04697e01d0f (127.0.105.190:41615), 3b274c37ad4445ba8b41d6784b3cd336 (127.0.105.188:33087)
I20260617 07:52:58.065809 674 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:52:58.065963 674 raft_consensus.cc:697] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 1 LEADER]: Becoming Leader. State: Replica: 29a94ff9f875443ab6aeac00922cda0d, State: Running, Role: LEADER
I20260617 07:52:58.066478 674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:58.084081 687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29a94ff9f875443ab6aeac00922cda0d. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:58.084456 687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: This master's current role is: LEADER
I20260617 07:52:58.098403 689 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260617 07:52:58.101260 689 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260617 07:52:58.119237 613 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Refusing update from remote peer 29a94ff9f875443ab6aeac00922cda0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:52:58.120263 687 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:52:58.130906 471 raft_consensus.cc:1275] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Refusing update from remote peer 29a94ff9f875443ab6aeac00922cda0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:52:58.132032 687 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:52:58.150597 646 sys_catalog.cc:455] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29a94ff9f875443ab6aeac00922cda0d. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:58.150887 646 sys_catalog.cc:458] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:52:58.156471 690 mvcc.cc:204] Tried to move back new op lower bound from 7297772659162054656 to 7297772658973134848. Current Snapshot: MvccSnapshot[applied={T|T < 7297772659162054656}]
I20260617 07:52:58.157214 692 mvcc.cc:204] Tried to move back new op lower bound from 7297772659162054656 to 7297772658973134848. Current Snapshot: MvccSnapshot[applied={T|T < 7297772659162054656}]
I20260617 07:52:58.165303 674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:58.165661 674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: This master's current role is: LEADER
I20260617 07:52:58.167318 689 catalog_manager.cc:1382] Generated new cluster ID: 6a36b51fde3b4c70a9a0683607c17859
I20260617 07:52:58.167420 689 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260617 07:52:58.171639 660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29a94ff9f875443ab6aeac00922cda0d. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:58.171877 660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:52:58.173189 687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:58.173362 687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: This master's current role is: LEADER
I20260617 07:52:58.177829 691 mvcc.cc:204] Tried to move back new op lower bound from 7297772659162054656 to 7297772658973134848. Current Snapshot: MvccSnapshot[applied={T|T < 7297772659162054656}]
I20260617 07:52:58.188287 660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:58.188832 660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:52:58.188853 646 sys_catalog.cc:455] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:52:58.189051 646 sys_catalog.cc:458] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:52:58.198202 689 catalog_manager.cc:1405] Generated new certificate authority record
I20260617 07:52:58.200168 689 catalog_manager.cc:1539] Loading token signing keys...
I20260617 07:52:58.230023 689 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Generated new TSK 0
I20260617 07:52:58.231261 689 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260617 07:52:58.259497 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
/tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.129:0
--local_ip_for_outbound_sockets=127.0.105.129
--webserver_interface=127.0.105.129
--webserver_port=0
--tserver_master_addrs=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--builtin_ntp_servers=127.0.105.148:37851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260617 07:52:58.671630 698 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 07:52:58.671962 698 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 07:52:58.672041 698 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 07:52:58.680868 698 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 07:52:58.681035 698 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.129
I20260617 07:52:58.691807 698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:37851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.129
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 17 Jun 2026 07:43:25 UTC on bdcb31816ec0
build id 12434
ASAN enabled
I20260617 07:52:58.693399 698 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 07:52:58.695221 698 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 07:52:58.705253 704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:58.705302 703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:58.706221 706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:52:58.711526 698 server_base.cc:1061] running on GCE node
I20260617 07:52:58.712216 698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 07:52:58.713268 698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 07:52:58.714530 698 hybrid_clock.cc:648] HybridClock initialized: now 1781682778714470 us; error 53 us; skew 500 ppm
I20260617 07:52:58.714957 698 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 07:52:58.717473 698 webserver.cc:533] Webserver started at http://127.0.105.129:44763/ using document root <none> and password file <none>
I20260617 07:52:58.718336 698 fs_manager.cc:362] Metadata directory not provided
I20260617 07:52:58.718431 698 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 07:52:58.718741 698 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 07:52:58.721372 698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/data/instance:
uuid: "6438857e0a7741ceaadf84cb9dc979e7"
format_stamp: "Formatted at 2026-06-17 07:52:58 on dist-test-slave-v0n2"
I20260617 07:52:58.722138 698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/instance:
uuid: "6438857e0a7741ceaadf84cb9dc979e7"
format_stamp: "Formatted at 2026-06-17 07:52:58 on dist-test-slave-v0n2"
I20260617 07:52:58.727416 698 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260617 07:52:58.730849 712 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:58.732383 698 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260617 07:52:58.732650 698 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal
uuid: "6438857e0a7741ceaadf84cb9dc979e7"
format_stamp: "Formatted at 2026-06-17 07:52:58 on dist-test-slave-v0n2"
I20260617 07:52:58.732844 698 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 07:52:58.749420 698 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 07:52:58.750443 698 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 07:52:58.750722 698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 07:52:58.751709 698 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260617 07:52:58.753316 698 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260617 07:52:58.753443 698 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:58.753561 698 ts_tablet_manager.cc:616] Registered 0 tablets
I20260617 07:52:58.753645 698 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:58.792814 698 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.129:37545
I20260617 07:52:58.792863 824 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.129:37545 every 8 connection(s)
I20260617 07:52:58.794893 698 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/data/info.pb
I20260617 07:52:58.802910 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu as pid 698
I20260617 07:52:58.803175 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/instance
I20260617 07:52:58.811396 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
/tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.130:0
--local_ip_for_outbound_sockets=127.0.105.130
--webserver_interface=127.0.105.130
--webserver_port=0
--tserver_master_addrs=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--builtin_ntp_servers=127.0.105.148:37851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260617 07:52:58.835083 825 heartbeater.cc:344] Connected to a master server at 127.0.105.188:33087
I20260617 07:52:58.835083 826 heartbeater.cc:344] Connected to a master server at 127.0.105.190:41615
I20260617 07:52:58.835121 827 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:52:58.835546 826 heartbeater.cc:461] Registering TS with master...
I20260617 07:52:58.835551 827 heartbeater.cc:461] Registering TS with master...
I20260617 07:52:58.835546 825 heartbeater.cc:461] Registering TS with master...
I20260617 07:52:58.836848 825 heartbeater.cc:507] Master 127.0.105.188:33087 requested a full tablet report, sending...
I20260617 07:52:58.836887 827 heartbeater.cc:507] Master 127.0.105.189:36505 requested a full tablet report, sending...
I20260617 07:52:58.837157 826 heartbeater.cc:507] Master 127.0.105.190:41615 requested a full tablet report, sending...
I20260617 07:52:58.839356 461 ts_manager.cc:194] Registered new tserver with Master: 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:52:58.839371 603 ts_manager.cc:194] Registered new tserver with Master: 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:52:58.839349 532 ts_manager.cc:194] Registered new tserver with Master: 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:52:58.841120 532 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.129:48765
I20260617 07:52:58.843940 657 catalog_manager.cc:1294] Loaded cluster ID: 6a36b51fde3b4c70a9a0683607c17859
I20260617 07:52:58.844058 657 catalog_manager.cc:1587] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: loading cluster ID for follower catalog manager: success
I20260617 07:52:58.847281 657 catalog_manager.cc:1609] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: acquiring CA information for follower catalog manager: success
I20260617 07:52:58.849267 657 catalog_manager.cc:1637] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260617 07:52:58.877924 671 catalog_manager.cc:1294] Loaded cluster ID: 6a36b51fde3b4c70a9a0683607c17859
I20260617 07:52:58.878049 671 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: loading cluster ID for follower catalog manager: success
I20260617 07:52:58.880962 671 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: acquiring CA information for follower catalog manager: success
I20260617 07:52:58.882851 671 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260617 07:52:59.183378 835 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 07:52:59.183672 835 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 07:52:59.183882 835 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 07:52:59.192830 835 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 07:52:59.193078 835 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.130
I20260617 07:52:59.203405 835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:37851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.130
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 17 Jun 2026 07:43:25 UTC on bdcb31816ec0
build id 12434
ASAN enabled
I20260617 07:52:59.204427 839 raft_consensus.cc:493] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29a94ff9f875443ab6aeac00922cda0d)
I20260617 07:52:59.204665 839 raft_consensus.cc:515] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:52:59.205380 835 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 07:52:59.206167 839 leader_election.cc:290] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505), 3b274c37ad4445ba8b41d6784b3cd336 (127.0.105.188:33087)
I20260617 07:52:59.206780 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "becdd6b4fad846399c95f04697e01d0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b274c37ad4445ba8b41d6784b3cd336" is_pre_election: true
I20260617 07:52:59.206845 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "becdd6b4fad846399c95f04697e01d0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "29a94ff9f875443ab6aeac00922cda0d" is_pre_election: true
I20260617 07:52:59.207779 835 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260617 07:52:59.207705 446 leader_election.cc:304] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becdd6b4fad846399c95f04697e01d0f; no voters: 29a94ff9f875443ab6aeac00922cda0d, 3b274c37ad4445ba8b41d6784b3cd336
I20260617 07:52:59.208070 839 raft_consensus.cc:2749] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260617 07:52:59.218046 841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:59.218071 842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:59.219313 844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:52:59.219869 835 server_base.cc:1061] running on GCE node
I20260617 07:52:59.220463 835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 07:52:59.221439 835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 07:52:59.222669 835 hybrid_clock.cc:648] HybridClock initialized: now 1781682779222626 us; error 59 us; skew 500 ppm
I20260617 07:52:59.223016 835 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 07:52:59.225015 835 webserver.cc:533] Webserver started at http://127.0.105.130:36357/ using document root <none> and password file <none>
I20260617 07:52:59.225991 835 fs_manager.cc:362] Metadata directory not provided
I20260617 07:52:59.226118 835 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 07:52:59.226487 835 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 07:52:59.230264 835 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/data/instance:
uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
format_stamp: "Formatted at 2026-06-17 07:52:59 on dist-test-slave-v0n2"
I20260617 07:52:59.231238 835 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/instance:
uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
format_stamp: "Formatted at 2026-06-17 07:52:59 on dist-test-slave-v0n2"
I20260617 07:52:59.236570 835 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260617 07:52:59.239876 850 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:59.241591 835 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260617 07:52:59.241804 835 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal
uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
format_stamp: "Formatted at 2026-06-17 07:52:59 on dist-test-slave-v0n2"
I20260617 07:52:59.242019 835 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 07:52:59.260529 835 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 07:52:59.261399 835 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 07:52:59.261673 835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 07:52:59.262765 835 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260617 07:52:59.264362 835 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260617 07:52:59.264479 835 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:59.264626 835 ts_tablet_manager.cc:616] Registered 0 tablets
I20260617 07:52:59.265166 835 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:59.302229 835 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.130:38879
I20260617 07:52:59.302325 962 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.130:38879 every 8 connection(s)
I20260617 07:52:59.303699 835 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/data/info.pb
I20260617 07:52:59.311214 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu as pid 835
I20260617 07:52:59.311409 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/instance
I20260617 07:52:59.316926 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
/tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.131:0
--local_ip_for_outbound_sockets=127.0.105.131
--webserver_interface=127.0.105.131
--webserver_port=0
--tserver_master_addrs=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--builtin_ntp_servers=127.0.105.148:37851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260617 07:52:59.333088 964 heartbeater.cc:344] Connected to a master server at 127.0.105.190:41615
I20260617 07:52:59.333572 965 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:52:59.333741 964 heartbeater.cc:461] Registering TS with master...
I20260617 07:52:59.333843 965 heartbeater.cc:461] Registering TS with master...
I20260617 07:52:59.334311 963 heartbeater.cc:344] Connected to a master server at 127.0.105.188:33087
I20260617 07:52:59.334432 963 heartbeater.cc:461] Registering TS with master...
I20260617 07:52:59.334923 964 heartbeater.cc:507] Master 127.0.105.190:41615 requested a full tablet report, sending...
I20260617 07:52:59.335014 963 heartbeater.cc:507] Master 127.0.105.188:33087 requested a full tablet report, sending...
I20260617 07:52:59.336123 965 heartbeater.cc:507] Master 127.0.105.189:36505 requested a full tablet report, sending...
I20260617 07:52:59.336733 603 ts_manager.cc:194] Registered new tserver with Master: 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:52:59.336771 461 ts_manager.cc:194] Registered new tserver with Master: 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:52:59.337069 532 ts_manager.cc:194] Registered new tserver with Master: 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:52:59.338191 532 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.130:46577
I20260617 07:52:59.343904 827 heartbeater.cc:499] Master 127.0.105.189:36505 was elected leader, sending a full tablet report...
W20260617 07:52:59.668592 970 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 07:52:59.668902 970 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 07:52:59.668982 970 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 07:52:59.677500 970 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 07:52:59.677663 970 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.131
I20260617 07:52:59.688517 970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:37851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.131
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 17 Jun 2026 07:43:25 UTC on bdcb31816ec0
build id 12434
ASAN enabled
I20260617 07:52:59.690171 970 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 07:52:59.691984 970 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 07:52:59.702373 975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:59.702360 976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 07:52:59.703696 978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:52:59.703791 970 server_base.cc:1061] running on GCE node
I20260617 07:52:59.704361 970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 07:52:59.705274 970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 07:52:59.706516 970 hybrid_clock.cc:648] HybridClock initialized: now 1781682779706454 us; error 51 us; skew 500 ppm
I20260617 07:52:59.706787 970 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 07:52:59.708881 970 webserver.cc:533] Webserver started at http://127.0.105.131:46537/ using document root <none> and password file <none>
I20260617 07:52:59.709570 970 fs_manager.cc:362] Metadata directory not provided
I20260617 07:52:59.709656 970 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 07:52:59.710022 970 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 07:52:59.712375 970 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/data/instance:
uuid: "dc3bec007846459a9da0c7b8211e477b"
format_stamp: "Formatted at 2026-06-17 07:52:59 on dist-test-slave-v0n2"
I20260617 07:52:59.713068 970 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/instance:
uuid: "dc3bec007846459a9da0c7b8211e477b"
format_stamp: "Formatted at 2026-06-17 07:52:59 on dist-test-slave-v0n2"
I20260617 07:52:59.718925 970 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260617 07:52:59.722443 984 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:59.723729 970 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260617 07:52:59.723902 970 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal
uuid: "dc3bec007846459a9da0c7b8211e477b"
format_stamp: "Formatted at 2026-06-17 07:52:59 on dist-test-slave-v0n2"
I20260617 07:52:59.724097 970 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 07:52:59.748654 970 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 07:52:59.749548 970 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 07:52:59.749861 970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 07:52:59.750788 970 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260617 07:52:59.752458 970 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260617 07:52:59.752542 970 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:59.752669 970 ts_tablet_manager.cc:616] Registered 0 tablets
I20260617 07:52:59.752740 970 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260617 07:52:59.791214 970 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.131:36497
I20260617 07:52:59.791294 1096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.131:36497 every 8 connection(s)
I20260617 07:52:59.792937 970 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/data/info.pb
I20260617 07:52:59.796706 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu as pid 970
I20260617 07:52:59.796931 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/instance
I20260617 07:52:59.828001 1097 heartbeater.cc:344] Connected to a master server at 127.0.105.188:33087
I20260617 07:52:59.828451 1097 heartbeater.cc:461] Registering TS with master...
I20260617 07:52:59.829041 1098 heartbeater.cc:344] Connected to a master server at 127.0.105.190:41615
I20260617 07:52:59.829195 1098 heartbeater.cc:461] Registering TS with master...
I20260617 07:52:59.829886 1098 heartbeater.cc:507] Master 127.0.105.190:41615 requested a full tablet report, sending...
I20260617 07:52:59.830808 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:52:59.830837 1097 heartbeater.cc:507] Master 127.0.105.188:33087 requested a full tablet report, sending...
I20260617 07:52:59.830976 1099 heartbeater.cc:461] Registering TS with master...
I20260617 07:52:59.831478 1099 heartbeater.cc:507] Master 127.0.105.189:36505 requested a full tablet report, sending...
I20260617 07:52:59.831593 461 ts_manager.cc:194] Registered new tserver with Master: dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:52:59.832151 603 ts_manager.cc:194] Registered new tserver with Master: dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:52:59.833345 532 ts_manager.cc:194] Registered new tserver with Master: dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:52:59.834348 532 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.131:59513
I20260617 07:52:59.840267 965 heartbeater.cc:499] Master 127.0.105.189:36505 was elected leader, sending a full tablet report...
I20260617 07:52:59.842815 422 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260617 07:52:59.883592 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_0b5ccdac74d7404caefc0ff78f370dcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.890345 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b5ccdac74d7404caefc0ff78f370dcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.884044 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_7467de68f6d74c6bbd3a37480667066b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.894541 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7467de68f6d74c6bbd3a37480667066b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.885336 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5e8ce00f2e9248369c03ab25799d5796"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.897246 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e8ce00f2e9248369c03ab25799d5796 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.885057 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_f781983fd72045cfac84d72f29b63c34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.899555 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f781983fd72045cfac84d72f29b63c34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.885619 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_2c69686edad749b6af8e0552a533e02d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.901623 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c69686edad749b6af8e0552a533e02d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.884742 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_318c2cf0541341879f0fdad9d05953ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.903669 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_318c2cf0541341879f0fdad9d05953ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.883973 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.906076 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.884395 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_c28f7e20025146759d77b2e8c0fc3051"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.907488 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c28f7e20025146759d77b2e8c0fc3051 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.885751 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_70c6b89e24984f9b912dfa5ba55e392e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.909397 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70c6b89e24984f9b912dfa5ba55e392e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.876845 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_6c7c8b0f291242bab28aec0bed663691"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:52:59.912190 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c7c8b0f291242bab28aec0bed663691 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:52:59.983527 422 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu pid 569
I20260617 07:52:59.985140 633 generic_service.cc:196] Checking for leaks (request via RPC)
I20260617 07:52:59.998356 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6c7c8b0f291242bab28aec0bed663691" } modify_external_catalogs: true
I20260617 07:52:59.998648 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6c7c8b0f291242bab28aec0bed663691" } modify_external_catalogs: true
I20260617 07:52:59.999514 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5e8ce00f2e9248369c03ab25799d5796" } new_table_name: "default.Table_1733dc64eb804976ace6c98ee2a36e28" modify_external_catalogs: true
I20260617 07:52:59.999588 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_318c2cf0541341879f0fdad9d05953ab" } modify_external_catalogs: true
I20260617 07:52:59.999621 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f781983fd72045cfac84d72f29b63c34" } new_table_name: "default.Table_aa6c5dde465e46849c219300191d5bc6" modify_external_catalogs: true
I20260617 07:52:59.999841 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_318c2cf0541341879f0fdad9d05953ab" } modify_external_catalogs: true
I20260617 07:52:59.999958 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_70c6b89e24984f9b912dfa5ba55e392e" } modify_external_catalogs: true
I20260617 07:53:00.000118 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_70c6b89e24984f9b912dfa5ba55e392e" } modify_external_catalogs: true
I20260617 07:53:00.000219 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_2c69686edad749b6af8e0552a533e02d" } new_table_name: "default.Table_bcff2efa928f4bdd8af4e61f026f5c13" modify_external_catalogs: true
I20260617 07:53:00.000597 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_7467de68f6d74c6bbd3a37480667066b" } new_table_name: "default.Table_95abfaf925ae425f800bab4d50f12834" modify_external_catalogs: true
I20260617 07:53:00.001983 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0b5ccdac74d7404caefc0ff78f370dcc" } modify_external_catalogs: true
I20260617 07:53:00.002175 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0b5ccdac74d7404caefc0ff78f370dcc" } modify_external_catalogs: true
I20260617 07:52:59.999652 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65" } modify_external_catalogs: true
I20260617 07:53:00.003726 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65" } modify_external_catalogs: true
I20260617 07:53:00.004590 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c28f7e20025146759d77b2e8c0fc3051" } new_table_name: "default.Table_dd5654ae7c324d8aac1821cc250e7d2a" modify_external_catalogs: true
W20260617 07:53:00.009034 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f6fdc168bd4a4eaca86b24a986b4eb7d has no consensus state
W20260617 07:53:00.009524 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6a31e2ee09d4fa3a75943e2dc038692 has no consensus state
W20260617 07:53:00.012902 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8f7c36eac304694a96dcc41e2b1ea66 has no consensus state
W20260617 07:53:00.013145 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49b35cb92271401782d3338f2193d54a has no consensus state
W20260617 07:53:00.015547 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7e99ddce1e848139376d5188c754d46 has no consensus state
I20260617 07:53:00.027997 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 0b3a8a749ebb4707931355138f5fe323
I20260617 07:53:00.028061 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b
I20260617 07:53:00.036774 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 393af627c11a47bc8d8b5ae3d7f2bec6
I20260617 07:53:00.037627 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 822e4336ea9747d1b50cbbaf8babad29
W20260617 07:53:00.042920 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 49b35cb92271401782d3338f2193d54a (table default.Table_aa6c5dde465e46849c219300191d5bc6 [id=eac07ff3978e43898764f4ee3bf70397], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 49b35cb92271401782d3338f2193d54a consensus state has no leader
I20260617 07:53:00.045049 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.045104 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b3a8a749ebb4707931355138f5fe323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.046761 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 822e4336ea9747d1b50cbbaf8babad29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.046983 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.051302 894 tablet_service.cc:1511] Processing CreateTablet for tablet bb6d93a4b23246e0b73aae367270ac3a (DEFAULT_TABLE table=default.Table_0b5ccdac74d7404caefc0ff78f370dcc [id=fc74534573834b2dbbeeb343d0a2b192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.053242 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6d93a4b23246e0b73aae367270ac3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.058359 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:00.060285 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b because the tablet was not found. No further retry: Not found: Tablet not found: 7b3ac1e706b341bb9f0850bd4a6ccf4b
I20260617 07:53:00.060392 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet bb6d93a4b23246e0b73aae367270ac3a
I20260617 07:53:00.060918 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b3a8a749ebb4707931355138f5fe323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.061249 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.061578 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 822e4336ea9747d1b50cbbaf8babad29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.063148 897 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6d93a4b23246e0b73aae367270ac3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.063265 896 tablet_service.cc:1511] Processing CreateTablet for tablet 822e4336ea9747d1b50cbbaf8babad29 (DEFAULT_TABLE table=default.Table_6c7c8b0f291242bab28aec0bed663691 [id=a6f06301b17647c88411c624a9d830e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.063792 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822e4336ea9747d1b50cbbaf8babad29. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:00.065891 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0b3a8a749ebb4707931355138f5fe323 because the tablet was not found. No further retry: Not found: Tablet not found: 0b3a8a749ebb4707931355138f5fe323
I20260617 07:53:00.066123 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6d93a4b23246e0b73aae367270ac3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:00.066505 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 822e4336ea9747d1b50cbbaf8babad29 because the tablet was not found. No further retry: Not found: Tablet not found: 822e4336ea9747d1b50cbbaf8babad29
W20260617 07:53:00.067016 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 because the tablet was not found. No further retry: Not found: Tablet not found: 393af627c11a47bc8d8b5ae3d7f2bec6
I20260617 07:53:00.067018 1028 tablet_service.cc:1511] Processing CreateTablet for tablet bb6d93a4b23246e0b73aae367270ac3a (DEFAULT_TABLE table=default.Table_0b5ccdac74d7404caefc0ff78f370dcc [id=fc74534573834b2dbbeeb343d0a2b192]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:00.068560 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet bb6d93a4b23246e0b73aae367270ac3a because the tablet was not found. No further retry: Not found: Tablet not found: bb6d93a4b23246e0b73aae367270ac3a
I20260617 07:53:00.069273 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6d93a4b23246e0b73aae367270ac3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.077899 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 822e4336ea9747d1b50cbbaf8babad29 (DEFAULT_TABLE table=default.Table_6c7c8b0f291242bab28aec0bed663691 [id=a6f06301b17647c88411c624a9d830e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.078416 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822e4336ea9747d1b50cbbaf8babad29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.087106 897 tablet_service.cc:1511] Processing CreateTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 (DEFAULT_TABLE table=default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65 [id=129a4d59e15e4a1da3313e3c379ac2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.087563 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393af627c11a47bc8d8b5ae3d7f2bec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.087466 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 (DEFAULT_TABLE table=default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65 [id=129a4d59e15e4a1da3313e3c379ac2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.088454 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393af627c11a47bc8d8b5ae3d7f2bec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.088411 895 tablet_service.cc:1511] Processing CreateTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 (DEFAULT_TABLE table=default.Table_95abfaf925ae425f800bab4d50f12834 [id=69a653bfec384a5ca6613b1d188d8bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.088941 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a31e2ee09d4fa3a75943e2dc038692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.091245 1031 tablet_service.cc:1511] Processing CreateTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 (DEFAULT_TABLE table=default.Table_95abfaf925ae425f800bab4d50f12834 [id=69a653bfec384a5ca6613b1d188d8bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.091697 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a31e2ee09d4fa3a75943e2dc038692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.092211 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b (DEFAULT_TABLE table=default.Table_318c2cf0541341879f0fdad9d05953ab [id=d1c106200bd544229e408aa5452c6c7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.092841 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.096340 897 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3a8a749ebb4707931355138f5fe323 (DEFAULT_TABLE table=default.Table_70c6b89e24984f9b912dfa5ba55e392e [id=d8982b309f35412ca30783a3bbcc09e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.096748 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3a8a749ebb4707931355138f5fe323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.098239 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b (DEFAULT_TABLE table=default.Table_318c2cf0541341879f0fdad9d05953ab [id=d1c106200bd544229e408aa5452c6c7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.098802 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.106997 1171 tablet_bootstrap.cc:492] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.107501 1172 tablet_bootstrap.cc:492] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:00.111012 516 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b because the tablet was not found. No further retry: Not found: Tablet not found: 7b3ac1e706b341bb9f0850bd4a6ccf4b
W20260617 07:53:00.111821 516 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0b3a8a749ebb4707931355138f5fe323 because the tablet was not found. No further retry: Not found: Tablet not found: 0b3a8a749ebb4707931355138f5fe323
W20260617 07:53:00.112615 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 393af627c11a47bc8d8b5ae3d7f2bec6 already in progress: creating tablet
W20260617 07:53:00.113320 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 822e4336ea9747d1b50cbbaf8babad29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 822e4336ea9747d1b50cbbaf8babad29 already in progress: creating tablet
W20260617 07:53:00.113960 516 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet bb6d93a4b23246e0b73aae367270ac3a because the tablet was not found. No further retry: Not found: Tablet not found: bb6d93a4b23246e0b73aae367270ac3a
I20260617 07:53:00.116178 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 49b35cb92271401782d3338f2193d54a (DEFAULT_TABLE table=default.Table_aa6c5dde465e46849c219300191d5bc6 [id=eac07ff3978e43898764f4ee3bf70397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.116662 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b35cb92271401782d3338f2193d54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.116806 1172 tablet_bootstrap.cc:654] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.118080 1172 log.cc:826] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: Log is configured to *not* fsync() on all Append() calls
I20260617 07:53:00.119513 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3a8a749ebb4707931355138f5fe323 (DEFAULT_TABLE table=default.Table_70c6b89e24984f9b912dfa5ba55e392e [id=d8982b309f35412ca30783a3bbcc09e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.119939 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3a8a749ebb4707931355138f5fe323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.127403 894 tablet_service.cc:1511] Processing CreateTablet for tablet 49b35cb92271401782d3338f2193d54a (DEFAULT_TABLE table=default.Table_aa6c5dde465e46849c219300191d5bc6 [id=eac07ff3978e43898764f4ee3bf70397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.127874 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b35cb92271401782d3338f2193d54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.128824 1172 tablet_bootstrap.cc:492] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:00.129112 1172 ts_tablet_manager.cc:1403] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.000s
I20260617 07:53:00.130467 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 822e4336ea9747d1b50cbbaf8babad29 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.131510 527 master_service.cc:960] ReplaceTablet: received request to replace tablet d6a31e2ee09d4fa3a75943e2dc038692 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.133117 897 tablet_service.cc:1511] Processing CreateTablet for tablet e8f7c36eac304694a96dcc41e2b1ea66 (DEFAULT_TABLE table=default.Table_1733dc64eb804976ace6c98ee2a36e28 [id=2a25b9145c5a4982aaf43047c8214926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.133510 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f7c36eac304694a96dcc41e2b1ea66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.135385 1171 tablet_bootstrap.cc:654] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.135354 898 tablet_service.cc:1511] Processing CreateTablet for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (DEFAULT_TABLE table=default.Table_bcff2efa928f4bdd8af4e61f026f5c13 [id=b917e24e4cee4805b575b97ac7068195]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.135821 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fdc168bd4a4eaca86b24a986b4eb7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.138419 1029 tablet_service.cc:1511] Processing CreateTablet for tablet d7e99ddce1e848139376d5188c754d46 (DEFAULT_TABLE table=default.Table_dd5654ae7c324d8aac1821cc250e7d2a [id=83b4c82d614147749ec60adc74eda64a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.138815 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e99ddce1e848139376d5188c754d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.141383 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet d6a31e2ee09d4fa3a75943e2dc038692
I20260617 07:53:00.141904 527 catalog_manager.cc:6784] ReplaceTablet: tablet d6a31e2ee09d4fa3a75943e2dc038692 deleted and replaced by tablet a96d648af0a149e8a1e2ff42945b6fab
I20260617 07:53:00.142480 895 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 with delete_type TABLET_DATA_DELETED (replaced by tablet a96d648af0a149e8a1e2ff42945b6fab) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:00.143043 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d6a31e2ee09d4fa3a75943e2dc038692 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6a31e2ee09d4fa3a75943e2dc038692 already in progress: creating tablet
I20260617 07:53:00.143256 894 tablet_service.cc:1511] Processing CreateTablet for tablet d7e99ddce1e848139376d5188c754d46 (DEFAULT_TABLE table=default.Table_dd5654ae7c324d8aac1821cc250e7d2a [id=83b4c82d614147749ec60adc74eda64a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.143550 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 with delete_type TABLET_DATA_DELETED (replaced by tablet a96d648af0a149e8a1e2ff42945b6fab) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.143632 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e99ddce1e848139376d5188c754d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.144367 1030 tablet_service.cc:1511] Processing CreateTablet for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (DEFAULT_TABLE table=default.Table_bcff2efa928f4bdd8af4e61f026f5c13 [id=b917e24e4cee4805b575b97ac7068195]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.144999 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e8f7c36eac304694a96dcc41e2b1ea66 (DEFAULT_TABLE table=default.Table_1733dc64eb804976ace6c98ee2a36e28 [id=2a25b9145c5a4982aaf43047c8214926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.145282 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fdc168bd4a4eaca86b24a986b4eb7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.145542 1172 raft_consensus.cc:359] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.145963 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f7c36eac304694a96dcc41e2b1ea66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.146071 1172 raft_consensus.cc:385] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.146189 1172 raft_consensus.cc:740] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.147153 1172 consensus_queue.cc:260] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.148053 532 master_service.cc:960] ReplaceTablet: received request to replace tablet bb6d93a4b23246e0b73aae367270ac3a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.148703 530 master_service.cc:960] ReplaceTablet: received request to replace tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.149598 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b3a8a749ebb4707931355138f5fe323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.151592 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.151901 755 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6d93a4b23246e0b73aae367270ac3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.154066 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.154209 754 tablet_service.cc:1511] Processing CreateTablet for tablet 822e4336ea9747d1b50cbbaf8babad29 (DEFAULT_TABLE table=default.Table_6c7c8b0f291242bab28aec0bed663691 [id=a6f06301b17647c88411c624a9d830e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.153811 760 tablet_service.cc:1511] Processing CreateTablet for tablet bb6d93a4b23246e0b73aae367270ac3a (DEFAULT_TABLE table=default.Table_0b5ccdac74d7404caefc0ff78f370dcc [id=fc74534573834b2dbbeeb343d0a2b192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.155315 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 822e4336ea9747d1b50cbbaf8babad29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.155634 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:00.155671 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d6a31e2ee09d4fa3a75943e2dc038692 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6a31e2ee09d4fa3a75943e2dc038692 already in progress: creating tablet
I20260617 07:53:00.155905 753 tablet_service.cc:1511] Processing CreateTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 (DEFAULT_TABLE table=default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65 [id=129a4d59e15e4a1da3313e3c379ac2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.156077 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6d93a4b23246e0b73aae367270ac3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.156597 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393af627c11a47bc8d8b5ae3d7f2bec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.156497 1171 log.cc:826] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: Log is configured to *not* fsync() on all Append() calls
I20260617 07:53:00.158249 755 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3a8a749ebb4707931355138f5fe323 (DEFAULT_TABLE table=default.Table_70c6b89e24984f9b912dfa5ba55e392e [id=d8982b309f35412ca30783a3bbcc09e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.158937 752 tablet_service.cc:1511] Processing CreateTablet for tablet e8f7c36eac304694a96dcc41e2b1ea66 (DEFAULT_TABLE table=default.Table_1733dc64eb804976ace6c98ee2a36e28 [id=2a25b9145c5a4982aaf43047c8214926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.159117 751 tablet_service.cc:1511] Processing CreateTablet for tablet d7e99ddce1e848139376d5188c754d46 (DEFAULT_TABLE table=default.Table_dd5654ae7c324d8aac1821cc250e7d2a [id=83b4c82d614147749ec60adc74eda64a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.160070 756 tablet_service.cc:1511] Processing CreateTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b (DEFAULT_TABLE table=default.Table_318c2cf0541341879f0fdad9d05953ab [id=d1c106200bd544229e408aa5452c6c7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.162117 749 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 with delete_type TABLET_DATA_DELETED (replaced by tablet a96d648af0a149e8a1e2ff42945b6fab) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.162811 750 tablet_service.cc:1511] Processing CreateTablet for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (DEFAULT_TABLE table=default.Table_bcff2efa928f4bdd8af4e61f026f5c13 [id=b917e24e4cee4805b575b97ac7068195]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.163322 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822e4336ea9747d1b50cbbaf8babad29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.164256 757 tablet_service.cc:1511] Processing CreateTablet for tablet 49b35cb92271401782d3338f2193d54a (DEFAULT_TABLE table=default.Table_aa6c5dde465e46849c219300191d5bc6 [id=eac07ff3978e43898764f4ee3bf70397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.166320 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f7c36eac304694a96dcc41e2b1ea66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.166188 897 tablet_service.cc:1511] Processing CreateTablet for tablet a96d648af0a149e8a1e2ff42945b6fab (DEFAULT_TABLE table=default.Table_95abfaf925ae425f800bab4d50f12834 [id=69a653bfec384a5ca6613b1d188d8bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.163826 758 tablet_service.cc:1511] Processing CreateTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 (DEFAULT_TABLE table=default.Table_95abfaf925ae425f800bab4d50f12834 [id=69a653bfec384a5ca6613b1d188d8bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.167040 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96d648af0a149e8a1e2ff42945b6fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.167385 749 tablet_service.cc:1511] Processing CreateTablet for tablet a96d648af0a149e8a1e2ff42945b6fab (DEFAULT_TABLE table=default.Table_95abfaf925ae425f800bab4d50f12834 [id=69a653bfec384a5ca6613b1d188d8bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.168123 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3a8a749ebb4707931355138f5fe323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.168876 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e99ddce1e848139376d5188c754d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.167100 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a96d648af0a149e8a1e2ff42945b6fab (DEFAULT_TABLE table=default.Table_95abfaf925ae425f800bab4d50f12834 [id=69a653bfec384a5ca6613b1d188d8bc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.173997 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:00.177765 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0b3a8a749ebb4707931355138f5fe323 because the tablet was not found. No further retry: Not found: Tablet not found: 0b3a8a749ebb4707931355138f5fe323
I20260617 07:53:00.177913 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fdc168bd4a4eaca86b24a986b4eb7d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:00.178054 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 because the tablet was not found. No further retry: Not found: Tablet not found: 393af627c11a47bc8d8b5ae3d7f2bec6
W20260617 07:53:00.178300 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bb6d93a4b23246e0b73aae367270ac3a because the tablet was not found. No further retry: Not found: Tablet not found: bb6d93a4b23246e0b73aae367270ac3a
W20260617 07:53:00.178519 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 822e4336ea9747d1b50cbbaf8babad29 because the tablet was not found. No further retry: Not found: Tablet not found: 822e4336ea9747d1b50cbbaf8babad29
I20260617 07:53:00.172856 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96d648af0a149e8a1e2ff42945b6fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.179708 1099 heartbeater.cc:499] Master 127.0.105.189:36505 was elected leader, sending a full tablet report...
I20260617 07:53:00.182252 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b35cb92271401782d3338f2193d54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.183476 1172 ts_tablet_manager.cc:1434] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.054s user 0.005s sys 0.010s
I20260617 07:53:00.184046 1172 tablet_bootstrap.cc:492] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:00.184391 527 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 49b35cb92271401782d3338f2193d54a (table default.Table_aa6c5dde465e46849c219300191d5bc6 [id=eac07ff3978e43898764f4ee3bf70397]). Expected version 1 got 0
I20260617 07:53:00.184710 527 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_bcff2efa928f4bdd8af4e61f026f5c13 [id=b917e24e4cee4805b575b97ac7068195]). Expected version 1 got 0
I20260617 07:53:00.184919 527 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e8f7c36eac304694a96dcc41e2b1ea66 (table default.Table_1733dc64eb804976ace6c98ee2a36e28 [id=2a25b9145c5a4982aaf43047c8214926]). Expected version 1 got 0
I20260617 07:53:00.185055 527 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d7e99ddce1e848139376d5188c754d46 (table default.Table_dd5654ae7c324d8aac1821cc250e7d2a [id=83b4c82d614147749ec60adc74eda64a]). Expected version 1 got 0
I20260617 07:53:00.185845 1172 tablet_bootstrap.cc:654] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.185915 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a31e2ee09d4fa3a75943e2dc038692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.189406 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96d648af0a149e8a1e2ff42945b6fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.195066 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 822e4336ea9747d1b50cbbaf8babad29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.195504 1170 tablet_replica.cc:333] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:00.196123 1170 raft_consensus.cc:2243] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.196660 1170 raft_consensus.cc:2272] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.198899 1170 ts_tablet_manager.cc:1916] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.201004 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b3a8a749ebb4707931355138f5fe323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.201232 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.202710 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_549f28edd3154174b8b8bca2e1ab902e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.203487 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_549f28edd3154174b8b8bca2e1ab902e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.211042 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6d93a4b23246e0b73aae367270ac3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.226090 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_31c6f40eef3841b19eabe692395c866a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.226748 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31c6f40eef3841b19eabe692395c866a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.227301 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.228611 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b5ea244188ba423a926d78f48e818554"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.229135 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5ea244188ba423a926d78f48e818554 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.229063 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_8b1fdc750b3c4dcca79f18783124f6c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.229411 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_2b271e2563664a57a954aa99a29e38ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.229591 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b1fdc750b3c4dcca79f18783124f6c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:00.229903 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b271e2563664a57a954aa99a29e38ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.229954 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_42257d73daae45b4aaa3907369586926"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.230405 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42257d73daae45b4aaa3907369586926 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.230831 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_579d624a64244301bd5648e35f0d2a44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.231127 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_36ddf91375d64de9b2931c2694140490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.231254 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_579d624a64244301bd5648e35f0d2a44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:00.231539 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36ddf91375d64de9b2931c2694140490 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.232406 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_82181faa1432405cb6318acfa88304a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.232828 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82181faa1432405cb6318acfa88304a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:00.233202 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b because the tablet was not found. No further retry: Not found: Tablet not found: 7b3ac1e706b341bb9f0850bd4a6ccf4b
W20260617 07:53:00.233448 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d6a31e2ee09d4fa3a75943e2dc038692 because the tablet was not found. No further retry: Not found: Tablet not found: d6a31e2ee09d4fa3a75943e2dc038692
I20260617 07:53:00.234300 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_8bc6c29531e84f969b0890ef763e2072"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.234735 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bc6c29531e84f969b0890ef763e2072 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.238379 1171 tablet_bootstrap.cc:492] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.238700 1171 ts_tablet_manager.cc:1403] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.132s user 0.008s sys 0.002s
I20260617 07:53:00.246699 1178 tablet_bootstrap.cc:492] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.247087 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 with delete_type TABLET_DATA_DELETED (replaced by tablet a96d648af0a149e8a1e2ff42945b6fab) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.249603 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_95abfaf925ae425f800bab4d50f12834" } new_table_name: "default.Table_167010d9aec6407bac68c570998189ec" modify_external_catalogs: true
I20260617 07:53:00.251458 1178 tablet_bootstrap.cc:654] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.252767 1178 log.cc:826] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: Log is configured to *not* fsync() on all Append() calls
I20260617 07:53:00.253811 1171 raft_consensus.cc:359] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.254228 1171 raft_consensus.cc:385] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.254318 1171 raft_consensus.cc:740] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.255143 1171 consensus_queue.cc:260] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.260771 1171 ts_tablet_manager.cc:1434] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.022s user 0.010s sys 0.002s
I20260617 07:53:00.263636 1171 tablet_bootstrap.cc:492] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.265460 1171 tablet_bootstrap.cc:654] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.265816 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bcff2efa928f4bdd8af4e61f026f5c13" } new_table_name: "default.Table_0341227ad84c491bb7508718c27fa411" modify_external_catalogs: true
I20260617 07:53:00.265976 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_dd5654ae7c324d8aac1821cc250e7d2a" } new_table_name: "default.Table_f9ff44e392af4f8bb43efa1aec72265d" modify_external_catalogs: true
I20260617 07:53:00.267110 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_aa6c5dde465e46849c219300191d5bc6" } new_table_name: "default.Table_b54e01e759c64a6eaf65d07c96a310a6" modify_external_catalogs: true
I20260617 07:53:00.267446 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1733dc64eb804976ace6c98ee2a36e28" } new_table_name: "default.Table_786bf0435df54f028aefdf1a94cef6f2" modify_external_catalogs: true
I20260617 07:53:00.269403 1178 tablet_bootstrap.cc:492] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.269574 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 822e4336ea9747d1b50cbbaf8babad29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.269708 1178 ts_tablet_manager.cc:1403] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.007s
I20260617 07:53:00.270093 1169 tablet_replica.cc:333] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:00.270520 1169 raft_consensus.cc:2243] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.270901 1169 raft_consensus.cc:2272] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.272492 1169 ts_tablet_manager.cc:1916] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.279121 1169 ts_tablet_manager.cc:1929] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.281154 1169 log.cc:1199] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/822e4336ea9747d1b50cbbaf8babad29
I20260617 07:53:00.281843 1169 ts_tablet_manager.cc:1950] T 822e4336ea9747d1b50cbbaf8babad29 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:00.283692 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 822e4336ea9747d1b50cbbaf8babad29 (table default.Table_6c7c8b0f291242bab28aec0bed663691 [id=a6f06301b17647c88411c624a9d830e7]) successfully deleted
I20260617 07:53:00.284632 1171 tablet_bootstrap.cc:492] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.284766 1171 ts_tablet_manager.cc:1403] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260617 07:53:00.285449 1171 raft_consensus.cc:359] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.285629 1171 raft_consensus.cc:385] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.285965 1171 raft_consensus.cc:740] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.286247 1171 consensus_queue.cc:260] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.286855 1171 ts_tablet_manager.cc:1434] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 07:53:00.287124 1171 tablet_bootstrap.cc:492] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.289582 1171 tablet_bootstrap.cc:654] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.301478 1178 raft_consensus.cc:359] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.302011 1178 raft_consensus.cc:385] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.302145 1178 raft_consensus.cc:740] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.303529 1178 consensus_queue.cc:260] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:00.306814 966 tablet.cc:2406] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 07:53:00.308305 422 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu with pid 569
I20260617 07:53:00.312883 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.313150 1169 tablet_replica.cc:333] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:00.313529 1169 raft_consensus.cc:2243] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.313769 1169 raft_consensus.cc:2272] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.314527 1169 ts_tablet_manager.cc:1916] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:00.315408 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a96d648af0a149e8a1e2ff42945b6fab consensus state has no leader
I20260617 07:53:00.317508 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.317548 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 627c7ce6b0954176a1044b65543c04ec (DEFAULT_TABLE table=default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.318423 897 tablet_service.cc:1511] Processing CreateTablet for tablet 627c7ce6b0954176a1044b65543c04ec (DEFAULT_TABLE table=default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.318838 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627c7ce6b0954176a1044b65543c04ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.320549 760 tablet_service.cc:1511] Processing CreateTablet for tablet 627c7ce6b0954176a1044b65543c04ec (DEFAULT_TABLE table=default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.320984 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627c7ce6b0954176a1044b65543c04ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:00.321985 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b already in progress: creating tablet
I20260617 07:53:00.328405 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_167010d9aec6407bac68c570998189ec" } modify_external_catalogs: true
I20260617 07:53:00.328596 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_167010d9aec6407bac68c570998189ec" } modify_external_catalogs: true
I20260617 07:53:00.329793 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_2b271e2563664a57a954aa99a29e38ce" } modify_external_catalogs: true
I20260617 07:53:00.330035 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_2b271e2563664a57a954aa99a29e38ce" } modify_external_catalogs: true
I20260617 07:53:00.330739 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_8b1fdc750b3c4dcca79f18783124f6c1" } modify_external_catalogs: true
I20260617 07:53:00.330895 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_8b1fdc750b3c4dcca79f18783124f6c1" } modify_external_catalogs: true
I20260617 07:53:00.331730 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_82181faa1432405cb6318acfa88304a3" } modify_external_catalogs: true
I20260617 07:53:00.331890 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_82181faa1432405cb6318acfa88304a3" } modify_external_catalogs: true
I20260617 07:53:00.335188 1169 ts_tablet_manager.cc:1929] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.335446 1169 log.cc:1199] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/393af627c11a47bc8d8b5ae3d7f2bec6
I20260617 07:53:00.335899 1169 ts_tablet_manager.cc:1950] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:00.337060 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 393af627c11a47bc8d8b5ae3d7f2bec6 (table default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65 [id=129a4d59e15e4a1da3313e3c379ac2ff]) successfully deleted
I20260617 07:53:00.337345 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627c7ce6b0954176a1044b65543c04ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.352344 528 master_service.cc:960] ReplaceTablet: received request to replace tablet a96d648af0a149e8a1e2ff42945b6fab from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.373871 1170 ts_tablet_manager.cc:1929] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.374118 1170 log.cc:1199] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/822e4336ea9747d1b50cbbaf8babad29
I20260617 07:53:00.374802 1170 ts_tablet_manager.cc:1950] T 822e4336ea9747d1b50cbbaf8babad29 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:00.377133 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 822e4336ea9747d1b50cbbaf8babad29 (table default.Table_6c7c8b0f291242bab28aec0bed663691 [id=a6f06301b17647c88411c624a9d830e7]) successfully deleted
W20260617 07:53:00.377964 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0b3a8a749ebb4707931355138f5fe323 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b3a8a749ebb4707931355138f5fe323 already in progress: creating tablet
W20260617 07:53:00.378252 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b already in progress: creating tablet
W20260617 07:53:00.378539 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet bb6d93a4b23246e0b73aae367270ac3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb6d93a4b23246e0b73aae367270ac3a already in progress: creating tablet
W20260617 07:53:00.378841 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 393af627c11a47bc8d8b5ae3d7f2bec6 already in progress: creating tablet
W20260617 07:53:00.380247 1097 heartbeater.cc:646] Failed to heartbeat to 127.0.105.188:33087 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.0.105.188:33087 (error 108)
W20260617 07:53:00.380625 963 heartbeater.cc:646] Failed to heartbeat to 127.0.105.188:33087 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.0.105.188:33087 (error 108)
I20260617 07:53:00.384061 1178 ts_tablet_manager.cc:1434] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.109s user 0.013s sys 0.000s
I20260617 07:53:00.385895 1178 tablet_bootstrap.cc:492] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:00.387166 715 connection.cc:573] client connection to 127.0.105.188:33087 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260617 07:53:00.387842 825 heartbeater.cc:646] Failed to heartbeat to 127.0.105.188:33087 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260617 07:53:00.390412 1185 negotiation.cc:336] Failed RPC negotiation. Trace:
0617 07:53:00.381297 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.188:33087 (local address 127.0.105.130:60031)
0617 07:53:00.387029 (+ 5732us) negotiation.cc:107] Waiting for socket to connect
0617 07:53:00.387050 (+ 21us) client_negotiation.cc:175] Beginning negotiation
0617 07:53:00.387318 (+ 268us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0617 07:53:00.389056 (+ 1738us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":5588,"thread_start_us":5474,"threads_started":1}
I20260617 07:53:00.399847 1178 tablet_bootstrap.cc:654] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.402372 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_579d624a64244301bd5648e35f0d2a44" } modify_external_catalogs: true
I20260617 07:53:00.402614 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_579d624a64244301bd5648e35f0d2a44" } modify_external_catalogs: true
I20260617 07:53:00.403613 1172 tablet_bootstrap.cc:492] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:00.403786 1172 ts_tablet_manager.cc:1403] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.220s user 0.048s sys 0.131s
W20260617 07:53:00.404071 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f6fdc168bd4a4eaca86b24a986b4eb7d consensus state has no leader
W20260617 07:53:00.404134 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49b35cb92271401782d3338f2193d54a consensus state has no leader
I20260617 07:53:00.404412 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 49b35cb92271401782d3338f2193d54a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.404592 1172 raft_consensus.cc:359] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.404805 1172 raft_consensus.cc:385] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.404904 1172 raft_consensus.cc:740] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.405117 1171 tablet_bootstrap.cc:492] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.405288 1171 ts_tablet_manager.cc:1403] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.118s user 0.017s sys 0.018s
I20260617 07:53:00.405139 1172 consensus_queue.cc:260] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:00.405551 1184 negotiation.cc:336] Failed RPC negotiation. Trace:
0617 07:53:00.381017 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.188:33087 (local address 127.0.105.131:44189)
0617 07:53:00.402970 (+ 21953us) negotiation.cc:107] Waiting for socket to connect
0617 07:53:00.403139 (+ 169us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":20604,"threads_started":1}
I20260617 07:53:00.405615 523 master_service.cc:960] ReplaceTablet: received request to replace tablet bb6d93a4b23246e0b73aae367270ac3a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.406077 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 0b3a8a749ebb4707931355138f5fe323 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.406158 1171 raft_consensus.cc:359] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.406360 1171 raft_consensus.cc:385] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.406420 1178 tablet_bootstrap.cc:492] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.406440 1171 raft_consensus.cc:740] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.406477 523 master_service.cc:960] ReplaceTablet: received request to replace tablet d6a31e2ee09d4fa3a75943e2dc038692 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.406572 1178 ts_tablet_manager.cc:1403] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260617 07:53:00.406690 1171 consensus_queue.cc:260] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:00.407048 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7e99ddce1e848139376d5188c754d46 consensus state has no leader
W20260617 07:53:00.407408 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8f7c36eac304694a96dcc41e2b1ea66 consensus state has no leader
I20260617 07:53:00.407562 1178 raft_consensus.cc:359] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.407768 1178 raft_consensus.cc:385] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.407845 1178 raft_consensus.cc:740] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.408034 1178 consensus_queue.cc:260] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.408413 1171 ts_tablet_manager.cc:1434] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 07:53:00.409543 1171 tablet_bootstrap.cc:492] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.410991 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.411201 1178 ts_tablet_manager.cc:1434] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260617 07:53:00.411301 1175 tablet_replica.cc:333] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:00.411531 1171 tablet_bootstrap.cc:654] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.411790 1175 raft_consensus.cc:2243] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.412245 1175 raft_consensus.cc:2272] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.414016 1178 tablet_bootstrap.cc:492] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.415813 1178 tablet_bootstrap.cc:654] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.416848 532 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_0341227ad84c491bb7508718c27fa411 [id=b917e24e4cee4805b575b97ac7068195]). Expected version 2 got 0
I20260617 07:53:00.417636 1172 ts_tablet_manager.cc:1434] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260617 07:53:00.417996 1175 ts_tablet_manager.cc:1916] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.421137 532 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_0341227ad84c491bb7508718c27fa411 [id=b917e24e4cee4805b575b97ac7068195]). Expected version 2 got 0
I20260617 07:53:00.424176 760 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab29952346b44e68d58e5ee85754f4f (DEFAULT_TABLE table=default.Table_8bc6c29531e84f969b0890ef763e2072 [id=03ababcd2bda4c96a8ead4f4fd3ae578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.424640 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab29952346b44e68d58e5ee85754f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.424876 897 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab29952346b44e68d58e5ee85754f4f (DEFAULT_TABLE table=default.Table_8bc6c29531e84f969b0890ef763e2072 [id=03ababcd2bda4c96a8ead4f4fd3ae578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.425258 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab29952346b44e68d58e5ee85754f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.426275 1172 tablet_bootstrap.cc:492] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:00.428452 756 tablet_service.cc:1511] Processing CreateTablet for tablet 966145c57a434dc68f004f93351e8ce5 (DEFAULT_TABLE table=default.Table_82181faa1432405cb6318acfa88304a3 [id=fc01741386744b208a3d0acaa963091b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.428478 894 tablet_service.cc:1511] Processing CreateTablet for tablet 966145c57a434dc68f004f93351e8ce5 (DEFAULT_TABLE table=default.Table_82181faa1432405cb6318acfa88304a3 [id=fc01741386744b208a3d0acaa963091b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.428838 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966145c57a434dc68f004f93351e8ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.428861 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966145c57a434dc68f004f93351e8ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.430071 755 tablet_service.cc:1511] Processing CreateTablet for tablet 2c97be29a90f4b88b568b9f210f94248 (DEFAULT_TABLE table=default.Table_42257d73daae45b4aaa3907369586926 [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.430416 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c97be29a90f4b88b568b9f210f94248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.432257 1172 tablet_bootstrap.cc:654] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:00.433493 518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.188:33087, user_credentials={real_user=slave}} blocked reactor thread for 46253.1us
I20260617 07:53:00.434242 895 tablet_service.cc:1511] Processing CreateTablet for tablet 2c97be29a90f4b88b568b9f210f94248 (DEFAULT_TABLE table=default.Table_42257d73daae45b4aaa3907369586926 [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.434630 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c97be29a90f4b88b568b9f210f94248. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:00.437551 518 consensus_peers.cc:597] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d -> Peer 3b274c37ad4445ba8b41d6784b3cd336 (127.0.105.188:33087): Couldn't send request to peer 3b274c37ad4445ba8b41d6784b3cd336. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:00.439296 751 tablet_service.cc:1511] Processing CreateTablet for tablet d3fdc22bf2f24d028393401ae78bf7fb (DEFAULT_TABLE table=default.Table_8b1fdc750b3c4dcca79f18783124f6c1 [id=e5970e1075234e20928126042294cc16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.439702 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3fdc22bf2f24d028393401ae78bf7fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:00.440681 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d6a31e2ee09d4fa3a75943e2dc038692 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6a31e2ee09d4fa3a75943e2dc038692 already in progress: creating tablet
I20260617 07:53:00.442010 749 tablet_service.cc:1511] Processing CreateTablet for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (DEFAULT_TABLE table=default.Table_31c6f40eef3841b19eabe692395c866a [id=659cc77082d04f239408931a673cd30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.442377 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500ee0a225c43ebb75a69f9b44ef0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.443133 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 2c97be29a90f4b88b568b9f210f94248 (DEFAULT_TABLE table=default.Table_42257d73daae45b4aaa3907369586926 [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.443413 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (DEFAULT_TABLE table=default.Table_31c6f40eef3841b19eabe692395c866a [id=659cc77082d04f239408931a673cd30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.443596 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c97be29a90f4b88b568b9f210f94248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.443826 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500ee0a225c43ebb75a69f9b44ef0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.443797 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 966145c57a434dc68f004f93351e8ce5 (DEFAULT_TABLE table=default.Table_82181faa1432405cb6318acfa88304a3 [id=fc01741386744b208a3d0acaa963091b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.444133 1029 tablet_service.cc:1511] Processing CreateTablet for tablet d3fdc22bf2f24d028393401ae78bf7fb (DEFAULT_TABLE table=default.Table_8b1fdc750b3c4dcca79f18783124f6c1 [id=e5970e1075234e20928126042294cc16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.445205 753 tablet_service.cc:1511] Processing CreateTablet for tablet 3cee843694bd4f268347e7fc8673816e (DEFAULT_TABLE table=default.Table_36ddf91375d64de9b2931c2694140490 [id=e4cac3bc7e8e4142b8168b04644a5194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.445572 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cee843694bd4f268347e7fc8673816e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.447044 758 tablet_service.cc:1511] Processing CreateTablet for tablet bb96aca7a8ee486e9d05290e53b95bbc (DEFAULT_TABLE table=default.Table_579d624a64244301bd5648e35f0d2a44 [id=fb7fb070eb1041c580e63ebc35d8558c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.447491 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb96aca7a8ee486e9d05290e53b95bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.447449 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab29952346b44e68d58e5ee85754f4f (DEFAULT_TABLE table=default.Table_8bc6c29531e84f969b0890ef763e2072 [id=03ababcd2bda4c96a8ead4f4fd3ae578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.454175 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e93f77eefbea46a6ac71a5b27dc0e63d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.454778 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e93f77eefbea46a6ac71a5b27dc0e63d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.456945 898 tablet_service.cc:1511] Processing CreateTablet for tablet d3fdc22bf2f24d028393401ae78bf7fb (DEFAULT_TABLE table=default.Table_8b1fdc750b3c4dcca79f18783124f6c1 [id=e5970e1075234e20928126042294cc16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.457010 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (DEFAULT_TABLE table=default.Table_31c6f40eef3841b19eabe692395c866a [id=659cc77082d04f239408931a673cd30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.457422 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3fdc22bf2f24d028393401ae78bf7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.457540 893 tablet_service.cc:1511] Processing CreateTablet for tablet 3cee843694bd4f268347e7fc8673816e (DEFAULT_TABLE table=default.Table_36ddf91375d64de9b2931c2694140490 [id=e4cac3bc7e8e4142b8168b04644a5194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.458113 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cee843694bd4f268347e7fc8673816e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.459585 1175 ts_tablet_manager.cc:1929] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.459776 1175 log.cc:1199] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/7b3ac1e706b341bb9f0850bd4a6ccf4b
I20260617 07:53:00.460336 1175 ts_tablet_manager.cc:1950] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:00.461980 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500ee0a225c43ebb75a69f9b44ef0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.461992 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_45d3051485a04d58ab910c518ff9b9b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.462505 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45d3051485a04d58ab910c518ff9b9b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.466351 892 tablet_service.cc:1511] Processing CreateTablet for tablet bb96aca7a8ee486e9d05290e53b95bbc (DEFAULT_TABLE table=default.Table_579d624a64244301bd5648e35f0d2a44 [id=fb7fb070eb1041c580e63ebc35d8558c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.466840 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb96aca7a8ee486e9d05290e53b95bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.466756 758 tablet_service.cc:1511] Processing CreateTablet for tablet fedebf6da6364fd093fc13ce54beee8c (DEFAULT_TABLE table=default.Table_b5ea244188ba423a926d78f48e818554 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.467142 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedebf6da6364fd093fc13ce54beee8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.467748 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b3a8a749ebb4707931355138f5fe323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.468138 1169 tablet_replica.cc:333] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:00.468338 1169 raft_consensus.cc:2243] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.468531 1169 raft_consensus.cc:2272] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.470750 1169 ts_tablet_manager.cc:1916] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.477640 749 tablet_service.cc:1511] Processing CreateTablet for tablet d6d25b9220bc414b88a0cf3991f9ec5c (DEFAULT_TABLE table=default.Table_2b271e2563664a57a954aa99a29e38ce [id=bfc8d977c5b4448cb8fb2a9cabe10281]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.478399 897 tablet_service.cc:1511] Processing CreateTablet for tablet d6d25b9220bc414b88a0cf3991f9ec5c (DEFAULT_TABLE table=default.Table_2b271e2563664a57a954aa99a29e38ce [id=bfc8d977c5b4448cb8fb2a9cabe10281]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.478880 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d25b9220bc414b88a0cf3991f9ec5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.479552 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d25b9220bc414b88a0cf3991f9ec5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.479998 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b (table default.Table_318c2cf0541341879f0fdad9d05953ab [id=d1c106200bd544229e408aa5452c6c7a]) successfully deleted
I20260617 07:53:00.479190 894 tablet_service.cc:1511] Processing CreateTablet for tablet fedebf6da6364fd093fc13ce54beee8c (DEFAULT_TABLE table=default.Table_b5ea244188ba423a926d78f48e818554 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.480835 1178 tablet_bootstrap.cc:492] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.481164 1178 ts_tablet_manager.cc:1403] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.067s user 0.018s sys 0.028s
I20260617 07:53:00.480067 1169 ts_tablet_manager.cc:1929] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.483139 1178 raft_consensus.cc:359] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.483618 1178 raft_consensus.cc:385] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.483839 1178 raft_consensus.cc:740] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.484527 1178 consensus_queue.cc:260] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.485204 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedebf6da6364fd093fc13ce54beee8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.444144 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966145c57a434dc68f004f93351e8ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.493856 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3fdc22bf2f24d028393401ae78bf7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.495194 1169 log.cc:1199] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0b3a8a749ebb4707931355138f5fe323
I20260617 07:53:00.498024 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab29952346b44e68d58e5ee85754f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.498373 1178 ts_tablet_manager.cc:1434] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
I20260617 07:53:00.499740 1169 ts_tablet_manager.cc:1950] T 0b3a8a749ebb4707931355138f5fe323 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:00.500766 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0b3a8a749ebb4707931355138f5fe323 (table default.Table_70c6b89e24984f9b912dfa5ba55e392e [id=d8982b309f35412ca30783a3bbcc09e5]) successfully deleted
I20260617 07:53:00.502391 1178 tablet_bootstrap.cc:492] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.504530 1178 tablet_bootstrap.cc:654] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.507395 1171 tablet_bootstrap.cc:492] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.507540 1171 ts_tablet_manager.cc:1403] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.098s user 0.008s sys 0.007s
I20260617 07:53:00.508348 1171 raft_consensus.cc:359] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.508538 1171 raft_consensus.cc:385] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.508613 1171 raft_consensus.cc:740] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.508869 1171 consensus_queue.cc:260] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.510422 1171 ts_tablet_manager.cc:1434] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:00.511544 1171 tablet_bootstrap.cc:492] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.512872 1178 tablet_bootstrap.cc:492] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.513049 1178 ts_tablet_manager.cc:1403] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260617 07:53:00.513252 1171 tablet_bootstrap.cc:654] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.514088 1178 raft_consensus.cc:359] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.514329 1178 raft_consensus.cc:385] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.514424 1178 raft_consensus.cc:740] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.514758 1178 consensus_queue.cc:260] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.518215 1178 ts_tablet_manager.cc:1434] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260617 07:53:00.519316 1028 tablet_service.cc:1511] Processing CreateTablet for tablet fedebf6da6364fd093fc13ce54beee8c (DEFAULT_TABLE table=default.Table_b5ea244188ba423a926d78f48e818554 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.519717 1178 tablet_bootstrap.cc:492] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.519897 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedebf6da6364fd093fc13ce54beee8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.521812 1178 tablet_bootstrap.cc:654] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.526336 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 3cee843694bd4f268347e7fc8673816e (DEFAULT_TABLE table=default.Table_36ddf91375d64de9b2931c2694140490 [id=e4cac3bc7e8e4142b8168b04644a5194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.526907 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cee843694bd4f268347e7fc8673816e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.527715 1171 tablet_bootstrap.cc:492] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.527937 1171 ts_tablet_manager.cc:1403] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.012s
I20260617 07:53:00.528185 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bb96aca7a8ee486e9d05290e53b95bbc (DEFAULT_TABLE table=default.Table_579d624a64244301bd5648e35f0d2a44 [id=fb7fb070eb1041c580e63ebc35d8558c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.528604 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb96aca7a8ee486e9d05290e53b95bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.529340 1171 raft_consensus.cc:359] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.529613 1171 raft_consensus.cc:385] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.529698 1171 raft_consensus.cc:740] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.530064 1171 consensus_queue.cc:260] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.530737 1171 ts_tablet_manager.cc:1434] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:00.531157 1171 tablet_bootstrap.cc:492] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.532886 1178 tablet_bootstrap.cc:492] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.533057 1178 ts_tablet_manager.cc:1403] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.005s
I20260617 07:53:00.533294 1171 tablet_bootstrap.cc:654] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.533906 1178 raft_consensus.cc:359] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.534097 1178 raft_consensus.cc:385] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.534190 1178 raft_consensus.cc:740] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.534500 1178 consensus_queue.cc:260] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.535452 1178 ts_tablet_manager.cc:1434] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:00.535805 1178 tablet_bootstrap.cc:492] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.537644 1178 tablet_bootstrap.cc:654] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.540493 1178 tablet_bootstrap.cc:492] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.540632 1178 ts_tablet_manager.cc:1403] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260617 07:53:00.541311 1178 raft_consensus.cc:359] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.541494 1178 raft_consensus.cc:385] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.541595 1178 raft_consensus.cc:740] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.541837 1178 consensus_queue.cc:260] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.543066 1178 ts_tablet_manager.cc:1434] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 07:53:00.543339 1178 tablet_bootstrap.cc:492] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.545007 1178 tablet_bootstrap.cc:654] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.547237 1029 tablet_service.cc:1511] Processing CreateTablet for tablet d6d25b9220bc414b88a0cf3991f9ec5c (DEFAULT_TABLE table=default.Table_2b271e2563664a57a954aa99a29e38ce [id=bfc8d977c5b4448cb8fb2a9cabe10281]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.549193 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d25b9220bc414b88a0cf3991f9ec5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.551527 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 49b35cb92271401782d3338f2193d54a
I20260617 07:53:00.552191 529 catalog_manager.cc:6784] ReplaceTablet: tablet 49b35cb92271401782d3338f2193d54a deleted and replaced by tablet a8df3210685244ae8a9b7c9190d619a0
I20260617 07:53:00.553483 1178 tablet_bootstrap.cc:492] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.553630 1178 ts_tablet_manager.cc:1403] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.001s
I20260617 07:53:00.554469 1178 raft_consensus.cc:359] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.554661 1178 raft_consensus.cc:385] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.554734 1178 raft_consensus.cc:740] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
W20260617 07:53:00.554785 1102 tablet.cc:2406] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 07:53:00.555013 1178 consensus_queue.cc:260] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.555523 1178 ts_tablet_manager.cc:1434] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:00.555852 1178 tablet_bootstrap.cc:492] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.556064 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b35cb92271401782d3338f2193d54a with delete_type TABLET_DATA_DELETED (replaced by tablet a8df3210685244ae8a9b7c9190d619a0) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.556389 1175 tablet_replica.cc:333] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:00.556560 1175 raft_consensus.cc:2243] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.556717 1175 raft_consensus.cc:2272] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.557461 1175 ts_tablet_manager.cc:1916] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.557760 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b3a8a749ebb4707931355138f5fe323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.558179 1178 tablet_bootstrap.cc:654] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.558813 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b35cb92271401782d3338f2193d54a with delete_type TABLET_DATA_DELETED (replaced by tablet a8df3210685244ae8a9b7c9190d619a0) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:00.560742 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0b3a8a749ebb4707931355138f5fe323 because the tablet was not found. No further retry: Not found: Tablet not found: 0b3a8a749ebb4707931355138f5fe323
W20260617 07:53:00.561087 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 49b35cb92271401782d3338f2193d54a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49b35cb92271401782d3338f2193d54a already in progress: creating tablet
I20260617 07:53:00.562897 1178 tablet_bootstrap.cc:492] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.563035 1178 ts_tablet_manager.cc:1403] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260617 07:53:00.563582 529 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d7e99ddce1e848139376d5188c754d46 (table default.Table_f9ff44e392af4f8bb43efa1aec72265d [id=83b4c82d614147749ec60adc74eda64a]). Expected version 2 got 0
I20260617 07:53:00.563815 1178 raft_consensus.cc:359] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.564002 1178 raft_consensus.cc:385] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.564047 1175 ts_tablet_manager.cc:1929] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.564111 1178 raft_consensus.cc:740] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.564172 1175 log.cc:1199] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/49b35cb92271401782d3338f2193d54a
I20260617 07:53:00.564551 1175 ts_tablet_manager.cc:1950] T 49b35cb92271401782d3338f2193d54a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:00.564476 1178 consensus_queue.cc:260] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.565804 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 49b35cb92271401782d3338f2193d54a (table default.Table_b54e01e759c64a6eaf65d07c96a310a6 [id=eac07ff3978e43898764f4ee3bf70397]) successfully deleted
I20260617 07:53:00.566200 1178 ts_tablet_manager.cc:1434] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:00.566663 1178 tablet_bootstrap.cc:492] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.567238 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b35cb92271401782d3338f2193d54a with delete_type TABLET_DATA_DELETED (replaced by tablet a8df3210685244ae8a9b7c9190d619a0) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:00.568295 828 tablet.cc:2406] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 07:53:00.568377 1178 tablet_bootstrap.cc:654] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.568606 1172 tablet_bootstrap.cc:492] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:00.568773 1172 ts_tablet_manager.cc:1403] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.143s user 0.029s sys 0.026s
I20260617 07:53:00.569584 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet bb96aca7a8ee486e9d05290e53b95bbc
I20260617 07:53:00.569854 1172 raft_consensus.cc:359] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.570115 1172 raft_consensus.cc:385] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.570194 1172 raft_consensus.cc:740] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.570550 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 966145c57a434dc68f004f93351e8ce5
I20260617 07:53:00.570504 1172 consensus_queue.cc:260] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.571103 1172 ts_tablet_manager.cc:1434] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:00.571224 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b6f5a943489f4a44a8a7d448f9da6c3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.571847 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6f5a943489f4a44a8a7d448f9da6c3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.571930 749 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96aca7a8ee486e9d05290e53b95bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.572204 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 966145c57a434dc68f004f93351e8ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.573216 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet d3fdc22bf2f24d028393401ae78bf7fb
I20260617 07:53:00.573913 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_6eb6d6bdd5274cb4a0186d8b5aadf0ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.574424 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6eb6d6bdd5274cb4a0186d8b5aadf0ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.574525 894 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96aca7a8ee486e9d05290e53b95bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.574811 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 966145c57a434dc68f004f93351e8ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.575569 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet d6d25b9220bc414b88a0cf3991f9ec5c
I20260617 07:53:00.575958 1172 tablet_bootstrap.cc:492] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:00.576236 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_2cef2da1fcd347cb8233a3f44fbf6b37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.576427 1178 tablet_bootstrap.cc:492] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.576570 1178 ts_tablet_manager.cc:1403] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
W20260617 07:53:00.576756 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cef2da1fcd347cb8233a3f44fbf6b37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.577018 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_97a6127c04a145468bae9289e4433677"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.577351 1178 raft_consensus.cc:359] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:00.577450 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97a6127c04a145468bae9289e4433677 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.577543 1178 raft_consensus.cc:385] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.577620 1172 tablet_bootstrap.cc:654] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.577630 1178 raft_consensus.cc:740] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.577903 1178 consensus_queue.cc:260] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.578364 1178 ts_tablet_manager.cc:1434] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:00.578634 1178 tablet_bootstrap.cc:492] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.579185 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_57339f59d3434cc6aa87310f32242731"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.579792 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57339f59d3434cc6aa87310f32242731 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.580273 1178 tablet_bootstrap.cc:654] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.583611 1171 tablet_bootstrap.cc:492] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.583794 1171 ts_tablet_manager.cc:1403] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.013s
I20260617 07:53:00.584859 1171 raft_consensus.cc:359] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.585076 1171 raft_consensus.cc:385] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.585179 1171 raft_consensus.cc:740] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.585474 1171 consensus_queue.cc:260] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:00.590770 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 49b35cb92271401782d3338f2193d54a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49b35cb92271401782d3338f2193d54a already in progress: creating tablet
I20260617 07:53:00.591928 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 966145c57a434dc68f004f93351e8ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.592265 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fdc22bf2f24d028393401ae78bf7fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.592499 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96aca7a8ee486e9d05290e53b95bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.591931 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d25b9220bc414b88a0cf3991f9ec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:00.595424 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 966145c57a434dc68f004f93351e8ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 966145c57a434dc68f004f93351e8ce5 already in progress: creating tablet
W20260617 07:53:00.595707 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d3fdc22bf2f24d028393401ae78bf7fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3fdc22bf2f24d028393401ae78bf7fb already in progress: creating tablet
W20260617 07:53:00.595958 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet bb96aca7a8ee486e9d05290e53b95bbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb96aca7a8ee486e9d05290e53b95bbc already in progress: creating tablet
W20260617 07:53:00.596304 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet bb96aca7a8ee486e9d05290e53b95bbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb96aca7a8ee486e9d05290e53b95bbc already in progress: creating tablet
W20260617 07:53:00.596572 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 966145c57a434dc68f004f93351e8ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 966145c57a434dc68f004f93351e8ce5 already in progress: creating tablet
I20260617 07:53:00.597451 893 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fdc22bf2f24d028393401ae78bf7fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.598047 894 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d25b9220bc414b88a0cf3991f9ec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.598855 756 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fdc22bf2f24d028393401ae78bf7fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.599120 749 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d25b9220bc414b88a0cf3991f9ec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.599629 1171 ts_tablet_manager.cc:1434] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
W20260617 07:53:00.597702 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bb96aca7a8ee486e9d05290e53b95bbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb96aca7a8ee486e9d05290e53b95bbc already in progress: creating tablet
W20260617 07:53:00.601085 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 966145c57a434dc68f004f93351e8ce5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 966145c57a434dc68f004f93351e8ce5 already in progress: creating tablet
W20260617 07:53:00.601321 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d3fdc22bf2f24d028393401ae78bf7fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3fdc22bf2f24d028393401ae78bf7fb already in progress: creating tablet
W20260617 07:53:00.601577 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d6d25b9220bc414b88a0cf3991f9ec5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6d25b9220bc414b88a0cf3991f9ec5c already in progress: creating tablet
W20260617 07:53:00.599126 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d3fdc22bf2f24d028393401ae78bf7fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3fdc22bf2f24d028393401ae78bf7fb already in progress: creating tablet
W20260617 07:53:00.602605 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d6d25b9220bc414b88a0cf3991f9ec5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6d25b9220bc414b88a0cf3991f9ec5c already in progress: creating tablet
W20260617 07:53:00.596302 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d6d25b9220bc414b88a0cf3991f9ec5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6d25b9220bc414b88a0cf3991f9ec5c already in progress: creating tablet
I20260617 07:53:00.603510 1171 tablet_bootstrap.cc:492] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.605178 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_46e203e35c294f2e936792a24c6b4011"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.605473 1171 tablet_bootstrap.cc:654] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:00.605821 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46e203e35c294f2e936792a24c6b4011 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.610013 1171 tablet_bootstrap.cc:492] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.610183 1171 ts_tablet_manager.cc:1403] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260617 07:53:00.610321 1172 tablet_bootstrap.cc:492] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:00.610472 1172 ts_tablet_manager.cc:1403] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.021s
I20260617 07:53:00.610951 1171 raft_consensus.cc:359] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.611150 1171 raft_consensus.cc:385] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.611230 1171 raft_consensus.cc:740] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.611284 1172 raft_consensus.cc:359] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.611456 1172 raft_consensus.cc:385] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.611552 1172 raft_consensus.cc:740] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.611490 1171 consensus_queue.cc:260] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.611768 1172 consensus_queue.cc:260] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.612025 1171 ts_tablet_manager.cc:1434] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:00.612316 1171 tablet_bootstrap.cc:492] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.613853 1172 ts_tablet_manager.cc:1434] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:00.613970 1171 tablet_bootstrap.cc:654] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.614156 1172 tablet_bootstrap.cc:492] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:00.615897 1172 tablet_bootstrap.cc:654] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.617791 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_4d662781dac64b4eadfe4c99fb6515db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.618088 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_6514fc84d3b14ba59f0dc6bf286f2ab2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.618340 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d662781dac64b4eadfe4c99fb6515db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.619606 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_786bf0435df54f028aefdf1a94cef6f2" } new_table_name: "default.Table_791e9d42cb984c7fa9347e6d00266b68" modify_external_catalogs: true
I20260617 07:53:00.621129 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_36ddf91375d64de9b2931c2694140490" } new_table_name: "default.Table_49587b2e81f148a4a250f39749e158d3" modify_external_catalogs: true
W20260617 07:53:00.618546 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6514fc84d3b14ba59f0dc6bf286f2ab2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.623698 527 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d7e99ddce1e848139376d5188c754d46 (table default.Table_f9ff44e392af4f8bb43efa1aec72265d [id=83b4c82d614147749ec60adc74eda64a]). Expected version 2 got 0
I20260617 07:53:00.623899 527 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e8f7c36eac304694a96dcc41e2b1ea66 (table default.Table_786bf0435df54f028aefdf1a94cef6f2 [id=2a25b9145c5a4982aaf43047c8214926]). Expected version 2 got 0
I20260617 07:53:00.624552 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a96d648af0a149e8a1e2ff42945b6fab
I20260617 07:53:00.625316 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_31c6f40eef3841b19eabe692395c866a" } new_table_name: "default.Table_80c7d1700afc48cfac169bb161d8597f" modify_external_catalogs: true
I20260617 07:53:00.626296 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_42257d73daae45b4aaa3907369586926" } new_table_name: "default.Table_73499470b1494807ba75ea3917853761" modify_external_catalogs: true
I20260617 07:53:00.626931 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b54e01e759c64a6eaf65d07c96a310a6" } new_table_name: "default.Table_f25afebccc084eb994072fd8ed9f99a6" modify_external_catalogs: true
I20260617 07:53:00.628525 1171 tablet_bootstrap.cc:492] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.628677 1171 ts_tablet_manager.cc:1403] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.003s
I20260617 07:53:00.629776 1171 raft_consensus.cc:359] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.629997 1171 raft_consensus.cc:385] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.630118 1171 raft_consensus.cc:740] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.630376 1171 consensus_queue.cc:260] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.632215 1171 ts_tablet_manager.cc:1434] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 07:53:00.632865 1172 tablet_bootstrap.cc:492] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:00.633033 1172 ts_tablet_manager.cc:1403] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.005s
I20260617 07:53:00.633376 1171 tablet_bootstrap.cc:492] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.633816 1172 raft_consensus.cc:359] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.634037 1172 raft_consensus.cc:385] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.634105 1172 raft_consensus.cc:740] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.634361 1172 consensus_queue.cc:260] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.634477 749 tablet_service.cc:1558] Processing DeleteTablet for tablet a96d648af0a149e8a1e2ff42945b6fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.634829 1175 tablet_replica.cc:333] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:00.635025 1175 raft_consensus.cc:2243] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.635149 1171 tablet_bootstrap.cc:654] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.635281 1175 raft_consensus.cc:2272] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.635432 1172 ts_tablet_manager.cc:1434] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:00.635735 1172 tablet_bootstrap.cc:492] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:00.636974 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet a96d648af0a149e8a1e2ff42945b6fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.637483 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 with delete_type TABLET_DATA_DELETED (replaced by tablet a96d648af0a149e8a1e2ff42945b6fab) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.637694 1170 tablet_replica.cc:333] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:00.637920 1170 raft_consensus.cc:2243] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.638098 1170 raft_consensus.cc:2272] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.638166 1172 tablet_bootstrap.cc:654] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.638576 1178 tablet_bootstrap.cc:492] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.638729 1178 ts_tablet_manager.cc:1403] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.019s
I20260617 07:53:00.639211 1170 ts_tablet_manager.cc:1916] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.639385 1175 ts_tablet_manager.cc:1916] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.639447 1171 tablet_bootstrap.cc:492] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.639580 1171 ts_tablet_manager.cc:1403] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260617 07:53:00.640262 1171 raft_consensus.cc:359] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.640457 1171 raft_consensus.cc:385] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.640537 1171 raft_consensus.cc:740] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.639528 1178 raft_consensus.cc:359] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.640734 1178 raft_consensus.cc:385] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.640765 1171 consensus_queue.cc:260] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.640831 1178 raft_consensus.cc:740] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.641105 1178 consensus_queue.cc:260] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.641606 1178 ts_tablet_manager.cc:1434] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:00.641918 1178 tablet_bootstrap.cc:492] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.642328 1171 ts_tablet_manager.cc:1434] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:00.643708 1178 tablet_bootstrap.cc:654] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.644064 893 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 with delete_type TABLET_DATA_DELETED (replaced by tablet a96d648af0a149e8a1e2ff42945b6fab) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.644106 894 tablet_service.cc:1558] Processing DeleteTablet for tablet a96d648af0a149e8a1e2ff42945b6fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.644279 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.644330 1169 tablet_replica.cc:333] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:00.644495 1169 raft_consensus.cc:2243] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.644654 1169 raft_consensus.cc:2272] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.645212 1171 tablet_bootstrap.cc:492] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.645469 1169 ts_tablet_manager.cc:1916] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.646984 1171 tablet_bootstrap.cc:654] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.648789 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.649087 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.657586 1170 ts_tablet_manager.cc:1929] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.658237 1170 log.cc:1199] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d6a31e2ee09d4fa3a75943e2dc038692
I20260617 07:53:00.658977 1170 ts_tablet_manager.cc:1950] T d6a31e2ee09d4fa3a75943e2dc038692 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:00.660712 1170 tablet_replica.cc:333] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:00.661118 1170 raft_consensus.cc:2243] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.661441 1170 raft_consensus.cc:2272] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.662557 1170 ts_tablet_manager.cc:1916] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:00.663460 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a96d648af0a149e8a1e2ff42945b6fab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a96d648af0a149e8a1e2ff42945b6fab already in progress: creating tablet
I20260617 07:53:00.663753 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d6a31e2ee09d4fa3a75943e2dc038692 (table default.Table_167010d9aec6407bac68c570998189ec [id=69a653bfec384a5ca6613b1d188d8bc4]) successfully deleted
I20260617 07:53:00.667217 749 tablet_service.cc:1511] Processing CreateTablet for tablet 5f92d26dd0d746a18f88058379ac7b83 (DEFAULT_TABLE table=default.Table_e93f77eefbea46a6ac71a5b27dc0e63d [id=0e160fc0302048c2aaba651b3e67beb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.667863 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f92d26dd0d746a18f88058379ac7b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.670214 756 tablet_service.cc:1511] Processing CreateTablet for tablet a8df3210685244ae8a9b7c9190d619a0 (DEFAULT_TABLE table=default.Table_b54e01e759c64a6eaf65d07c96a310a6 [id=eac07ff3978e43898764f4ee3bf70397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.670677 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8df3210685244ae8a9b7c9190d619a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.670957 894 tablet_service.cc:1511] Processing CreateTablet for tablet 5f92d26dd0d746a18f88058379ac7b83 (DEFAULT_TABLE table=default.Table_e93f77eefbea46a6ac71a5b27dc0e63d [id=0e160fc0302048c2aaba651b3e67beb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.671494 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f92d26dd0d746a18f88058379ac7b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.674016 1183 raft_consensus.cc:493] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:00.674117 897 tablet_service.cc:1511] Processing CreateTablet for tablet a8df3210685244ae8a9b7c9190d619a0 (DEFAULT_TABLE table=default.Table_b54e01e759c64a6eaf65d07c96a310a6 [id=eac07ff3978e43898764f4ee3bf70397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.674615 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8df3210685244ae8a9b7c9190d619a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.674361 1183 raft_consensus.cc:515] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.683679 1183 leader_election.cc:290] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:00.687969 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 5f92d26dd0d746a18f88058379ac7b83 (DEFAULT_TABLE table=default.Table_e93f77eefbea46a6ac71a5b27dc0e63d [id=0e160fc0302048c2aaba651b3e67beb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.688521 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f92d26dd0d746a18f88058379ac7b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.692552 528 master_service.cc:960] ReplaceTablet: received request to replace tablet d3fdc22bf2f24d028393401ae78bf7fb from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.693048 528 master_service.cc:960] ReplaceTablet: received request to replace tablet fedebf6da6364fd093fc13ce54beee8c from {username='slave'} at 127.0.0.1:42828
W20260617 07:53:00.693496 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8f7c36eac304694a96dcc41e2b1ea66 consensus state has no leader
I20260617 07:53:00.693472 1169 ts_tablet_manager.cc:1929] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.693797 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 9ab29952346b44e68d58e5ee85754f4f from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.694133 1028 tablet_service.cc:1511] Processing CreateTablet for tablet a8df3210685244ae8a9b7c9190d619a0 (DEFAULT_TABLE table=default.Table_b54e01e759c64a6eaf65d07c96a310a6 [id=eac07ff3978e43898764f4ee3bf70397]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:00.694499 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cee843694bd4f268347e7fc8673816e consensus state has no leader
I20260617 07:53:00.694598 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8df3210685244ae8a9b7c9190d619a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:00.694934 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c97be29a90f4b88b568b9f210f94248 consensus state has no leader
I20260617 07:53:00.698978 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b35cb92271401782d3338f2193d54a with delete_type TABLET_DATA_DELETED (replaced by tablet a8df3210685244ae8a9b7c9190d619a0) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.699270 753 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a31e2ee09d4fa3a75943e2dc038692 with delete_type TABLET_DATA_DELETED (replaced by tablet a96d648af0a149e8a1e2ff42945b6fab) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.700402 1175 ts_tablet_manager.cc:1929] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.700560 1175 log.cc:1199] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a96d648af0a149e8a1e2ff42945b6fab
I20260617 07:53:00.700606 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 822e4336ea9747d1b50cbbaf8babad29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.701030 1175 ts_tablet_manager.cc:1950] T a96d648af0a149e8a1e2ff42945b6fab P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:00.702261 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0500ee0a225c43ebb75a69f9b44ef0dd consensus state has no leader
I20260617 07:53:00.702258 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a96d648af0a149e8a1e2ff42945b6fab (table default.Table_167010d9aec6407bac68c570998189ec [id=69a653bfec384a5ca6613b1d188d8bc4]) successfully deleted
I20260617 07:53:00.693682 1169 log.cc:1199] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d6a31e2ee09d4fa3a75943e2dc038692
I20260617 07:53:00.706427 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b3a8a749ebb4707931355138f5fe323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.706583 1169 ts_tablet_manager.cc:1950] T d6a31e2ee09d4fa3a75943e2dc038692 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:00.706697 751 tablet_service.cc:1558] Processing DeleteTablet for tablet a96d648af0a149e8a1e2ff42945b6fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.706919 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 393af627c11a47bc8d8b5ae3d7f2bec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.707864 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d6a31e2ee09d4fa3a75943e2dc038692 (table default.Table_167010d9aec6407bac68c570998189ec [id=69a653bfec384a5ca6613b1d188d8bc4]) successfully deleted
I20260617 07:53:00.708372 1169 tablet_replica.cc:333] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:00.708700 1169 raft_consensus.cc:2243] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:00.710813 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 49b35cb92271401782d3338f2193d54a because the tablet was not found. No further retry: Not found: Tablet not found: 49b35cb92271401782d3338f2193d54a
I20260617 07:53:00.711171 1169 raft_consensus.cc:2272] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.711552 1175 tablet_replica.cc:333] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:00.711892 1175 raft_consensus.cc:2243] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.712188 1175 raft_consensus.cc:2272] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.713140 1175 ts_tablet_manager.cc:1916] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.713475 1171 tablet_bootstrap.cc:492] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.713671 1171 ts_tablet_manager.cc:1403] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.069s user 0.024s sys 0.041s
I20260617 07:53:00.714607 1171 raft_consensus.cc:359] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.714856 1171 raft_consensus.cc:385] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.714985 1171 raft_consensus.cc:740] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.715305 1171 consensus_queue.cc:260] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.715859 1171 ts_tablet_manager.cc:1434] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:00.716180 1171 tablet_bootstrap.cc:492] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.718251 1171 tablet_bootstrap.cc:654] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.723197 1171 tablet_bootstrap.cc:492] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:00.723379 1171 ts_tablet_manager.cc:1403] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260617 07:53:00.724056 1172 tablet_bootstrap.cc:492] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:00.724249 1172 ts_tablet_manager.cc:1403] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.089s user 0.004s sys 0.000s
I20260617 07:53:00.724208 1171 raft_consensus.cc:359] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.724423 1171 raft_consensus.cc:385] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.724524 1171 raft_consensus.cc:740] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.724823 1171 consensus_queue.cc:260] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.725193 1172 raft_consensus.cc:359] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.725425 1172 raft_consensus.cc:385] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.725541 1172 raft_consensus.cc:740] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.725852 1172 consensus_queue.cc:260] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.726402 1172 ts_tablet_manager.cc:1434] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260617 07:53:00.726747 1172 tablet_bootstrap.cc:492] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:00.728868 1172 tablet_bootstrap.cc:654] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.728946 1171 ts_tablet_manager.cc:1434] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:00.732106 1171 tablet_bootstrap.cc:492] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:00.734369 1171 tablet_bootstrap.cc:654] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.735814 1170 ts_tablet_manager.cc:1929] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.736567 1175 ts_tablet_manager.cc:1929] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.736801 1175 log.cc:1199] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d6a31e2ee09d4fa3a75943e2dc038692
I20260617 07:53:00.737378 1175 ts_tablet_manager.cc:1950] T d6a31e2ee09d4fa3a75943e2dc038692 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:00.738791 1178 tablet_bootstrap.cc:492] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.739032 1178 ts_tablet_manager.cc:1403] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.097s user 0.037s sys 0.025s
I20260617 07:53:00.740135 1178 raft_consensus.cc:359] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.740429 1178 raft_consensus.cc:385] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.740523 1178 raft_consensus.cc:740] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
W20260617 07:53:00.741544 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8df3210685244ae8a9b7c9190d619a0 consensus state has no leader
I20260617 07:53:00.742360 1178 consensus_queue.cc:260] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.746743 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b35cb92271401782d3338f2193d54a with delete_type TABLET_DATA_DELETED (replaced by tablet a8df3210685244ae8a9b7c9190d619a0) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.746990 894 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6d93a4b23246e0b73aae367270ac3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.747246 1169 ts_tablet_manager.cc:1916] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.751468 749 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6d93a4b23246e0b73aae367270ac3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.751974 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d6a31e2ee09d4fa3a75943e2dc038692 (table default.Table_167010d9aec6407bac68c570998189ec [id=69a653bfec384a5ca6613b1d188d8bc4]) successfully deleted
I20260617 07:53:00.752375 1175 tablet_replica.cc:333] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:00.752559 1175 raft_consensus.cc:2243] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.752748 1175 raft_consensus.cc:2272] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.756771 1175 ts_tablet_manager.cc:1916] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.757392 1170 log.cc:1199] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/7b3ac1e706b341bb9f0850bd4a6ccf4b
I20260617 07:53:00.757848 1170 ts_tablet_manager.cc:1950] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:00.758940 894 tablet_service.cc:1511] Processing CreateTablet for tablet 2a80c833560f46789a079bd7672e1874 (DEFAULT_TABLE table=default.Table_57339f59d3434cc6aa87310f32242731 [id=719427e0fac94f51a2d5189178be5a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.759377 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a80c833560f46789a079bd7672e1874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.760228 525 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_0341227ad84c491bb7508718c27fa411 [id=b917e24e4cee4805b575b97ac7068195]). Expected version 2 got 0
I20260617 07:53:00.760583 525 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d7e99ddce1e848139376d5188c754d46 (table default.Table_f9ff44e392af4f8bb43efa1aec72265d [id=83b4c82d614147749ec60adc74eda64a]). Expected version 2 got 0
I20260617 07:53:00.760821 525 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet e8f7c36eac304694a96dcc41e2b1ea66 (table default.Table_791e9d42cb984c7fa9347e6d00266b68 [id=2a25b9145c5a4982aaf43047c8214926]). Expected version 3 got 0
I20260617 07:53:00.763708 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 52e9dc5fcd034eaab7a5548bccebd134 (DEFAULT_TABLE table=default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.764226 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e9dc5fcd034eaab7a5548bccebd134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.765892 756 tablet_service.cc:1511] Processing CreateTablet for tablet 52e9dc5fcd034eaab7a5548bccebd134 (DEFAULT_TABLE table=default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.766290 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e9dc5fcd034eaab7a5548bccebd134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.766435 1178 ts_tablet_manager.cc:1434] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.027s user 0.002s sys 0.002s
I20260617 07:53:00.768798 1178 tablet_bootstrap.cc:492] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.770021 758 tablet_service.cc:1511] Processing CreateTablet for tablet c9c156733805461ca185f7797525392f (DEFAULT_TABLE table=default.Table_6eb6d6bdd5274cb4a0186d8b5aadf0ac [id=0ab7b2d30cea43f0bcfee627747ca777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.770419 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c156733805461ca185f7797525392f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.770597 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet fedebf6da6364fd093fc13ce54beee8c
I20260617 07:53:00.770620 1030 tablet_service.cc:1511] Processing CreateTablet for tablet c9c156733805461ca185f7797525392f (DEFAULT_TABLE table=default.Table_6eb6d6bdd5274cb4a0186d8b5aadf0ac [id=0ab7b2d30cea43f0bcfee627747ca777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.771086 528 catalog_manager.cc:6784] ReplaceTablet: tablet fedebf6da6364fd093fc13ce54beee8c deleted and replaced by tablet 8ac72fef1251446cbd3975d98fa2f4ae
I20260617 07:53:00.771183 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c156733805461ca185f7797525392f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.771561 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 9ab29952346b44e68d58e5ee85754f4f
I20260617 07:53:00.772007 531 catalog_manager.cc:6784] ReplaceTablet: tablet 9ab29952346b44e68d58e5ee85754f4f deleted and replaced by tablet b14f9f70461e49ccb4d318eab824a3e1
I20260617 07:53:00.773273 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ab29952346b44e68d58e5ee85754f4f with delete_type TABLET_DATA_DELETED (replaced by tablet b14f9f70461e49ccb4d318eab824a3e1) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.773393 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet fedebf6da6364fd093fc13ce54beee8c with delete_type TABLET_DATA_DELETED (replaced by tablet 8ac72fef1251446cbd3975d98fa2f4ae) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.774055 751 tablet_service.cc:1511] Processing CreateTablet for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f (DEFAULT_TABLE table=default.Table_2cef2da1fcd347cb8233a3f44fbf6b37 [id=d3e06ba3c45f4836aee5420d99de4b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.774411 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.775722 1178 tablet_bootstrap.cc:654] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.777748 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 006b71a3287240a5b15bfd489f514f4c (DEFAULT_TABLE table=default.Table_45d3051485a04d58ab910c518ff9b9b8 [id=fb1c8cff45884121a6fa9d2b53f1029e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.778008 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f (DEFAULT_TABLE table=default.Table_2cef2da1fcd347cb8233a3f44fbf6b37 [id=d3e06ba3c45f4836aee5420d99de4b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.778019 753 tablet_service.cc:1511] Processing CreateTablet for tablet 0435c4596b2d466c92d89ed41f132ea0 (DEFAULT_TABLE table=default.Table_97a6127c04a145468bae9289e4433677 [id=0552acfce4294af484ccd1f88c42c4cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.778234 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006b71a3287240a5b15bfd489f514f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.778388 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0435c4596b2d466c92d89ed41f132ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.778596 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 0435c4596b2d466c92d89ed41f132ea0 (DEFAULT_TABLE table=default.Table_97a6127c04a145468bae9289e4433677 [id=0552acfce4294af484ccd1f88c42c4cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.778955 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0435c4596b2d466c92d89ed41f132ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.782014 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.782351 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 2a80c833560f46789a079bd7672e1874 (DEFAULT_TABLE table=default.Table_57339f59d3434cc6aa87310f32242731 [id=719427e0fac94f51a2d5189178be5a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.782397 1180 raft_consensus.cc:493] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:00.782658 1180 raft_consensus.cc:515] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.783529 896 tablet_service.cc:1511] Processing CreateTablet for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f (DEFAULT_TABLE table=default.Table_2cef2da1fcd347cb8233a3f44fbf6b37 [id=d3e06ba3c45f4836aee5420d99de4b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.783865 897 tablet_service.cc:1511] Processing CreateTablet for tablet 52e9dc5fcd034eaab7a5548bccebd134 (DEFAULT_TABLE table=default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.784020 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.784410 893 tablet_service.cc:1511] Processing CreateTablet for tablet c9c156733805461ca185f7797525392f (DEFAULT_TABLE table=default.Table_6eb6d6bdd5274cb4a0186d8b5aadf0ac [id=0ab7b2d30cea43f0bcfee627747ca777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.784732 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c156733805461ca185f7797525392f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.785634 892 tablet_service.cc:1511] Processing CreateTablet for tablet 0435c4596b2d466c92d89ed41f132ea0 (DEFAULT_TABLE table=default.Table_97a6127c04a145468bae9289e4433677 [id=0552acfce4294af484ccd1f88c42c4cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.786159 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0435c4596b2d466c92d89ed41f132ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.788301 895 tablet_service.cc:1511] Processing CreateTablet for tablet 006b71a3287240a5b15bfd489f514f4c (DEFAULT_TABLE table=default.Table_45d3051485a04d58ab910c518ff9b9b8 [id=fb1c8cff45884121a6fa9d2b53f1029e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.788707 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006b71a3287240a5b15bfd489f514f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.788908 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_46e203e35c294f2e936792a24c6b4011" } modify_external_catalogs: true
I20260617 07:53:00.789098 525 master_service.cc:960] ReplaceTablet: received request to replace tablet 2c97be29a90f4b88b568b9f210f94248 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.789134 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_46e203e35c294f2e936792a24c6b4011" } modify_external_catalogs: true
I20260617 07:53:00.789392 1178 tablet_bootstrap.cc:492] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.789552 1178 ts_tablet_manager.cc:1403] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.003s
I20260617 07:53:00.789767 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e9dc5fcd034eaab7a5548bccebd134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.789781 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_57339f59d3434cc6aa87310f32242731" } modify_external_catalogs: true
I20260617 07:53:00.789921 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_57339f59d3434cc6aa87310f32242731" } modify_external_catalogs: true
I20260617 07:53:00.790465 1178 raft_consensus.cc:359] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.802066 755 tablet_service.cc:1558] Processing DeleteTablet for tablet fedebf6da6364fd093fc13ce54beee8c with delete_type TABLET_DATA_DELETED (replaced by tablet 8ac72fef1251446cbd3975d98fa2f4ae) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.802330 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ab29952346b44e68d58e5ee85754f4f with delete_type TABLET_DATA_DELETED (replaced by tablet b14f9f70461e49ccb4d318eab824a3e1) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.802759 754 tablet_service.cc:1511] Processing CreateTablet for tablet 006b71a3287240a5b15bfd489f514f4c (DEFAULT_TABLE table=default.Table_45d3051485a04d58ab910c518ff9b9b8 [id=fb1c8cff45884121a6fa9d2b53f1029e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.803167 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006b71a3287240a5b15bfd489f514f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.804258 1180 leader_election.cc:290] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:00.806716 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_6a9432b681bd4a8ab38f88d21a16c398"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.806836 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_4d662781dac64b4eadfe4c99fb6515db" } modify_external_catalogs: true
I20260617 07:53:00.807015 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_4d662781dac64b4eadfe4c99fb6515db" } modify_external_catalogs: true
W20260617 07:53:00.807404 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a9432b681bd4a8ab38f88d21a16c398 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.807611 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f25afebccc084eb994072fd8ed9f99a6" } modify_external_catalogs: true
I20260617 07:53:00.807757 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f25afebccc084eb994072fd8ed9f99a6" } modify_external_catalogs: true
I20260617 07:53:00.808406 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 2a80c833560f46789a079bd7672e1874
I20260617 07:53:00.810433 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_4e5b772c907d45be9a233d194ecf89fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.810930 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e5b772c907d45be9a233d194ecf89fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.814170 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a80c833560f46789a079bd7672e1874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.790679 1178 raft_consensus.cc:385] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.814821 1178 raft_consensus.cc:740] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.815461 1178 consensus_queue.cc:260] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.819094 1178 ts_tablet_manager.cc:1434] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20260617 07:53:00.820760 1178 tablet_bootstrap.cc:492] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.821286 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a80c833560f46789a079bd7672e1874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.821923 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a80c833560f46789a079bd7672e1874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.823436 1178 tablet_bootstrap.cc:654] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.834558 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_108d8d5583c8427fa9d6164085053aba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.835143 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_108d8d5583c8427fa9d6164085053aba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.836963 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_ec3b5256518241a1a661b1e8c1841123"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.837273 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a3b725166d9c420e9aa4435f707ce6c8
I20260617 07:53:00.837316 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_571f16c26fbb42bea040ac456c289710"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.837502 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec3b5256518241a1a661b1e8c1841123 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:00.838438 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_571f16c26fbb42bea040ac456c289710 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.838641 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6a9432b681bd4a8ab38f88d21a16c398" } modify_external_catalogs: true
I20260617 07:53:00.838817 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6a9432b681bd4a8ab38f88d21a16c398" } modify_external_catalogs: true
I20260617 07:53:00.839792 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_02097379d1104499b453045821bc80cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.839828 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_44f93edbb84d4109909eac56e8a8668e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.840276 1031 tablet_service.cc:1511] Processing CreateTablet for tablet cad8eca2f4184640a3eba751a7855abb (DEFAULT_TABLE table=default.Table_4d662781dac64b4eadfe4c99fb6515db [id=6323ccf9b79a4d01835f788a87d0c724]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:00.840415 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44f93edbb84d4109909eac56e8a8668e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.840758 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad8eca2f4184640a3eba751a7855abb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:00.841769 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02097379d1104499b453045821bc80cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.843052 760 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b725166d9c420e9aa4435f707ce6c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.845504 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 2c97be29a90f4b88b568b9f210f94248
I20260617 07:53:00.846076 525 catalog_manager.cc:6784] ReplaceTablet: tablet 2c97be29a90f4b88b568b9f210f94248 deleted and replaced by tablet 89d0b4bcb35c42fd8cd2844cd018b634
I20260617 07:53:00.846712 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c97be29a90f4b88b568b9f210f94248 with delete_type TABLET_DATA_DELETED (replaced by tablet 89d0b4bcb35c42fd8cd2844cd018b634) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.846943 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a8df3210685244ae8a9b7c9190d619a0
I20260617 07:53:00.847239 749 tablet_service.cc:1511] Processing CreateTablet for tablet 2a80c833560f46789a079bd7672e1874 (DEFAULT_TABLE table=default.Table_57339f59d3434cc6aa87310f32242731 [id=719427e0fac94f51a2d5189178be5a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.848085 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet a8df3210685244ae8a9b7c9190d619a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.851594 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a80c833560f46789a079bd7672e1874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.853008 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a8df3210685244ae8a9b7c9190d619a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.853229 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c97be29a90f4b88b568b9f210f94248 with delete_type TABLET_DATA_DELETED (replaced by tablet 89d0b4bcb35c42fd8cd2844cd018b634) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.859479 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 (DEFAULT_TABLE table=default.Table_6514fc84d3b14ba59f0dc6bf286f2ab2 [id=816ac8741e6f485d9aa6fb6f93946193]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.861531 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1481eb3482dd421f94556a1ce32eeed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.748409 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b35cb92271401782d3338f2193d54a with delete_type TABLET_DATA_DELETED (replaced by tablet a8df3210685244ae8a9b7c9190d619a0) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.868738 1183 raft_consensus.cc:493] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:00.868959 1183 raft_consensus.cc:515] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.869580 1183 leader_election.cc:290] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:00.872618 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b725166d9c420e9aa4435f707ce6c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.872618 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b (table default.Table_318c2cf0541341879f0fdad9d05953ab [id=d1c106200bd544229e408aa5452c6c7a]) successfully deleted
I20260617 07:53:00.873193 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 (DEFAULT_TABLE table=default.Table_6514fc84d3b14ba59f0dc6bf286f2ab2 [id=816ac8741e6f485d9aa6fb6f93946193]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.873786 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1481eb3482dd421f94556a1ce32eeed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.878669 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627c7ce6b0954176a1044b65543c04ec" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:00.879712 716 leader_election.cc:343] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 0b3a8a749ebb4707931355138f5fe323
W20260617 07:53:00.880110 716 leader_election.cc:343] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:00.880664 1178 tablet_bootstrap.cc:492] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.881088 1178 ts_tablet_manager.cc:1403] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.000s
I20260617 07:53:00.882052 1178 raft_consensus.cc:359] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.882266 1178 raft_consensus.cc:385] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.882359 1178 raft_consensus.cc:740] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.882635 1178 consensus_queue.cc:260] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.883184 1178 ts_tablet_manager.cc:1434] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:00.884275 1178 tablet_bootstrap.cc:492] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.888978 524 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 6f4521ce096042e6b3b78abdadebdc99
I20260617 07:53:00.889292 1170 tablet_replica.cc:333] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:00.889529 1170 raft_consensus.cc:2243] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.889762 1170 raft_consensus.cc:2272] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.891458 1170 ts_tablet_manager.cc:1916] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.894685 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b3a8a749ebb4707931355138f5fe323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.897271 1178 tablet_bootstrap.cc:654] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.900030 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_41b3fa5c301945ff93a84c7b89309508"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.900650 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41b3fa5c301945ff93a84c7b89309508 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.902879 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_571f16c26fbb42bea040ac456c289710" } new_table_name: "default.Table_1aea035e85d3436abb2bfaea4f748368" modify_external_catalogs: true
I20260617 07:53:00.903496 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet cad8eca2f4184640a3eba751a7855abb
I20260617 07:53:00.904816 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_108d8d5583c8427fa9d6164085053aba" } new_table_name: "default.Table_91270a2fce904166a732f7bb47392c7e" modify_external_catalogs: true
I20260617 07:53:00.905248 1031 tablet_service.cc:1511] Processing CreateTablet for tablet a3b725166d9c420e9aa4435f707ce6c8 (DEFAULT_TABLE table=default.Table_46e203e35c294f2e936792a24c6b4011 [id=0d7c0472a2d346bdbfbe5d6409b7a3f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.905583 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet cad8eca2f4184640a3eba751a7855abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.905757 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b725166d9c420e9aa4435f707ce6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.907021 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_46218428354642c4bc4c32e9def466c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:00.907078 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_97a6127c04a145468bae9289e4433677" } new_table_name: "default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35" modify_external_catalogs: true
W20260617 07:53:00.907745 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46218428354642c4bc4c32e9def466c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.910049 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_c618c8ab0c5b498eb1aebd26c42d9c10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:00.910657 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c618c8ab0c5b498eb1aebd26c42d9c10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:00.912222 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6eb6d6bdd5274cb4a0186d8b5aadf0ac" } new_table_name: "default.Table_446494fa57f14df8a45ed1ae3e963352" modify_external_catalogs: true
I20260617 07:53:00.914347 1172 tablet_bootstrap.cc:492] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:00.914570 1172 ts_tablet_manager.cc:1403] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.188s user 0.013s sys 0.016s
I20260617 07:53:00.915462 1172 raft_consensus.cc:359] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.915789 1172 raft_consensus.cc:385] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.915915 1172 raft_consensus.cc:740] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.916275 1172 consensus_queue.cc:260] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.919590 1172 ts_tablet_manager.cc:1434] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260617 07:53:00.920053 1178 tablet_bootstrap.cc:492] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:00.920200 1178 ts_tablet_manager.cc:1403] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260617 07:53:00.920994 1172 tablet_bootstrap.cc:492] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:00.905046 1175 ts_tablet_manager.cc:1929] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.910003 751 tablet_service.cc:1511] Processing CreateTablet for tablet cad8eca2f4184640a3eba751a7855abb (DEFAULT_TABLE table=default.Table_4d662781dac64b4eadfe4c99fb6515db [id=6323ccf9b79a4d01835f788a87d0c724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.921478 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad8eca2f4184640a3eba751a7855abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.913213 1183 raft_consensus.cc:493] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:00.921753 1183 raft_consensus.cc:515] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.922199 1178 raft_consensus.cc:359] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.922369 1183 leader_election.cc:290] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:00.923023 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e99ddce1e848139376d5188c754d46" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:00.923267 917 raft_consensus.cc:2468] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:00.923921 716 leader_election.cc:304] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:00.924003 756 tablet_service.cc:1511] Processing CreateTablet for tablet a3b725166d9c420e9aa4435f707ce6c8 (DEFAULT_TABLE table=default.Table_46e203e35c294f2e936792a24c6b4011 [id=0d7c0472a2d346bdbfbe5d6409b7a3f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.924424 1183 raft_consensus.cc:2804] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:00.924580 1183 raft_consensus.cc:493] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:00.924660 1183 raft_consensus.cc:3060] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:00.927702 1183 raft_consensus.cc:515] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.928052 894 tablet_service.cc:1558] Processing DeleteTablet for tablet fedebf6da6364fd093fc13ce54beee8c with delete_type TABLET_DATA_DELETED (replaced by tablet 8ac72fef1251446cbd3975d98fa2f4ae) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.928700 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ab29952346b44e68d58e5ee85754f4f with delete_type TABLET_DATA_DELETED (replaced by tablet b14f9f70461e49ccb4d318eab824a3e1) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.928918 1183 leader_election.cc:290] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:00.929330 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a80c833560f46789a079bd7672e1874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.929509 1169 ts_tablet_manager.cc:1929] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.929656 1169 log.cc:1199] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/7b3ac1e706b341bb9f0850bd4a6ccf4b
I20260617 07:53:00.911975 749 tablet_service.cc:1558] Processing DeleteTablet for tablet cad8eca2f4184640a3eba751a7855abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.922392 1178 raft_consensus.cc:385] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.930233 1178 raft_consensus.cc:740] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.930575 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b725166d9c420e9aa4435f707ce6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.930570 1178 consensus_queue.cc:260] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:00.933254 749 tablet_service.cc:1511] Processing CreateTablet for tablet b14f9f70461e49ccb4d318eab824a3e1 (DEFAULT_TABLE table=default.Table_8bc6c29531e84f969b0890ef763e2072 [id=03ababcd2bda4c96a8ead4f4fd3ae578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.933741 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14f9f70461e49ccb4d318eab824a3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.936906 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6d93a4b23246e0b73aae367270ac3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:00.937460 1183 raft_consensus.cc:493] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:00.937743 1183 raft_consensus.cc:515] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.938545 1183 leader_election.cc:290] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:00.938656 530 master_service.cc:960] ReplaceTablet: received request to replace tablet 67a3b2a9dd8f4861b9d1f4ababf3973f from {username='slave'} at 127.0.0.1:42828
W20260617 07:53:00.939291 716 leader_election.cc:343] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 393af627c11a47bc8d8b5ae3d7f2bec6
I20260617 07:53:00.940059 1174 raft_consensus.cc:493] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:00.940083 754 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96aca7a8ee486e9d05290e53b95bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:00.940299 1174 raft_consensus.cc:515] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.942821 1174 leader_election.cc:290] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:00.943687 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 627c7ce6b0954176a1044b65543c04ec from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:00.921132 1175 log.cc:1199] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/822e4336ea9747d1b50cbbaf8babad29
I20260617 07:53:00.950171 1175 ts_tablet_manager.cc:1950] T 822e4336ea9747d1b50cbbaf8babad29 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:00.954023 1170 ts_tablet_manager.cc:1929] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.954253 1170 log.cc:1199] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/393af627c11a47bc8d8b5ae3d7f2bec6
I20260617 07:53:00.954733 1170 ts_tablet_manager.cc:1950] T 393af627c11a47bc8d8b5ae3d7f2bec6 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:00.955996 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 393af627c11a47bc8d8b5ae3d7f2bec6 (table default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65 [id=129a4d59e15e4a1da3313e3c379ac2ff]) successfully deleted
I20260617 07:53:00.956727 1170 tablet_replica.cc:333] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:00.937582 1178 ts_tablet_manager.cc:1434] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
W20260617 07:53:00.956848 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 9ab29952346b44e68d58e5ee85754f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ab29952346b44e68d58e5ee85754f4f already in progress: creating tablet
I20260617 07:53:00.956950 1170 raft_consensus.cc:2243] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.957157 1170 raft_consensus.cc:2272] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:00.957149 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet fedebf6da6364fd093fc13ce54beee8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fedebf6da6364fd093fc13ce54beee8c already in progress: creating tablet
W20260617 07:53:00.957393 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2a80c833560f46789a079bd7672e1874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a80c833560f46789a079bd7672e1874 already in progress: creating tablet
W20260617 07:53:00.957605 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2c97be29a90f4b88b568b9f210f94248 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c97be29a90f4b88b568b9f210f94248 already in progress: creating tablet
W20260617 07:53:00.957880 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a8df3210685244ae8a9b7c9190d619a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8df3210685244ae8a9b7c9190d619a0 already in progress: creating tablet
I20260617 07:53:00.958029 1170 ts_tablet_manager.cc:1916] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.958519 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3a8a749ebb4707931355138f5fe323" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:00.958972 1178 tablet_bootstrap.cc:492] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:00.958947 1052 raft_consensus.cc:2468] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:00.960799 1178 tablet_bootstrap.cc:654] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.962442 1172 tablet_bootstrap.cc:654] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:00.963869 1175 tablet_replica.cc:333] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:00.963982 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 822e4336ea9747d1b50cbbaf8babad29 (table default.Table_6c7c8b0f291242bab28aec0bed663691 [id=a6f06301b17647c88411c624a9d830e7]) successfully deleted
I20260617 07:53:00.964076 1175 raft_consensus.cc:2243] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.964252 1175 raft_consensus.cc:2272] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.964761 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627c7ce6b0954176a1044b65543c04ec" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:00.965003 1175 ts_tablet_manager.cc:1916] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.965464 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e99ddce1e848139376d5188c754d46" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:00.965873 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b14f9f70461e49ccb4d318eab824a3e1 (DEFAULT_TABLE table=default.Table_8bc6c29531e84f969b0890ef763e2072 [id=03ababcd2bda4c96a8ead4f4fd3ae578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.966252 1170 ts_tablet_manager.cc:1929] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.966382 1170 log.cc:1199] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/49b35cb92271401782d3338f2193d54a
I20260617 07:53:00.966405 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14f9f70461e49ccb4d318eab824a3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.966849 1170 ts_tablet_manager.cc:1950] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:00.967649 1170 tablet_replica.cc:333] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:00.967917 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a3b725166d9c420e9aa4435f707ce6c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3b725166d9c420e9aa4435f707ce6c8 already in progress: creating tablet
I20260617 07:53:00.967964 1170 raft_consensus.cc:2243] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:00.968134 1170 raft_consensus.cc:2272] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:00.968917 1170 ts_tablet_manager.cc:1916] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.969947 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e99ddce1e848139376d5188c754d46" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:00.971050 713 leader_election.cc:304] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:00.971282 713 raft_consensus.cc:2686] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260617 07:53:00.971902 713 leader_election.cc:343] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:00.972023 713 leader_election.cc:304] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:00.972355 1183 raft_consensus.cc:2749] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:00.972965 713 leader_election.cc:343] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:00.973423 713 leader_election.cc:343] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:00.973592 713 leader_election.cc:343] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 393af627c11a47bc8d8b5ae3d7f2bec6
I20260617 07:53:00.973682 713 leader_election.cc:304] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:00.974398 1183 raft_consensus.cc:2749] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:00.975996 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6d93a4b23246e0b73aae367270ac3a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:00.976441 780 raft_consensus.cc:2468] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:00.976661 1172 tablet_bootstrap.cc:492] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:00.976776 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac72fef1251446cbd3975d98fa2f4ae (DEFAULT_TABLE table=default.Table_b5ea244188ba423a926d78f48e818554 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.976869 1172 ts_tablet_manager.cc:1403] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.002s
I20260617 07:53:00.977236 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac72fef1251446cbd3975d98fa2f4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:00.978120 1172 raft_consensus.cc:359] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.978430 1172 raft_consensus.cc:385] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:00.978571 1172 raft_consensus.cc:740] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:00.978888 1172 consensus_queue.cc:260] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.979895 1172 ts_tablet_manager.cc:1434] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:00.980165 1172 tablet_bootstrap.cc:492] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:00.982456 1172 tablet_bootstrap.cc:654] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:00.987094 986 leader_election.cc:343] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: 49b35cb92271401782d3338f2193d54a
I20260617 07:53:00.997614 1175 ts_tablet_manager.cc:1929] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:00.997921 1175 log.cc:1199] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/0b3a8a749ebb4707931355138f5fe323
I20260617 07:53:00.998399 1175 ts_tablet_manager.cc:1950] T 0b3a8a749ebb4707931355138f5fe323 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:00.999464 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6d93a4b23246e0b73aae367270ac3a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:00.999560 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 0b3a8a749ebb4707931355138f5fe323 (table default.Table_70c6b89e24984f9b912dfa5ba55e392e [id=d8982b309f35412ca30783a3bbcc09e5]) successfully deleted
I20260617 07:53:00.999751 1052 raft_consensus.cc:2468] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:01.000528 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a96d648af0a149e8a1e2ff42945b6fab because the tablet was not found. No further retry: Not found: Tablet not found: a96d648af0a149e8a1e2ff42945b6fab
I20260617 07:53:01.000608 756 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac72fef1251446cbd3975d98fa2f4ae (DEFAULT_TABLE table=default.Table_b5ea244188ba423a926d78f48e818554 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.000890 1175 tablet_replica.cc:333] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.001088 1175 raft_consensus.cc:2243] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.001322 1175 raft_consensus.cc:2272] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.001318 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac72fef1251446cbd3975d98fa2f4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.001948 1170 ts_tablet_manager.cc:1929] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.002138 1170 log.cc:1199] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0b3a8a749ebb4707931355138f5fe323
I20260617 07:53:01.002501 1175 ts_tablet_manager.cc:1916] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.002583 1170 ts_tablet_manager.cc:1950] T 0b3a8a749ebb4707931355138f5fe323 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:01.003863 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 0b3a8a749ebb4707931355138f5fe323 (table default.Table_70c6b89e24984f9b912dfa5ba55e392e [id=d8982b309f35412ca30783a3bbcc09e5]) successfully deleted
W20260617 07:53:01.004671 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet cad8eca2f4184640a3eba751a7855abb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cad8eca2f4184640a3eba751a7855abb already in progress: creating tablet
I20260617 07:53:01.005069 1170 tablet_replica.cc:333] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:01.005299 1170 raft_consensus.cc:2243] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.005512 1170 raft_consensus.cc:2272] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.006600 1170 ts_tablet_manager.cc:1916] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:00.929821 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e99ddce1e848139376d5188c754d46" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:00.930114 894 tablet_service.cc:1511] Processing CreateTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 (DEFAULT_TABLE table=default.Table_6514fc84d3b14ba59f0dc6bf286f2ab2 [id=816ac8741e6f485d9aa6fb6f93946193]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.013973 917 raft_consensus.cc:3060] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.014232 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1481eb3482dd421f94556a1ce32eeed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.016826 1180 raft_consensus.cc:493] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.017063 1180 raft_consensus.cc:515] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:00.930898 893 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b725166d9c420e9aa4435f707ce6c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.931253 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c97be29a90f4b88b568b9f210f94248 with delete_type TABLET_DATA_DELETED (replaced by tablet 89d0b4bcb35c42fd8cd2844cd018b634) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.931574 895 tablet_service.cc:1558] Processing DeleteTablet for tablet a8df3210685244ae8a9b7c9190d619a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.017904 1180 leader_election.cc:290] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:00.932080 897 tablet_service.cc:1511] Processing CreateTablet for tablet cad8eca2f4184640a3eba751a7855abb (DEFAULT_TABLE table=default.Table_4d662781dac64b4eadfe4c99fb6515db [id=6323ccf9b79a4d01835f788a87d0c724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.018230 917 raft_consensus.cc:2468] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:00.932423 896 tablet_service.cc:1558] Processing DeleteTablet for tablet cad8eca2f4184640a3eba751a7855abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:00.932864 898 tablet_service.cc:1511] Processing CreateTablet for tablet a3b725166d9c420e9aa4435f707ce6c8 (DEFAULT_TABLE table=default.Table_46e203e35c294f2e936792a24c6b4011 [id=0d7c0472a2d346bdbfbe5d6409b7a3f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.962214 891 tablet_service.cc:1511] Processing CreateTablet for tablet b14f9f70461e49ccb4d318eab824a3e1 (DEFAULT_TABLE table=default.Table_8bc6c29531e84f969b0890ef763e2072 [id=03ababcd2bda4c96a8ead4f4fd3ae578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.952535 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b35cb92271401782d3338f2193d54a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:00.975339 890 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac72fef1251446cbd3975d98fa2f4ae (DEFAULT_TABLE table=default.Table_b5ea244188ba423a926d78f48e818554 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:00.977178 852 leader_election.cc:304] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:01.018298 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad8eca2f4184640a3eba751a7855abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.018996 918 raft_consensus.cc:2468] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:01.020149 1180 raft_consensus.cc:2804] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:01.020259 1180 raft_consensus.cc:493] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:01.020256 988 leader_election.cc:304] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:01.020383 1180 raft_consensus.cc:3060] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:01.020646 988 raft_consensus.cc:2686] T 49b35cb92271401782d3338f2193d54a P dc3bec007846459a9da0c7b8211e477b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 07:53:01.023099 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b725166d9c420e9aa4435f707ce6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.023676 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14f9f70461e49ccb4d318eab824a3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.024145 1180 raft_consensus.cc:515] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.025362 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac72fef1251446cbd3975d98fa2f4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.030009 1180 leader_election.cc:290] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:01.030742 716 leader_election.cc:304] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:01.031260 1183 raft_consensus.cc:2804] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:01.032224 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96d648af0a149e8a1e2ff42945b6fab" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:01.032750 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6d93a4b23246e0b73aae367270ac3a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
W20260617 07:53:01.033703 851 leader_election.cc:343] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:01.034026 851 leader_election.cc:343] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:01.034446 1174 raft_consensus.cc:493] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.034488 1170 ts_tablet_manager.cc:1929] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.034632 1174 raft_consensus.cc:515] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.035326 1174 leader_election.cc:290] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:01.034636 1170 log.cc:1199] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/bb6d93a4b23246e0b73aae367270ac3a
I20260617 07:53:01.035763 1170 ts_tablet_manager.cc:1950] T bb6d93a4b23246e0b73aae367270ac3a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:01.035877 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e99ddce1e848139376d5188c754d46" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:01.036775 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet bb6d93a4b23246e0b73aae367270ac3a (table default.Table_0b5ccdac74d7404caefc0ff78f370dcc [id=fc74534573834b2dbbeeb343d0a2b192]) successfully deleted
W20260617 07:53:01.045176 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 49b35cb92271401782d3338f2193d54a (table default.Table_f25afebccc084eb994072fd8ed9f99a6 [id=eac07ff3978e43898764f4ee3bf70397], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 49b35cb92271401782d3338f2193d54a consensus state has no leader
I20260617 07:53:01.046597 1175 ts_tablet_manager.cc:1929] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.046762 1175 log.cc:1199] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/393af627c11a47bc8d8b5ae3d7f2bec6
I20260617 07:53:01.047255 1175 ts_tablet_manager.cc:1950] T 393af627c11a47bc8d8b5ae3d7f2bec6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.048430 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 393af627c11a47bc8d8b5ae3d7f2bec6 (table default.Table_b4bcc5fbc86a4c0896ed2b46fb1efc65 [id=129a4d59e15e4a1da3313e3c379ac2ff]) successfully deleted
I20260617 07:53:01.048805 1175 tablet_replica.cc:333] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.048702 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6d93a4b23246e0b73aae367270ac3a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:01.048943 779 raft_consensus.cc:3060] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.052201 779 raft_consensus.cc:2468] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:01.052392 1175 raft_consensus.cc:2243] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:01.052865 852 leader_election.cc:343] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: a96d648af0a149e8a1e2ff42945b6fab
I20260617 07:53:01.053092 852 leader_election.cc:304] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:01.053424 1180 raft_consensus.cc:2749] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:01.054256 1175 raft_consensus.cc:2272] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.054889 852 leader_election.cc:304] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:01.055141 1175 ts_tablet_manager.cc:1916] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.055183 1180 raft_consensus.cc:2804] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:01.052866 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e99ddce1e848139376d5188c754d46" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:01.057253 917 raft_consensus.cc:2393] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc3bec007846459a9da0c7b8211e477b in current term 1: Already voted for candidate 6438857e0a7741ceaadf84cb9dc979e7 in this term.
I20260617 07:53:01.058820 1169 ts_tablet_manager.cc:1950] T 7b3ac1e706b341bb9f0850bd4a6ccf4b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.059401 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 7b3ac1e706b341bb9f0850bd4a6ccf4b (table default.Table_318c2cf0541341879f0fdad9d05953ab [id=d1c106200bd544229e408aa5452c6c7a]) successfully deleted
I20260617 07:53:01.060598 1178 tablet_bootstrap.cc:492] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:01.061034 1178 ts_tablet_manager.cc:1403] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.102s user 0.007s sys 0.001s
I20260617 07:53:01.062060 1172 tablet_bootstrap.cc:492] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:01.062266 1172 ts_tablet_manager.cc:1403] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.082s user 0.013s sys 0.023s
I20260617 07:53:01.062737 1169 tablet_replica.cc:333] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.063279 1169 raft_consensus.cc:2243] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.064734 1172 raft_consensus.cc:359] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.064998 1172 raft_consensus.cc:385] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.065101 1172 raft_consensus.cc:740] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.065399 1172 consensus_queue.cc:260] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:01.068027 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e364eed959174ef2a8fbbe7bb2215fa1 has no consensus state
I20260617 07:53:01.068432 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e93f77eefbea46a6ac71a5b27dc0e63d" } modify_external_catalogs: true
I20260617 07:53:01.068588 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e93f77eefbea46a6ac71a5b27dc0e63d" } modify_external_catalogs: true
W20260617 07:53:01.069114 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36cbea7b0f024422bc281ea97f6d76d5 has no consensus state
I20260617 07:53:01.069447 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_09a7839ef9df4c6cb77cf0a55a133446"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.070003 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09a7839ef9df4c6cb77cf0a55a133446 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.070314 1172 ts_tablet_manager.cc:1434] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260617 07:53:01.071497 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_12efac8f00f3425cac18946f8560096a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.071990 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12efac8f00f3425cac18946f8560096a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.072674 1175 ts_tablet_manager.cc:1929] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.072852 1175 log.cc:1199] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/bb6d93a4b23246e0b73aae367270ac3a
I20260617 07:53:01.073313 529 master_service.cc:960] ReplaceTablet: received request to replace tablet d6d25b9220bc414b88a0cf3991f9ec5c from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.073381 1175 ts_tablet_manager.cc:1950] T bb6d93a4b23246e0b73aae367270ac3a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:01.073953 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9c156733805461ca185f7797525392f consensus state has no leader
I20260617 07:53:01.074117 1172 tablet_bootstrap.cc:492] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:01.072984 1178 raft_consensus.cc:359] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.074292 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_49587b2e81f148a4a250f39749e158d3" } modify_external_catalogs: true
I20260617 07:53:01.074364 1178 raft_consensus.cc:385] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.074440 1178 raft_consensus.cc:740] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.074456 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_49587b2e81f148a4a250f39749e158d3" } modify_external_catalogs: true
I20260617 07:53:01.074743 1178 consensus_queue.cc:260] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.074963 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 67a3b2a9dd8f4861b9d1f4ababf3973f
I20260617 07:53:01.075489 530 catalog_manager.cc:6784] ReplaceTablet: tablet 67a3b2a9dd8f4861b9d1f4ababf3973f deleted and replaced by tablet a31fba373a214b5a96bd11b930ed3b86
I20260617 07:53:01.075780 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_41b3fa5c301945ff93a84c7b89309508" } modify_external_catalogs: true
I20260617 07:53:01.075937 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_41b3fa5c301945ff93a84c7b89309508" } modify_external_catalogs: true
I20260617 07:53:01.076316 1175 tablet_replica.cc:333] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.076527 1175 raft_consensus.cc:2243] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.076711 1175 raft_consensus.cc:2272] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.082165 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet bb6d93a4b23246e0b73aae367270ac3a (table default.Table_0b5ccdac74d7404caefc0ff78f370dcc [id=fc74534573834b2dbbeeb343d0a2b192]) successfully deleted
W20260617 07:53:01.082424 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet fedebf6da6364fd093fc13ce54beee8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fedebf6da6364fd093fc13ce54beee8c already in progress: creating tablet
I20260617 07:53:01.082505 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f with delete_type TABLET_DATA_DELETED (replaced by tablet a31fba373a214b5a96bd11b930ed3b86) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.082940 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f with delete_type TABLET_DATA_DELETED (replaced by tablet a31fba373a214b5a96bd11b930ed3b86) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.082789 1175 ts_tablet_manager.cc:1916] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:01.084125 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67a3b2a9dd8f4861b9d1f4ababf3973f already in progress: creating tablet
I20260617 07:53:01.084605 529 master_service.cc:960] ReplaceTablet: received request to replace tablet d6d25b9220bc414b88a0cf3991f9ec5c from {username='slave'} at 127.0.0.1:42828
W20260617 07:53:01.085865 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0435c4596b2d466c92d89ed41f132ea0 consensus state has no leader
I20260617 07:53:01.086210 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6514fc84d3b14ba59f0dc6bf286f2ab2" } new_table_name: "default.Table_d7b564096cd0495cb0f0a82db15e011e" modify_external_catalogs: true
I20260617 07:53:01.086428 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_cb143d90a8394d7fbe1e54dc7f8c1166"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.087018 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb143d90a8394d7fbe1e54dc7f8c1166 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.089433 1162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:01.089771 1162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: This master's current role is: LEADER
I20260617 07:53:01.092180 1178 ts_tablet_manager.cc:1434] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.031s user 0.003s sys 0.000s
I20260617 07:53:01.092443 1169 raft_consensus.cc:2272] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.092523 1178 tablet_bootstrap.cc:492] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:01.093685 1169 ts_tablet_manager.cc:1916] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.094218 1178 tablet_bootstrap.cc:654] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.094478 1183 raft_consensus.cc:697] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:01.096797 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_bac89c3b70e94d8f84681a0043fa2ea8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.097319 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bac89c3b70e94d8f84681a0043fa2ea8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.097903 1172 tablet_bootstrap.cc:654] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.098531 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1aea035e85d3436abb2bfaea4f748368" } modify_external_catalogs: true
I20260617 07:53:01.098713 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1aea035e85d3436abb2bfaea4f748368" } modify_external_catalogs: true
I20260617 07:53:01.099398 1175 ts_tablet_manager.cc:1929] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.099512 1175 log.cc:1199] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/9ab29952346b44e68d58e5ee85754f4f
I20260617 07:53:01.099932 1175 ts_tablet_manager.cc:1950] T 9ab29952346b44e68d58e5ee85754f4f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.094924 1183 consensus_queue.cc:237] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.099956 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f with delete_type TABLET_DATA_DELETED (replaced by tablet a31fba373a214b5a96bd11b930ed3b86) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.100903 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 9ab29952346b44e68d58e5ee85754f4f (table default.Table_8bc6c29531e84f969b0890ef763e2072 [id=03ababcd2bda4c96a8ead4f4fd3ae578]) successfully deleted
W20260617 07:53:01.103790 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2a80c833560f46789a079bd7672e1874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a80c833560f46789a079bd7672e1874 already in progress: creating tablet
W20260617 07:53:01.104614 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a3b725166d9c420e9aa4435f707ce6c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3b725166d9c420e9aa4435f707ce6c8 already in progress: creating tablet
W20260617 07:53:01.105412 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a8df3210685244ae8a9b7c9190d619a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8df3210685244ae8a9b7c9190d619a0 already in progress: creating tablet
W20260617 07:53:01.106182 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2c97be29a90f4b88b568b9f210f94248 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c97be29a90f4b88b568b9f210f94248 already in progress: creating tablet
W20260617 07:53:01.107020 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cad8eca2f4184640a3eba751a7855abb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cad8eca2f4184640a3eba751a7855abb already in progress: creating tablet
I20260617 07:53:01.107478 1175 tablet_replica.cc:333] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.107703 1175 raft_consensus.cc:2243] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.107884 1175 raft_consensus.cc:2272] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.109586 1175 ts_tablet_manager.cc:1916] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.110766 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5fcf50bba845478aa1765c2ac162b1c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.111344 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fcf50bba845478aa1765c2ac162b1c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.116501 1169 ts_tablet_manager.cc:1929] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.116737 1169 log.cc:1199] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a96d648af0a149e8a1e2ff42945b6fab
I20260617 07:53:01.117254 1169 ts_tablet_manager.cc:1950] T a96d648af0a149e8a1e2ff42945b6fab P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.121153 1169 tablet_replica.cc:333] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.121117 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a96d648af0a149e8a1e2ff42945b6fab (table default.Table_167010d9aec6407bac68c570998189ec [id=69a653bfec384a5ca6613b1d188d8bc4]) successfully deleted
I20260617 07:53:01.121505 1169 raft_consensus.cc:2243] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.122567 1175 ts_tablet_manager.cc:1929] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.122756 1175 log.cc:1199] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/bb96aca7a8ee486e9d05290e53b95bbc
I20260617 07:53:01.121829 1180 raft_consensus.cc:697] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:01.123185 1175 ts_tablet_manager.cc:1950] T bb96aca7a8ee486e9d05290e53b95bbc P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.123466 1180 consensus_queue.cc:237] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.124243 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet bb96aca7a8ee486e9d05290e53b95bbc (table default.Table_579d624a64244301bd5648e35f0d2a44 [id=fb7fb070eb1041c580e63ebc35d8558c]) successfully deleted
I20260617 07:53:01.122635 1171 tablet_bootstrap.cc:492] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.124544 1171 ts_tablet_manager.cc:1403] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.393s user 0.056s sys 0.091s
I20260617 07:53:01.125290 1169 raft_consensus.cc:2272] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:01.126341 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67a3b2a9dd8f4861b9d1f4ababf3973f already in progress: creating tablet
I20260617 07:53:01.126405 986 leader_election.cc:304] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:01.126995 1174 raft_consensus.cc:3060] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.125795 1171 raft_consensus.cc:359] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.127853 1171 raft_consensus.cc:385] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.127967 1171 raft_consensus.cc:740] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.128129 1169 ts_tablet_manager.cc:1916] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.128768 1171 consensus_queue.cc:260] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.129357 1171 ts_tablet_manager.cc:1434] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:01.131132 1174 raft_consensus.cc:2749] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:01.132541 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_f7b44d219962403696014ced4ea87a19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.133258 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7b44d219962403696014ced4ea87a19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.136263 1171 tablet_bootstrap.cc:492] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.136691 1183 raft_consensus.cc:493] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.136914 1183 raft_consensus.cc:515] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.139264 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7c36eac304694a96dcc41e2b1ea66" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:01.139870 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7c36eac304694a96dcc41e2b1ea66" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:01.140136 917 raft_consensus.cc:2468] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
W20260617 07:53:01.140529 713 leader_election.cc:343] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:01.141072 716 leader_election.cc:304] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:01.141196 1171 tablet_bootstrap.cc:654] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.141547 1230 raft_consensus.cc:2804] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:01.141666 1230 raft_consensus.cc:493] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:01.141848 1230 raft_consensus.cc:3060] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.146092 1230 raft_consensus.cc:515] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.147635 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7c36eac304694a96dcc41e2b1ea66" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:01.147876 917 raft_consensus.cc:3060] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.151132 1169 ts_tablet_manager.cc:1929] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.152812 1230 leader_election.cc:290] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:01.152114 917 raft_consensus.cc:2468] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:01.153285 1169 log.cc:1199] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/49b35cb92271401782d3338f2193d54a
I20260617 07:53:01.153581 716 leader_election.cc:304] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:01.153853 1169 ts_tablet_manager.cc:1950] T 49b35cb92271401782d3338f2193d54a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.154611 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7c36eac304694a96dcc41e2b1ea66" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
W20260617 07:53:01.155381 713 leader_election.cc:343] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:01.155869 1230 raft_consensus.cc:2804] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:01.156185 1169 tablet_replica.cc:333] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.156454 1169 raft_consensus.cc:2243] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:01.156431 1230 raft_consensus.cc:697] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:01.156869 1169 pending_rounds.cc:70] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:01.157071 1169 pending_rounds.cc:77] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772671496704000 op_type: NO_OP noop_request { }
I20260617 07:53:01.156867 1230 consensus_queue.cc:237] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.157270 1169 raft_consensus.cc:2889] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:01.157367 1171 tablet_bootstrap.cc:492] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.157449 1169 raft_consensus.cc:2272] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.157543 1171 ts_tablet_manager.cc:1403] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.002s
I20260617 07:53:01.158385 1171 raft_consensus.cc:359] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.158627 1171 raft_consensus.cc:385] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.158720 1171 raft_consensus.cc:740] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.159026 1171 consensus_queue.cc:260] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.159456 1171 ts_tablet_manager.cc:1434] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 07:53:01.161705 1169 ts_tablet_manager.cc:1916] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.164855 1171 tablet_bootstrap.cc:492] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.167151 1171 tablet_bootstrap.cc:654] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.170415 751 tablet_service.cc:1511] Processing CreateTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 (DEFAULT_TABLE table=default.Table_02097379d1104499b453045821bc80cf [id=6f5f5cfa42c54ca3964df6f9e25f18ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.170878 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076c6f6f406842ceb3db75e886e3ce50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.174189 1169 ts_tablet_manager.cc:1929] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:01.174330 1169 log.cc:1199] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/bb6d93a4b23246e0b73aae367270ac3a
I20260617 07:53:01.174814 1169 ts_tablet_manager.cc:1950] T bb6d93a4b23246e0b73aae367270ac3a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.177980 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet bb6d93a4b23246e0b73aae367270ac3a (table default.Table_0b5ccdac74d7404caefc0ff78f370dcc [id=fc74534573834b2dbbeeb343d0a2b192]) successfully deleted
I20260617 07:53:01.178534 754 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 (DEFAULT_TABLE table=default.Table_41b3fa5c301945ff93a84c7b89309508 [id=29666c7cf6b54264910c2352e985ea96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.178777 891 tablet_service.cc:1511] Processing CreateTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 (DEFAULT_TABLE table=default.Table_02097379d1104499b453045821bc80cf [id=6f5f5cfa42c54ca3964df6f9e25f18ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.178965 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2ee285802f47b98c152daad8cfd9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.179189 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076c6f6f406842ceb3db75e886e3ce50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.179678 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 36cbea7b0f024422bc281ea97f6d76d5 (DEFAULT_TABLE table=default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.180074 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cbea7b0f024422bc281ea97f6d76d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.181983 753 tablet_service.cc:1511] Processing CreateTablet for tablet 89d0b4bcb35c42fd8cd2844cd018b634 (DEFAULT_TABLE table=default.Table_73499470b1494807ba75ea3917853761 [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.182062 894 tablet_service.cc:1511] Processing CreateTablet for tablet 5adee4d54cd94c4b9c45991762d91622 (DEFAULT_TABLE table=default.Table_4e5b772c907d45be9a233d194ecf89fd [id=30af12af77d74211bfb66830c1787615]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.182345 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d0b4bcb35c42fd8cd2844cd018b634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.182447 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adee4d54cd94c4b9c45991762d91622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.185979 758 tablet_service.cc:1511] Processing CreateTablet for tablet 5adee4d54cd94c4b9c45991762d91622 (DEFAULT_TABLE table=default.Table_4e5b772c907d45be9a233d194ecf89fd [id=30af12af77d74211bfb66830c1787615]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.186133 897 tablet_service.cc:1511] Processing CreateTablet for tablet 36cbea7b0f024422bc281ea97f6d76d5 (DEFAULT_TABLE table=default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.186347 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adee4d54cd94c4b9c45991762d91622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.186546 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cbea7b0f024422bc281ea97f6d76d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.186684 1025 tablet_service.cc:1511] Processing CreateTablet for tablet e364eed959174ef2a8fbbe7bb2215fa1 (DEFAULT_TABLE table=default.Table_1aea035e85d3436abb2bfaea4f748368 [id=b30bf68f0a1649398cd7c8a8c0ca116e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.187186 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e364eed959174ef2a8fbbe7bb2215fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.189981 760 tablet_service.cc:1511] Processing CreateTablet for tablet 36cbea7b0f024422bc281ea97f6d76d5 (DEFAULT_TABLE table=default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.190061 896 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3d05dcda274f288aebc279aba3e10a (DEFAULT_TABLE table=default.Table_ec3b5256518241a1a661b1e8c1841123 [id=07868985fae742ce95c082e85caa6267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.190356 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cbea7b0f024422bc281ea97f6d76d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.190447 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3d05dcda274f288aebc279aba3e10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.194032 755 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3d05dcda274f288aebc279aba3e10a (DEFAULT_TABLE table=default.Table_ec3b5256518241a1a661b1e8c1841123 [id=07868985fae742ce95c082e85caa6267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.194057 898 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 (DEFAULT_TABLE table=default.Table_41b3fa5c301945ff93a84c7b89309508 [id=29666c7cf6b54264910c2352e985ea96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.194075 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 5adee4d54cd94c4b9c45991762d91622 (DEFAULT_TABLE table=default.Table_4e5b772c907d45be9a233d194ecf89fd [id=30af12af77d74211bfb66830c1787615]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.194393 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2ee285802f47b98c152daad8cfd9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.194406 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3d05dcda274f288aebc279aba3e10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.194490 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adee4d54cd94c4b9c45991762d91622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.198050 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 (DEFAULT_TABLE table=default.Table_02097379d1104499b453045821bc80cf [id=6f5f5cfa42c54ca3964df6f9e25f18ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.198127 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3d05dcda274f288aebc279aba3e10a (DEFAULT_TABLE table=default.Table_ec3b5256518241a1a661b1e8c1841123 [id=07868985fae742ce95c082e85caa6267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.198446 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076c6f6f406842ceb3db75e886e3ce50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.198861 890 tablet_service.cc:1511] Processing CreateTablet for tablet 89d0b4bcb35c42fd8cd2844cd018b634 (DEFAULT_TABLE table=default.Table_73499470b1494807ba75ea3917853761 [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.199288 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d0b4bcb35c42fd8cd2844cd018b634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.201915 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3d05dcda274f288aebc279aba3e10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.201984 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 (DEFAULT_TABLE table=default.Table_41b3fa5c301945ff93a84c7b89309508 [id=29666c7cf6b54264910c2352e985ea96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.202400 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2ee285802f47b98c152daad8cfd9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.205780 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3b1f601ac04fe996e63725f2d12e56 (DEFAULT_TABLE table=default.Table_44f93edbb84d4109909eac56e8a8668e [id=cbd872cee78b4535b90941504bafc133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.205979 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 89d0b4bcb35c42fd8cd2844cd018b634 (DEFAULT_TABLE table=default.Table_73499470b1494807ba75ea3917853761 [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.206156 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3b1f601ac04fe996e63725f2d12e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.206326 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d0b4bcb35c42fd8cd2844cd018b634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.210471 895 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3b1f601ac04fe996e63725f2d12e56 (DEFAULT_TABLE table=default.Table_44f93edbb84d4109909eac56e8a8668e [id=cbd872cee78b4535b90941504bafc133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.210983 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3b1f601ac04fe996e63725f2d12e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.214882 891 tablet_service.cc:1511] Processing CreateTablet for tablet e364eed959174ef2a8fbbe7bb2215fa1 (DEFAULT_TABLE table=default.Table_1aea035e85d3436abb2bfaea4f748368 [id=b30bf68f0a1649398cd7c8a8c0ca116e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.215124 752 tablet_service.cc:1511] Processing CreateTablet for tablet e364eed959174ef2a8fbbe7bb2215fa1 (DEFAULT_TABLE table=default.Table_1aea035e85d3436abb2bfaea4f748368 [id=b30bf68f0a1649398cd7c8a8c0ca116e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.215258 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e364eed959174ef2a8fbbe7bb2215fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.215495 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e364eed959174ef2a8fbbe7bb2215fa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.216840 1183 leader_election.cc:290] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:01.218060 757 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3b1f601ac04fe996e63725f2d12e56 (DEFAULT_TABLE table=default.Table_44f93edbb84d4109909eac56e8a8668e [id=cbd872cee78b4535b90941504bafc133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.218479 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3b1f601ac04fe996e63725f2d12e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.218523 1171 tablet_bootstrap.cc:492] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.218662 1171 ts_tablet_manager.cc:1403] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.000s
I20260617 07:53:01.219545 1171 raft_consensus.cc:359] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.219779 1171 raft_consensus.cc:385] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.219866 1171 raft_consensus.cc:740] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:01.219736 518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.188:33087, user_credentials={real_user=slave}} blocked reactor thread for 97714.4us
I20260617 07:53:01.220078 1171 consensus_queue.cc:260] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.220629 1171 ts_tablet_manager.cc:1434] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:01.220923 1171 tablet_bootstrap.cc:492] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.224520 1171 tablet_bootstrap.cc:654] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.231154 1172 tablet_bootstrap.cc:492] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:01.231315 1172 ts_tablet_manager.cc:1403] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.157s user 0.010s sys 0.011s
I20260617 07:53:01.232159 1172 raft_consensus.cc:359] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.232343 1172 raft_consensus.cc:385] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.232528 1172 raft_consensus.cc:740] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.233090 1172 consensus_queue.cc:260] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:01.234637 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet fedebf6da6364fd093fc13ce54beee8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fedebf6da6364fd093fc13ce54beee8c already in progress: creating tablet
W20260617 07:53:01.235605 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 9ab29952346b44e68d58e5ee85754f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ab29952346b44e68d58e5ee85754f4f already in progress: creating tablet
W20260617 07:53:01.235859 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2a80c833560f46789a079bd7672e1874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a80c833560f46789a079bd7672e1874 already in progress: creating tablet
W20260617 07:53:01.236471 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a3b725166d9c420e9aa4435f707ce6c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3b725166d9c420e9aa4435f707ce6c8 already in progress: creating tablet
W20260617 07:53:01.237186 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2c97be29a90f4b88b568b9f210f94248 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c97be29a90f4b88b568b9f210f94248 already in progress: creating tablet
W20260617 07:53:01.237412 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a8df3210685244ae8a9b7c9190d619a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8df3210685244ae8a9b7c9190d619a0 already in progress: creating tablet
W20260617 07:53:01.237600 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet cad8eca2f4184640a3eba751a7855abb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cad8eca2f4184640a3eba751a7855abb already in progress: creating tablet
W20260617 07:53:01.238116 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67a3b2a9dd8f4861b9d1f4ababf3973f already in progress: creating tablet
I20260617 07:53:01.238538 1172 ts_tablet_manager.cc:1434] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:01.239766 1172 tablet_bootstrap.cc:492] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:01.242067 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1481eb3482dd421f94556a1ce32eeed6 consensus state has no leader
I20260617 07:53:01.243232 1171 tablet_bootstrap.cc:492] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.243407 1171 ts_tablet_manager.cc:1403] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.007s
I20260617 07:53:01.244141 1171 raft_consensus.cc:359] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.244336 1171 raft_consensus.cc:385] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.244410 1171 raft_consensus.cc:740] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.244746 1171 consensus_queue.cc:260] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.246264 1171 ts_tablet_manager.cc:1434] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:01.247449 1171 tablet_bootstrap.cc:492] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.249131 1171 tablet_bootstrap.cc:654] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.251348 1172 tablet_bootstrap.cc:654] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.255012 1172 tablet_bootstrap.cc:492] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:01.256794 1171 tablet_bootstrap.cc:492] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.257108 1171 ts_tablet_manager.cc:1403] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.005s
I20260617 07:53:01.257819 1178 tablet_bootstrap.cc:492] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:01.257972 1178 ts_tablet_manager.cc:1403] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.166s user 0.029s sys 0.026s
I20260617 07:53:01.257961 1171 raft_consensus.cc:359] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.258168 1171 raft_consensus.cc:385] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.258267 1171 raft_consensus.cc:740] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.258483 1171 consensus_queue.cc:260] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.259160 1171 ts_tablet_manager.cc:1434] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:01.259446 1171 tablet_bootstrap.cc:492] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.258744 1178 raft_consensus.cc:359] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.260761 1178 raft_consensus.cc:385] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.260864 1178 raft_consensus.cc:740] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.261193 1171 tablet_bootstrap.cc:654] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.261109 1178 consensus_queue.cc:260] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.261790 1178 ts_tablet_manager.cc:1434] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:01.262006 1172 ts_tablet_manager.cc:1403] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20260617 07:53:01.262769 1172 raft_consensus.cc:359] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.262972 1172 raft_consensus.cc:385] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.263046 1172 raft_consensus.cc:740] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.263288 1172 consensus_queue.cc:260] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.263762 1172 ts_tablet_manager.cc:1434] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:01.264084 1172 tablet_bootstrap.cc:492] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:01.265307 1178 tablet_bootstrap.cc:492] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:01.267270 1178 tablet_bootstrap.cc:654] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.269764 1172 tablet_bootstrap.cc:654] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.272508 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
/tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:33087
--webserver_interface=127.0.105.188
--webserver_port=43207
--builtin_ntp_servers=127.0.105.148:37851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 07:53:01.273504 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_067884ce5e864bdd93b91edd4ef9a521"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.274140 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_067884ce5e864bdd93b91edd4ef9a521 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.275851 895 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6d93a4b23246e0b73aae367270ac3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.276824 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_26fe425146ac4138adf2a50c3a3ece88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.277359 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26fe425146ac4138adf2a50c3a3ece88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:01.278466 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet bb6d93a4b23246e0b73aae367270ac3a because the tablet was not found. No further retry: Not found: Tablet not found: bb6d93a4b23246e0b73aae367270ac3a
I20260617 07:53:01.278841 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_4e5b772c907d45be9a233d194ecf89fd" } modify_external_catalogs: true
I20260617 07:53:01.279009 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_4e5b772c907d45be9a233d194ecf89fd" } modify_external_catalogs: true
I20260617 07:53:01.279611 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet bb6d93a4b23246e0b73aae367270ac3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:52:59 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:01.280349 516 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet bb6d93a4b23246e0b73aae367270ac3a because the tablet was not found. No further retry: Not found: Tablet not found: bb6d93a4b23246e0b73aae367270ac3a
I20260617 07:53:01.282050 1178 tablet_bootstrap.cc:492] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:01.290961 1180 raft_consensus.cc:493] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.291158 1180 raft_consensus.cc:515] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.291780 1180 leader_election.cc:290] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:01.296193 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 2a2ee285802f47b98c152daad8cfd9d7
I20260617 07:53:01.296371 1178 ts_tablet_manager.cc:1403] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.002s
I20260617 07:53:01.297236 1178 raft_consensus.cc:359] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.297447 1178 raft_consensus.cc:385] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.297516 1178 raft_consensus.cc:740] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.297932 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:01.301067 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2a2ee285802f47b98c152daad8cfd9d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a2ee285802f47b98c152daad8cfd9d7 already in progress: creating tablet
I20260617 07:53:01.301208 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fdc168bd4a4eaca86b24a986b4eb7d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:01.301523 1051 raft_consensus.cc:2468] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:01.302160 851 leader_election.cc:304] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:01.302560 1180 raft_consensus.cc:2804] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:01.302682 1180 raft_consensus.cc:493] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:01.302803 1180 raft_consensus.cc:3060] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.303153 1178 consensus_queue.cc:260] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.303807 1178 ts_tablet_manager.cc:1434] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 07:53:01.304121 1178 tablet_bootstrap.cc:492] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:01.305703 1178 tablet_bootstrap.cc:654] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.308578 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:01.309831 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2a2ee285802f47b98c152daad8cfd9d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a2ee285802f47b98c152daad8cfd9d7 already in progress: creating tablet
I20260617 07:53:01.310531 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fdc168bd4a4eaca86b24a986b4eb7d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:01.310760 780 raft_consensus.cc:2468] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:01.317541 1180 raft_consensus.cc:515] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.319041 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fdc168bd4a4eaca86b24a986b4eb7d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:01.319308 780 raft_consensus.cc:3060] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.320439 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 3cee843694bd4f268347e7fc8673816e
I20260617 07:53:01.321091 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 0435c4596b2d466c92d89ed41f132ea0 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.322947 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cee843694bd4f268347e7fc8673816e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.323019 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cee843694bd4f268347e7fc8673816e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:01.323885 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3cee843694bd4f268347e7fc8673816e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cee843694bd4f268347e7fc8673816e already in progress: creating tablet
I20260617 07:53:01.324419 780 raft_consensus.cc:2468] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:01.324761 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cee843694bd4f268347e7fc8673816e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:01.325807 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3cee843694bd4f268347e7fc8673816e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cee843694bd4f268347e7fc8673816e already in progress: creating tablet
I20260617 07:53:01.325968 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 5f92d26dd0d746a18f88058379ac7b83
I20260617 07:53:01.326457 852 leader_election.cc:304] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:01.326836 1228 raft_consensus.cc:2804] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
W20260617 07:53:01.326900 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3cee843694bd4f268347e7fc8673816e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3cee843694bd4f268347e7fc8673816e already in progress: creating tablet
I20260617 07:53:01.327171 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f92d26dd0d746a18f88058379ac7b83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.327613 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f92d26dd0d746a18f88058379ac7b83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.327682 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f92d26dd0d746a18f88058379ac7b83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:01.328195 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5f92d26dd0d746a18f88058379ac7b83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f92d26dd0d746a18f88058379ac7b83 already in progress: creating tablet
W20260617 07:53:01.328625 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5f92d26dd0d746a18f88058379ac7b83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f92d26dd0d746a18f88058379ac7b83 already in progress: creating tablet
W20260617 07:53:01.330040 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5f92d26dd0d746a18f88058379ac7b83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f92d26dd0d746a18f88058379ac7b83 already in progress: creating tablet
I20260617 07:53:01.330454 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 627c7ce6b0954176a1044b65543c04ec
I20260617 07:53:01.330986 526 catalog_manager.cc:6784] ReplaceTablet: tablet 627c7ce6b0954176a1044b65543c04ec deleted and replaced by tablet 52ae3c99bec7426caac18a6e3880bf51
I20260617 07:53:01.331128 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fdc168bd4a4eaca86b24a986b4eb7d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:01.331398 1051 raft_consensus.cc:3060] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.332185 523 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_0341227ad84c491bb7508718c27fa411 [id=b917e24e4cee4805b575b97ac7068195]). Expected version 2 got 0
I20260617 07:53:01.332420 523 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d7e99ddce1e848139376d5188c754d46 (table default.Table_f9ff44e392af4f8bb43efa1aec72265d [id=83b4c82d614147749ec60adc74eda64a]). Expected version 2 got 0
I20260617 07:53:01.332616 523 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e8f7c36eac304694a96dcc41e2b1ea66 (table default.Table_791e9d42cb984c7fa9347e6d00266b68 [id=2a25b9145c5a4982aaf43047c8214926]). Expected version 3 got 0
I20260617 07:53:01.334383 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 627c7ce6b0954176a1044b65543c04ec with delete_type TABLET_DATA_DELETED (replaced by tablet 52ae3c99bec7426caac18a6e3880bf51) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.334667 1169 tablet_replica.cc:333] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.334864 1169 raft_consensus.cc:2243] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.335057 1169 raft_consensus.cc:2272] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.335259 1051 raft_consensus.cc:2468] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:01.335863 1169 ts_tablet_manager.cc:1916] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.336114 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 627c7ce6b0954176a1044b65543c04ec with delete_type TABLET_DATA_DELETED (replaced by tablet 52ae3c99bec7426caac18a6e3880bf51) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.336376 1175 tablet_replica.cc:333] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.336544 1175 raft_consensus.cc:2243] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.336722 1175 raft_consensus.cc:2272] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.337239 1175 ts_tablet_manager.cc:1916] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.337366 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 627c7ce6b0954176a1044b65543c04ec with delete_type TABLET_DATA_DELETED (replaced by tablet 52ae3c99bec7426caac18a6e3880bf51) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.337625 1170 tablet_replica.cc:333] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:01.337610 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 966145c57a434dc68f004f93351e8ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.337846 1170 raft_consensus.cc:2243] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.337997 1170 raft_consensus.cc:2272] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.338510 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ab29952346b44e68d58e5ee85754f4f with delete_type TABLET_DATA_DELETED (replaced by tablet b14f9f70461e49ccb4d318eab824a3e1) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.339560 891 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fdc22bf2f24d028393401ae78bf7fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.339756 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c97be29a90f4b88b568b9f210f94248 with delete_type TABLET_DATA_DELETED (replaced by tablet 89d0b4bcb35c42fd8cd2844cd018b634) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.339771 1170 ts_tablet_manager.cc:1916] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.342599 1169 ts_tablet_manager.cc:1929] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.342801 1169 log.cc:1199] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/627c7ce6b0954176a1044b65543c04ec
I20260617 07:53:01.343281 1169 ts_tablet_manager.cc:1950] T 627c7ce6b0954176a1044b65543c04ec P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.344352 1169 tablet_replica.cc:333] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.344308 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 627c7ce6b0954176a1044b65543c04ec (table default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]) successfully deleted
I20260617 07:53:01.344621 1169 raft_consensus.cc:2243] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.344687 1175 ts_tablet_manager.cc:1929] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.344811 1175 log.cc:1199] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/627c7ce6b0954176a1044b65543c04ec
I20260617 07:53:01.344992 1169 raft_consensus.cc:2272] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.345219 1175 ts_tablet_manager.cc:1950] T 627c7ce6b0954176a1044b65543c04ec P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.345536 1180 leader_election.cc:290] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:01.345849 1169 ts_tablet_manager.cc:1916] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.346141 1170 ts_tablet_manager.cc:1929] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.346264 1170 log.cc:1199] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/627c7ce6b0954176a1044b65543c04ec
I20260617 07:53:01.346565 1170 ts_tablet_manager.cc:1950] T 627c7ce6b0954176a1044b65543c04ec P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:01.346596 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.347962 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 627c7ce6b0954176a1044b65543c04ec (table default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]) successfully deleted
W20260617 07:53:01.348582 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2a2ee285802f47b98c152daad8cfd9d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a2ee285802f47b98c152daad8cfd9d7 already in progress: creating tablet
I20260617 07:53:01.349980 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet e364eed959174ef2a8fbbe7bb2215fa1
I20260617 07:53:01.350013 1230 raft_consensus.cc:493] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.350145 1230 raft_consensus.cc:515] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.350823 1230 leader_election.cc:290] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:01.351065 753 tablet_service.cc:1558] Processing DeleteTablet for tablet e364eed959174ef2a8fbbe7bb2215fa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.351385 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c97be29a90f4b88b568b9f210f94248" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:01.351433 894 tablet_service.cc:1558] Processing DeleteTablet for tablet e364eed959174ef2a8fbbe7bb2215fa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.351612 917 raft_consensus.cc:2468] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:01.352051 716 leader_election.cc:304] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:01.352298 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c97be29a90f4b88b568b9f210f94248" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:01.353086 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_8fa833038123494b9119b22687fe004a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.353585 713 leader_election.cc:343] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:01.353672 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fa833038123494b9119b22687fe004a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.354987 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet e364eed959174ef2a8fbbe7bb2215fa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.354957 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_46218428354642c4bc4c32e9def466c8" } new_table_name: "default.Table_8f023a35300e46fe80ba1d63915dd524" modify_external_catalogs: true
W20260617 07:53:01.355538 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e364eed959174ef2a8fbbe7bb2215fa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e364eed959174ef2a8fbbe7bb2215fa1 already in progress: creating tablet
I20260617 07:53:01.355989 1230 raft_consensus.cc:2804] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:01.356112 1230 raft_consensus.cc:493] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:01.356205 1230 raft_consensus.cc:3060] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.356240 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_2cef2da1fcd347cb8233a3f44fbf6b37" } new_table_name: "default.Table_da86397a452b40d085e68d6df9132dbe" modify_external_catalogs: true
I20260617 07:53:01.356878 1169 ts_tablet_manager.cc:1929] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.356962 1169 log.cc:1199] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/966145c57a434dc68f004f93351e8ce5
I20260617 07:53:01.357226 1169 ts_tablet_manager.cc:1950] T 966145c57a434dc68f004f93351e8ce5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.357568 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_7f7ca184d1ad499cb287399684677763"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:01.357821 1228 raft_consensus.cc:697] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
W20260617 07:53:01.358135 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f7ca184d1ad499cb287399684677763 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.358148 1228 consensus_queue.cc:237] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.358839 1230 raft_consensus.cc:515] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.359896 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f92d26dd0d746a18f88058379ac7b83 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.360051 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c97be29a90f4b88b568b9f210f94248" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
W20260617 07:53:01.360584 713 leader_election.cc:343] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:01.360589 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_44f93edbb84d4109909eac56e8a8668e" } new_table_name: "default.Table_456aace94223474f82d1801ec38d7b43" modify_external_catalogs: true
I20260617 07:53:01.361408 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 627c7ce6b0954176a1044b65543c04ec (table default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]) successfully deleted
W20260617 07:53:01.361788 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e364eed959174ef2a8fbbe7bb2215fa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e364eed959174ef2a8fbbe7bb2215fa1 already in progress: creating tablet
I20260617 07:53:01.362046 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c97be29a90f4b88b568b9f210f94248" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:01.362169 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f3b1f601ac04fe996e63725f2d12e56 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.362249 917 raft_consensus.cc:3060] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.362776 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_02097379d1104499b453045821bc80cf" } new_table_name: "default.Table_109a002e502a44d99c0e775b394e5c38" modify_external_catalogs: true
I20260617 07:53:01.364853 917 raft_consensus.cc:2468] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:01.365337 1230 leader_election.cc:290] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:01.365404 716 leader_election.cc:304] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:01.366029 1230 raft_consensus.cc:2804] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:01.366216 1230 raft_consensus.cc:697] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:01.366542 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 5adee4d54cd94c4b9c45991762d91622
I20260617 07:53:01.367213 1169 tablet_replica.cc:333] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.367431 1169 raft_consensus.cc:2243] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.367587 1169 raft_consensus.cc:2272] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.368080 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 966145c57a434dc68f004f93351e8ce5 (table default.Table_82181faa1432405cb6318acfa88304a3 [id=fc01741386744b208a3d0acaa963091b]) successfully deleted
I20260617 07:53:01.368237 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adee4d54cd94c4b9c45991762d91622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.368404 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adee4d54cd94c4b9c45991762d91622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.368716 1169 ts_tablet_manager.cc:1916] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.371166 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_9bae350dffe04a48933fbb60e3f26699"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.371730 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bae350dffe04a48933fbb60e3f26699 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.372056 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adee4d54cd94c4b9c45991762d91622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:01.373025 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5adee4d54cd94c4b9c45991762d91622 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5adee4d54cd94c4b9c45991762d91622 already in progress: creating tablet
W20260617 07:53:01.373076 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5adee4d54cd94c4b9c45991762d91622 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5adee4d54cd94c4b9c45991762d91622 already in progress: creating tablet
I20260617 07:53:01.373293 1230 consensus_queue.cc:237] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.377905 1169 ts_tablet_manager.cc:1929] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 07:53:01.379097 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a31fba373a214b5a96bd11b930ed3b86 has no consensus state
I20260617 07:53:01.379398 524 master_service.cc:960] ReplaceTablet: received request to replace tablet d7e99ddce1e848139376d5188c754d46 from {username='slave'} at 127.0.0.1:42828
W20260617 07:53:01.380132 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 294a8bfd35d04105b6bc03946d25c17a has no consensus state
I20260617 07:53:01.380484 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a4842e83c9b04eb0ba7f546b71836f8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.381035 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4842e83c9b04eb0ba7f546b71836f8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:01.382908 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f3b1f601ac04fe996e63725f2d12e56 consensus state has no leader
I20260617 07:53:01.384542 1169 log.cc:1199] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/9ab29952346b44e68d58e5ee85754f4f
I20260617 07:53:01.385362 1169 ts_tablet_manager.cc:1950] T 9ab29952346b44e68d58e5ee85754f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.386933 1178 tablet_bootstrap.cc:492] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:01.387091 1178 ts_tablet_manager.cc:1403] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.007s
I20260617 07:53:01.388708 1169 tablet_replica.cc:333] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.389195 1169 raft_consensus.cc:2243] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.389534 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 9ab29952346b44e68d58e5ee85754f4f (table default.Table_8bc6c29531e84f969b0890ef763e2072 [id=03ababcd2bda4c96a8ead4f4fd3ae578]) successfully deleted
I20260617 07:53:01.389693 1169 raft_consensus.cc:2272] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.390933 1169 ts_tablet_manager.cc:1916] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:01.391016 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 076c6f6f406842ceb3db75e886e3ce50 consensus state has no leader
I20260617 07:53:01.390995 1178 raft_consensus.cc:359] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.391202 1178 raft_consensus.cc:385] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.391317 1178 raft_consensus.cc:740] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.391566 1178 consensus_queue.cc:260] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.393730 1178 ts_tablet_manager.cc:1434] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:01.394042 1178 tablet_bootstrap.cc:492] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:01.394264 1172 tablet_bootstrap.cc:492] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:01.394469 1172 ts_tablet_manager.cc:1403] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.130s user 0.022s sys 0.044s
I20260617 07:53:01.395390 1172 raft_consensus.cc:359] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.395720 1172 raft_consensus.cc:385] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.395882 1172 raft_consensus.cc:740] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.396368 1172 consensus_queue.cc:260] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.398545 526 catalog_manager.cc:5696] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:01.399482 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_0341227ad84c491bb7508718c27fa411 [id=b917e24e4cee4805b575b97ac7068195]). Expected version 2 got 0
I20260617 07:53:01.400887 894 tablet_service.cc:1511] Processing CreateTablet for tablet 2063248863ed46c196c93013230529fe (DEFAULT_TABLE table=default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.401098 753 tablet_service.cc:1511] Processing CreateTablet for tablet 2063248863ed46c196c93013230529fe (DEFAULT_TABLE table=default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.401464 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2063248863ed46c196c93013230529fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.401520 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2063248863ed46c196c93013230529fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.406059 752 tablet_service.cc:1511] Processing CreateTablet for tablet 294a8bfd35d04105b6bc03946d25c17a (DEFAULT_TABLE table=default.Table_8f023a35300e46fe80ba1d63915dd524 [id=f229ae0273bf41348803c6ffaa3c098d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.406469 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294a8bfd35d04105b6bc03946d25c17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.406550 891 tablet_service.cc:1511] Processing CreateTablet for tablet 294a8bfd35d04105b6bc03946d25c17a (DEFAULT_TABLE table=default.Table_8f023a35300e46fe80ba1d63915dd524 [id=f229ae0273bf41348803c6ffaa3c098d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.407045 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294a8bfd35d04105b6bc03946d25c17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.410713 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2063248863ed46c196c93013230529fe (DEFAULT_TABLE table=default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.411080 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 086e43b610f9430c872daeef35c5586a (DEFAULT_TABLE table=default.Table_09a7839ef9df4c6cb77cf0a55a133446 [id=e2e28ecbf16446ae9e53e20ff4537b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.411223 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2063248863ed46c196c93013230529fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.411271 757 tablet_service.cc:1511] Processing CreateTablet for tablet ddc0439f992048358f1de4381516e543 (DEFAULT_TABLE table=default.Table_c618c8ab0c5b498eb1aebd26c42d9c10 [id=49f0d093a5f0430f8a88b36ee6719598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.411537 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086e43b610f9430c872daeef35c5586a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.411517 751 tablet_service.cc:1511] Processing CreateTablet for tablet 086e43b610f9430c872daeef35c5586a (DEFAULT_TABLE table=default.Table_09a7839ef9df4c6cb77cf0a55a133446 [id=e2e28ecbf16446ae9e53e20ff4537b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.411652 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddc0439f992048358f1de4381516e543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.411850 1029 tablet_service.cc:1511] Processing CreateTablet for tablet a31fba373a214b5a96bd11b930ed3b86 (DEFAULT_TABLE table=default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.411927 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086e43b610f9430c872daeef35c5586a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.412179 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31fba373a214b5a96bd11b930ed3b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.412721 896 tablet_service.cc:1511] Processing CreateTablet for tablet a31fba373a214b5a96bd11b930ed3b86 (DEFAULT_TABLE table=default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.413049 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31fba373a214b5a96bd11b930ed3b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.413509 895 tablet_service.cc:1511] Processing CreateTablet for tablet ddc0439f992048358f1de4381516e543 (DEFAULT_TABLE table=default.Table_c618c8ab0c5b498eb1aebd26c42d9c10 [id=49f0d093a5f0430f8a88b36ee6719598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.414000 755 tablet_service.cc:1511] Processing CreateTablet for tablet a31fba373a214b5a96bd11b930ed3b86 (DEFAULT_TABLE table=default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.411168 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 294a8bfd35d04105b6bc03946d25c17a (DEFAULT_TABLE table=default.Table_8f023a35300e46fe80ba1d63915dd524 [id=f229ae0273bf41348803c6ffaa3c098d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.414369 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 294a8bfd35d04105b6bc03946d25c17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.414463 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31fba373a214b5a96bd11b930ed3b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.417035 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddc0439f992048358f1de4381516e543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.421847 1172 ts_tablet_manager.cc:1434] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260617 07:53:01.422857 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet a96d648af0a149e8a1e2ff42945b6fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.423128 1170 tablet_replica.cc:333] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:01.423230 898 tablet_service.cc:1511] Processing CreateTablet for tablet 086e43b610f9430c872daeef35c5586a (DEFAULT_TABLE table=default.Table_09a7839ef9df4c6cb77cf0a55a133446 [id=e2e28ecbf16446ae9e53e20ff4537b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.423307 1170 raft_consensus.cc:2243] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.423477 1170 raft_consensus.cc:2272] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.424105 1170 ts_tablet_manager.cc:1916] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.427021 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ddc0439f992048358f1de4381516e543 (DEFAULT_TABLE table=default.Table_c618c8ab0c5b498eb1aebd26c42d9c10 [id=49f0d093a5f0430f8a88b36ee6719598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.427500 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddc0439f992048358f1de4381516e543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.430788 1170 ts_tablet_manager.cc:1929] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.430981 1170 log.cc:1199] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a96d648af0a149e8a1e2ff42945b6fab
I20260617 07:53:01.431445 1170 ts_tablet_manager.cc:1950] T a96d648af0a149e8a1e2ff42945b6fab P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:01.432531 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a96d648af0a149e8a1e2ff42945b6fab (table default.Table_167010d9aec6407bac68c570998189ec [id=69a653bfec384a5ca6613b1d188d8bc4]) successfully deleted
I20260617 07:53:01.437312 1172 tablet_bootstrap.cc:492] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:01.441859 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086e43b610f9430c872daeef35c5586a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.446065 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_26fe425146ac4138adf2a50c3a3ece88" } new_table_name: "default.Table_4d28d190e4ca42dc96c1b61c33672c61" modify_external_catalogs: true
I20260617 07:53:01.449780 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 0435c4596b2d466c92d89ed41f132ea0
I20260617 07:53:01.450239 1178 tablet_bootstrap.cc:654] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.450341 528 catalog_manager.cc:6784] ReplaceTablet: tablet 0435c4596b2d466c92d89ed41f132ea0 deleted and replaced by tablet 80f67a6c1dcf4a69842452c371a9c078
I20260617 07:53:01.451350 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0435c4596b2d466c92d89ed41f132ea0 with delete_type TABLET_DATA_DELETED (replaced by tablet 80f67a6c1dcf4a69842452c371a9c078) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.451458 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 0435c4596b2d466c92d89ed41f132ea0 with delete_type TABLET_DATA_DELETED (replaced by tablet 80f67a6c1dcf4a69842452c371a9c078) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:01.452128 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0435c4596b2d466c92d89ed41f132ea0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0435c4596b2d466c92d89ed41f132ea0 already in progress: creating tablet
I20260617 07:53:01.452682 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 0435c4596b2d466c92d89ed41f132ea0 with delete_type TABLET_DATA_DELETED (replaced by tablet 80f67a6c1dcf4a69842452c371a9c078) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:01.453361 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0435c4596b2d466c92d89ed41f132ea0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0435c4596b2d466c92d89ed41f132ea0 already in progress: creating tablet
I20260617 07:53:01.459409 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 1f3b1f601ac04fe996e63725f2d12e56
I20260617 07:53:01.459723 1171 tablet_bootstrap.cc:492] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.459910 529 catalog_manager.cc:6784] ReplaceTablet: tablet 1f3b1f601ac04fe996e63725f2d12e56 deleted and replaced by tablet 8fa23bb0929440b1820afdce4b9e8d8c
I20260617 07:53:01.459915 1171 ts_tablet_manager.cc:1403] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.201s user 0.001s sys 0.024s
I20260617 07:53:01.460835 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3b1f601ac04fe996e63725f2d12e56 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fa23bb0929440b1820afdce4b9e8d8c) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.461417 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3b1f601ac04fe996e63725f2d12e56 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fa23bb0929440b1820afdce4b9e8d8c) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:01.461756 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 1f3b1f601ac04fe996e63725f2d12e56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f3b1f601ac04fe996e63725f2d12e56 already in progress: creating tablet
I20260617 07:53:01.462033 1171 raft_consensus.cc:359] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.462318 1171 raft_consensus.cc:385] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.462456 1171 raft_consensus.cc:740] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.463117 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet d7e99ddce1e848139376d5188c754d46
I20260617 07:53:01.462929 1171 consensus_queue.cc:260] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.463900 753 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e99ddce1e848139376d5188c754d46 with delete_type TABLET_DATA_DELETED (replaced by tablet 647c5196f8e64c6b9852af7b4c3fcca3) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.463958 525 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]). Expected version 1 got 0
I20260617 07:53:01.464195 1175 tablet_replica.cc:333] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.464450 1175 raft_consensus.cc:2243] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:01.464936 1175 pending_rounds.cc:70] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: Trying to abort 1 pending ops.
I20260617 07:53:01.465157 1175 pending_rounds.cc:77] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772671389540352 op_type: NO_OP noop_request { }
I20260617 07:53:01.465365 1175 raft_consensus.cc:2889] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:01.465538 1175 raft_consensus.cc:2272] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.467419 1175 ts_tablet_manager.cc:1916] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.471009 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_d51aa47a0418400f8f51db808a42c3d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.471679 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d51aa47a0418400f8f51db808a42c3d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.471597 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_eed83a50eb564951beba72394e06b0dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:01.471946 1172 tablet_bootstrap.cc:654] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:01.472123 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eed83a50eb564951beba72394e06b0dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.474924 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e99ddce1e848139376d5188c754d46 with delete_type TABLET_DATA_DELETED (replaced by tablet 647c5196f8e64c6b9852af7b4c3fcca3) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.475175 1170 tablet_replica.cc:333] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:01.475371 1170 raft_consensus.cc:2243] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.473562 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_36ea1c171ce8494897cb86719e457f33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:01.475553 1170 raft_consensus.cc:2272] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.475844 524 catalog_manager.cc:6784] ReplaceTablet: tablet d7e99ddce1e848139376d5188c754d46 deleted and replaced by tablet 647c5196f8e64c6b9852af7b4c3fcca3
W20260617 07:53:01.475950 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36ea1c171ce8494897cb86719e457f33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.476385 1170 ts_tablet_manager.cc:1916] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.480746 1175 ts_tablet_manager.cc:1929] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:01.480898 1175 log.cc:1199] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d7e99ddce1e848139376d5188c754d46
W20260617 07:53:01.481323 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 452f7d2bceb5447290370f72ec788608 has no consensus state
I20260617 07:53:01.481341 1175 ts_tablet_manager.cc:1950] T d7e99ddce1e848139376d5188c754d46 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.471263 891 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e99ddce1e848139376d5188c754d46 with delete_type TABLET_DATA_DELETED (replaced by tablet 647c5196f8e64c6b9852af7b4c3fcca3) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.477666 1169 ts_tablet_manager.cc:1929] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.484675 1169 log.cc:1199] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d3fdc22bf2f24d028393401ae78bf7fb
I20260617 07:53:01.484972 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3b1f601ac04fe996e63725f2d12e56 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fa23bb0929440b1820afdce4b9e8d8c) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.485163 1169 ts_tablet_manager.cc:1950] T d3fdc22bf2f24d028393401ae78bf7fb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.486253 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d3fdc22bf2f24d028393401ae78bf7fb (table default.Table_8b1fdc750b3c4dcca79f18783124f6c1 [id=e5970e1075234e20928126042294cc16]) successfully deleted
I20260617 07:53:01.486578 891 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96aca7a8ee486e9d05290e53b95bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.486860 1169 tablet_replica.cc:333] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.487026 1171 ts_tablet_manager.cc:1434] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.027s user 0.001s sys 0.002s
I20260617 07:53:01.487438 1171 tablet_bootstrap.cc:492] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.487110 1169 raft_consensus.cc:2243] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.488430 1169 raft_consensus.cc:2272] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.489415 1169 ts_tablet_manager.cc:1916] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.494828 1170 ts_tablet_manager.cc:1929] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.495163 1170 log.cc:1199] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d7e99ddce1e848139376d5188c754d46
I20260617 07:53:01.497236 1170 ts_tablet_manager.cc:1950] T d7e99ddce1e848139376d5188c754d46 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:01.500610 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d7e99ddce1e848139376d5188c754d46 (table default.Table_f9ff44e392af4f8bb43efa1aec72265d [id=83b4c82d614147749ec60adc74eda64a]) successfully deleted
I20260617 07:53:01.501384 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d7e99ddce1e848139376d5188c754d46 (table default.Table_f9ff44e392af4f8bb43efa1aec72265d [id=83b4c82d614147749ec60adc74eda64a]) successfully deleted
I20260617 07:53:01.489746 1171 tablet_bootstrap.cc:654] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:01.512504 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 1f3b1f601ac04fe996e63725f2d12e56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f3b1f601ac04fe996e63725f2d12e56 already in progress: creating tablet
I20260617 07:53:01.514822 1169 ts_tablet_manager.cc:1929] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.515647 1169 log.cc:1199] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/2c97be29a90f4b88b568b9f210f94248
I20260617 07:53:01.516184 1169 ts_tablet_manager.cc:1950] T 2c97be29a90f4b88b568b9f210f94248 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.516474 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_4537eb32b59649669393ab9cad5c44a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.517123 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4537eb32b59649669393ab9cad5c44a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.517452 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 2c97be29a90f4b88b568b9f210f94248 (table default.Table_73499470b1494807ba75ea3917853761 [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
W20260617 07:53:01.520957 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e364eed959174ef2a8fbbe7bb2215fa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e364eed959174ef2a8fbbe7bb2215fa1 already in progress: creating tablet
W20260617 07:53:01.521508 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5adee4d54cd94c4b9c45991762d91622 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5adee4d54cd94c4b9c45991762d91622 already in progress: creating tablet
W20260617 07:53:01.522202 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0435c4596b2d466c92d89ed41f132ea0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0435c4596b2d466c92d89ed41f132ea0 already in progress: creating tablet
W20260617 07:53:01.522456 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 1f3b1f601ac04fe996e63725f2d12e56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f3b1f601ac04fe996e63725f2d12e56 already in progress: creating tablet
I20260617 07:53:01.522734 1169 tablet_replica.cc:333] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.522943 1169 raft_consensus.cc:2243] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.523182 1169 raft_consensus.cc:2272] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.523455 891 tablet_service.cc:1511] Processing CreateTablet for tablet 262a34e120f34689ba0b598d7a2999fd (DEFAULT_TABLE table=default.Table_7f7ca184d1ad499cb287399684677763 [id=bc72e8ae07954b5d9f55178f136a72bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.523759 1169 ts_tablet_manager.cc:1916] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.523932 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262a34e120f34689ba0b598d7a2999fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.524552 1171 tablet_bootstrap.cc:492] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.524726 1171 ts_tablet_manager.cc:1403] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.005s
I20260617 07:53:01.525429 525 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]). Expected version 1 got 0
I20260617 07:53:01.525516 1171 raft_consensus.cc:359] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.527153 753 tablet_service.cc:1511] Processing CreateTablet for tablet 262a34e120f34689ba0b598d7a2999fd (DEFAULT_TABLE table=default.Table_7f7ca184d1ad499cb287399684677763 [id=bc72e8ae07954b5d9f55178f136a72bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.527683 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262a34e120f34689ba0b598d7a2999fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.530150 757 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffce17fe5c8405a94a93ad7dd67806e (DEFAULT_TABLE table=default.Table_bac89c3b70e94d8f84681a0043fa2ea8 [id=6b5d086b3d7c428b824a39387d817f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.530596 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffce17fe5c8405a94a93ad7dd67806e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.531888 1171 raft_consensus.cc:385] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.532250 894 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffce17fe5c8405a94a93ad7dd67806e (DEFAULT_TABLE table=default.Table_bac89c3b70e94d8f84681a0043fa2ea8 [id=6b5d086b3d7c428b824a39387d817f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.532807 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffce17fe5c8405a94a93ad7dd67806e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.529901 751 tablet_service.cc:1511] Processing CreateTablet for tablet 452f7d2bceb5447290370f72ec788608 (DEFAULT_TABLE table=default.Table_4d28d190e4ca42dc96c1b61c33672c61 [id=26e1a39e290446dd976682e916b6bd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.534205 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452f7d2bceb5447290370f72ec788608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.537561 1172 tablet_bootstrap.cc:492] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:01.537787 1172 ts_tablet_manager.cc:1403] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.101s user 0.018s sys 0.024s
I20260617 07:53:01.538667 1172 raft_consensus.cc:359] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.538887 1172 raft_consensus.cc:385] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.538956 1172 raft_consensus.cc:740] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.525736 525 catalog_manager.cc:5696] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "6438857e0a7741ceaadf84cb9dc979e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:01.539192 1172 consensus_queue.cc:260] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.539412 525 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e8f7c36eac304694a96dcc41e2b1ea66 (table default.Table_791e9d42cb984c7fa9347e6d00266b68 [id=2a25b9145c5a4982aaf43047c8214926]). Expected version 3 got 0
I20260617 07:53:01.539476 898 tablet_service.cc:1511] Processing CreateTablet for tablet 452f7d2bceb5447290370f72ec788608 (DEFAULT_TABLE table=default.Table_4d28d190e4ca42dc96c1b61c33672c61 [id=26e1a39e290446dd976682e916b6bd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.539942 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452f7d2bceb5447290370f72ec788608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.542223 1172 ts_tablet_manager.cc:1434] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:01.545030 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 262a34e120f34689ba0b598d7a2999fd (DEFAULT_TABLE table=default.Table_7f7ca184d1ad499cb287399684677763 [id=bc72e8ae07954b5d9f55178f136a72bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.545351 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 452f7d2bceb5447290370f72ec788608 (DEFAULT_TABLE table=default.Table_4d28d190e4ca42dc96c1b61c33672c61 [id=26e1a39e290446dd976682e916b6bd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.545897 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffce17fe5c8405a94a93ad7dd67806e (DEFAULT_TABLE table=default.Table_bac89c3b70e94d8f84681a0043fa2ea8 [id=6b5d086b3d7c428b824a39387d817f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.546500 895 tablet_service.cc:1511] Processing CreateTablet for tablet 4ecf80e090494539ae3d20448f8d1126 (DEFAULT_TABLE table=default.Table_cb143d90a8394d7fbe1e54dc7f8c1166 [id=829b5684836747b2aa4265ac17eccd80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.547127 752 tablet_service.cc:1511] Processing CreateTablet for tablet c3a29aeb0a224cabb642f4100c44b8f3 (DEFAULT_TABLE table=default.Table_8fa833038123494b9119b22687fe004a [id=c94c06472dc34885962dd964aa186105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.547549 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3a29aeb0a224cabb642f4100c44b8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.549605 1027 tablet_service.cc:1511] Processing CreateTablet for tablet c3a29aeb0a224cabb642f4100c44b8f3 (DEFAULT_TABLE table=default.Table_8fa833038123494b9119b22687fe004a [id=c94c06472dc34885962dd964aa186105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.549634 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 4ecf80e090494539ae3d20448f8d1126 (DEFAULT_TABLE table=default.Table_cb143d90a8394d7fbe1e54dc7f8c1166 [id=829b5684836747b2aa4265ac17eccd80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.550318 755 tablet_service.cc:1511] Processing CreateTablet for tablet f9e253dca6904dfb914ed4be554da4b5 (DEFAULT_TABLE table=default.Table_9bae350dffe04a48933fbb60e3f26699 [id=d455eadd7e304b7bbb55ccff97befb5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.550724 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e253dca6904dfb914ed4be554da4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.554522 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_d51aa47a0418400f8f51db808a42c3d9" } modify_external_catalogs: true
I20260617 07:53:01.554719 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_d51aa47a0418400f8f51db808a42c3d9" } modify_external_catalogs: true
I20260617 07:53:01.555912 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bac89c3b70e94d8f84681a0043fa2ea8" } modify_external_catalogs: true
I20260617 07:53:01.556079 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bac89c3b70e94d8f84681a0043fa2ea8" } modify_external_catalogs: true
I20260617 07:53:01.557083 751 tablet_service.cc:1511] Processing CreateTablet for tablet 52ae3c99bec7426caac18a6e3880bf51 (DEFAULT_TABLE table=default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.557385 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_d7b564096cd0495cb0f0a82db15e011e" } modify_external_catalogs: true
I20260617 07:53:01.557543 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_d7b564096cd0495cb0f0a82db15e011e" } modify_external_catalogs: true
I20260617 07:53:01.560037 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f9ff44e392af4f8bb43efa1aec72265d" } modify_external_catalogs: true
I20260617 07:53:01.560181 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f9ff44e392af4f8bb43efa1aec72265d" } modify_external_catalogs: true
I20260617 07:53:01.560061 757 tablet_service.cc:1511] Processing CreateTablet for tablet 4ecf80e090494539ae3d20448f8d1126 (DEFAULT_TABLE table=default.Table_cb143d90a8394d7fbe1e54dc7f8c1166 [id=829b5684836747b2aa4265ac17eccd80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.561466 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a4932350eabc437790e3b63a38d8f951"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.562044 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4932350eabc437790e3b63a38d8f951 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.562117 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ecf80e090494539ae3d20448f8d1126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.563244 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_fe4f713af05a4164a8d282cfea623523"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:01.563362 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 52ae3c99bec7426caac18a6e3880bf51 (DEFAULT_TABLE table=default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:01.563686 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe4f713af05a4164a8d282cfea623523 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.564953 1025 tablet_service.cc:1511] Processing CreateTablet for tablet ccf7f07441954d35916890efbfa4d836 (DEFAULT_TABLE table=default.Table_067884ce5e864bdd93b91edd4ef9a521 [id=8b962c8429894c52a1ba7296a6f02205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.568575 758 tablet_service.cc:1558] Processing DeleteTablet for tablet fedebf6da6364fd093fc13ce54beee8c with delete_type TABLET_DATA_DELETED (replaced by tablet 8ac72fef1251446cbd3975d98fa2f4ae) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.568858 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fdc22bf2f24d028393401ae78bf7fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.569108 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c97be29a90f4b88b568b9f210f94248 with delete_type TABLET_DATA_DELETED (replaced by tablet 89d0b4bcb35c42fd8cd2844cd018b634) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.569758 1175 tablet_replica.cc:333] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.569974 1175 raft_consensus.cc:2243] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.570152 1175 raft_consensus.cc:2272] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.570720 890 tablet_service.cc:1511] Processing CreateTablet for tablet f9e253dca6904dfb914ed4be554da4b5 (DEFAULT_TABLE table=default.Table_9bae350dffe04a48933fbb60e3f26699 [id=d455eadd7e304b7bbb55ccff97befb5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.570964 1175 ts_tablet_manager.cc:1916] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.570676 896 tablet_service.cc:1511] Processing CreateTablet for tablet c3a29aeb0a224cabb642f4100c44b8f3 (DEFAULT_TABLE table=default.Table_8fa833038123494b9119b22687fe004a [id=c94c06472dc34885962dd964aa186105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.571308 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ecf80e090494539ae3d20448f8d1126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.574642 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3a29aeb0a224cabb642f4100c44b8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.574906 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ae3c99bec7426caac18a6e3880bf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.577394 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_8f023a35300e46fe80ba1d63915dd524" } modify_external_catalogs: true
I20260617 07:53:01.577610 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_8f023a35300e46fe80ba1d63915dd524" } modify_external_catalogs: true
I20260617 07:53:01.578351 525 master_service.cc:960] ReplaceTablet: received request to replace tablet 2063248863ed46c196c93013230529fe from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.580554 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e253dca6904dfb914ed4be554da4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.581398 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b80fd4d4286241409493bc531eb7fef8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.581965 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b80fd4d4286241409493bc531eb7fef8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.582037 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262a34e120f34689ba0b598d7a2999fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.570138 1171 raft_consensus.cc:740] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.582500 1171 consensus_queue.cc:260] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.583173 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c97be29a90f4b88b568b9f210f94248 with delete_type TABLET_DATA_DELETED (replaced by tablet 89d0b4bcb35c42fd8cd2844cd018b634) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.583173 1031 tablet_service.cc:1511] Processing CreateTablet for tablet f9e253dca6904dfb914ed4be554da4b5 (DEFAULT_TABLE table=default.Table_9bae350dffe04a48933fbb60e3f26699 [id=d455eadd7e304b7bbb55ccff97befb5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.583590 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e253dca6904dfb914ed4be554da4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.584658 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3a29aeb0a224cabb642f4100c44b8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.585578 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf7f07441954d35916890efbfa4d836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.585917 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ae3c99bec7426caac18a6e3880bf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.586287 1171 ts_tablet_manager.cc:1434] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.061s user 0.000s sys 0.002s
I20260617 07:53:01.586592 1171 tablet_bootstrap.cc:492] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.589079 1175 ts_tablet_manager.cc:1929] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.589861 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ecf80e090494539ae3d20448f8d1126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.597551 1169 ts_tablet_manager.cc:1929] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.598767 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0341227ad84c491bb7508718c27fa411" } new_table_name: "default.Table_da1e8c81e4404eecb5c17d208ae890d2" modify_external_catalogs: true
I20260617 07:53:01.600591 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452f7d2bceb5447290370f72ec788608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.601998 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 1481eb3482dd421f94556a1ce32eeed6
I20260617 07:53:01.603087 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 1ffce17fe5c8405a94a93ad7dd67806e
I20260617 07:53:01.603976 526 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 647c5196f8e64c6b9852af7b4c3fcca3
I20260617 07:53:01.604192 526 master_service.cc:960] ReplaceTablet: received request to replace tablet d7e99ddce1e848139376d5188c754d46 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.604538 527 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 305a1988676f4bfe88b936999dddde7f
I20260617 07:53:01.605199 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffce17fe5c8405a94a93ad7dd67806e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.610116 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ffce17fe5c8405a94a93ad7dd67806e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.613942 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 2063248863ed46c196c93013230529fe
I20260617 07:53:01.614086 1170 tablet_replica.cc:333] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:01.614298 1170 raft_consensus.cc:2243] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.614482 1170 raft_consensus.cc:2272] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.614500 525 catalog_manager.cc:6784] ReplaceTablet: tablet 2063248863ed46c196c93013230529fe deleted and replaced by tablet ddb71e5f65cd4b9e8dbe5ddf44e70340
I20260617 07:53:01.614640 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_8bc6c29531e84f969b0890ef763e2072" } new_table_name: "default.Table_23fcac675ff84eea8bea5945a0e604c6" modify_external_catalogs: true
I20260617 07:53:01.614802 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b4b3342eed21433e8924f22e9a41989b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.615411 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4b3342eed21433e8924f22e9a41989b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.616039 1170 ts_tablet_manager.cc:1916] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.616297 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_01592b03d24e492a9fb22885a4195c7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.616842 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01592b03d24e492a9fb22885a4195c7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.617462 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.570428 753 tablet_service.cc:1511] Processing CreateTablet for tablet ccf7f07441954d35916890efbfa4d836 (DEFAULT_TABLE table=default.Table_067884ce5e864bdd93b91edd4ef9a521 [id=8b962c8429894c52a1ba7296a6f02205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.618835 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_860af7cb625c496bb781b7c1b478d606"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:01.618957 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 2063248863ed46c196c93013230529fe with delete_type TABLET_DATA_DELETED (replaced by tablet ddb71e5f65cd4b9e8dbe5ddf44e70340) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:01.619325 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_860af7cb625c496bb781b7c1b478d606 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.620399 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_446494fa57f14df8a45ed1ae3e963352" } new_table_name: "default.Table_94ed63316c4c4d0ba63b1088757d1711" modify_external_catalogs: true
I20260617 07:53:01.620611 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 5b99b80966c94937baf7172b0c36af2a (DEFAULT_TABLE table=default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.621640 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_067884ce5e864bdd93b91edd4ef9a521" } new_table_name: "default.Table_bf7bd0bdbcaa4627bef32d8b9411f0c4" modify_external_catalogs: true
I20260617 07:53:01.621871 1172 tablet_bootstrap.cc:492] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:01.622843 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b99b80966c94937baf7172b0c36af2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.623340 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 294a8bfd35d04105b6bc03946d25c17a
I20260617 07:53:01.624351 1175 log.cc:1199] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/fedebf6da6364fd093fc13ce54beee8c
I20260617 07:53:01.624982 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 294a8bfd35d04105b6bc03946d25c17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.625224 1229 raft_consensus.cc:493] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.625386 1229 raft_consensus.cc:515] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.625775 1169 log.cc:1199] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d7e99ddce1e848139376d5188c754d46
I20260617 07:53:01.626187 1169 ts_tablet_manager.cc:1950] T d7e99ddce1e848139376d5188c754d46 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.622817 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 875962c2e27a4ee1b9889769d53022cc (DEFAULT_TABLE table=default.Table_f7b44d219962403696014ced4ea87a19 [id=50331a51441b4912848b324292638c0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.626809 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500ee0a225c43ebb75a69f9b44ef0dd" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:01.627081 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875962c2e27a4ee1b9889769d53022cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.598033 1171 tablet_bootstrap.cc:654] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.613770 891 tablet_service.cc:1511] Processing CreateTablet for tablet 52ae3c99bec7426caac18a6e3880bf51 (DEFAULT_TABLE table=default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.627566 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ae3c99bec7426caac18a6e3880bf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.627977 1052 raft_consensus.cc:1275] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:01.628155 1229 leader_election.cc:290] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:01.628995 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500ee0a225c43ebb75a69f9b44ef0dd" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:01.629514 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ffce17fe5c8405a94a93ad7dd67806e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.629810 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 294a8bfd35d04105b6bc03946d25c17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.630666 1228 consensus_queue.cc:1048] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:01.615100 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.615537 890 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d25b9220bc414b88a0cf3991f9ec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.618433 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ffce17fe5c8405a94a93ad7dd67806e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.618626 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 2063248863ed46c196c93013230529fe with delete_type TABLET_DATA_DELETED (replaced by tablet ddb71e5f65cd4b9e8dbe5ddf44e70340) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.619664 897 tablet_service.cc:1511] Processing CreateTablet for tablet ccf7f07441954d35916890efbfa4d836 (DEFAULT_TABLE table=default.Table_067884ce5e864bdd93b91edd4ef9a521 [id=8b962c8429894c52a1ba7296a6f02205]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.622176 892 tablet_service.cc:1511] Processing CreateTablet for tablet 5b99b80966c94937baf7172b0c36af2a (DEFAULT_TABLE table=default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.624696 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 294a8bfd35d04105b6bc03946d25c17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.632755 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf7f07441954d35916890efbfa4d836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.633066 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b99b80966c94937baf7172b0c36af2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.633633 1169 tablet_replica.cc:333] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.636971 893 tablet_service.cc:1511] Processing CreateTablet for tablet 875962c2e27a4ee1b9889769d53022cc (DEFAULT_TABLE table=default.Table_f7b44d219962403696014ced4ea87a19 [id=50331a51441b4912848b324292638c0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.638068 1169 raft_consensus.cc:2243] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.638181 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875962c2e27a4ee1b9889769d53022cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.638278 1169 raft_consensus.cc:2272] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.640271 898 tablet_service.cc:1511] Processing CreateTablet for tablet a5b7b95327604ef8b43944c4821d4ed7 (DEFAULT_TABLE table=default.Table_5fcf50bba845478aa1765c2ac162b1c1 [id=0d961292ee114171bd682606f6df393d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.640648 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b7b95327604ef8b43944c4821d4ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.642594 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a5b7b95327604ef8b43944c4821d4ed7 (DEFAULT_TABLE table=default.Table_5fcf50bba845478aa1765c2ac162b1c1 [id=0d961292ee114171bd682606f6df393d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.643131 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b7b95327604ef8b43944c4821d4ed7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:01.648095 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b14f9f70461e49ccb4d318eab824a3e1 consensus state has no leader
I20260617 07:53:01.651383 1169 ts_tablet_manager.cc:1916] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.653738 760 tablet_service.cc:1511] Processing CreateTablet for tablet 5b99b80966c94937baf7172b0c36af2a (DEFAULT_TABLE table=default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.653751 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.659677 1172 tablet_bootstrap.cc:654] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.663142 527 master_service.cc:960] ReplaceTablet: received request to replace tablet cad8eca2f4184640a3eba751a7855abb from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.663264 1170 ts_tablet_manager.cc:1929] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.663407 1170 log.cc:1199] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/2c97be29a90f4b88b568b9f210f94248
W20260617 07:53:01.668193 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9c156733805461ca185f7797525392f consensus state has no leader
W20260617 07:53:01.668655 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ccf7f07441954d35916890efbfa4d836 consensus state has no leader
I20260617 07:53:01.670171 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 2a80c833560f46789a079bd7672e1874 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.670568 1170 ts_tablet_manager.cc:1950] T 2c97be29a90f4b88b568b9f210f94248 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:01.671605 1171 tablet_bootstrap.cc:492] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.672879 1171 ts_tablet_manager.cc:1403] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.086s user 0.004s sys 0.003s
I20260617 07:53:01.673231 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 2c97be29a90f4b88b568b9f210f94248 (table default.Table_73499470b1494807ba75ea3917853761 [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
I20260617 07:53:01.674292 1172 tablet_bootstrap.cc:492] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:01.674593 1172 ts_tablet_manager.cc:1403] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.132s user 0.000s sys 0.004s
W20260617 07:53:01.675485 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 1ffce17fe5c8405a94a93ad7dd67806e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ffce17fe5c8405a94a93ad7dd67806e already in progress: creating tablet
I20260617 07:53:01.675865 1172 raft_consensus.cc:359] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:01.676069 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 1481eb3482dd421f94556a1ce32eeed6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1481eb3482dd421f94556a1ce32eeed6 already in progress: creating tablet
I20260617 07:53:01.676285 1172 raft_consensus.cc:385] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.677006 1172 raft_consensus.cc:740] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:01.677876 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2063248863ed46c196c93013230529fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2063248863ed46c196c93013230529fe already in progress: creating tablet
I20260617 07:53:01.678701 1172 consensus_queue.cc:260] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:01.678982 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 294a8bfd35d04105b6bc03946d25c17a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 294a8bfd35d04105b6bc03946d25c17a already in progress: creating tablet
I20260617 07:53:01.679884 1172 ts_tablet_manager.cc:1434] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
W20260617 07:53:01.685225 713 leader_election.cc:343] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:01.685472 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_fe4f713af05a4164a8d282cfea623523" } new_table_name: "default.Table_b5dd15921c6b423fad2fcbc1f3731fae" modify_external_catalogs: true
W20260617 07:53:01.685421 713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 53319.2us
W20260617 07:53:01.685931 716 leader_election.cc:343] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:01.686385 716 leader_election.cc:304] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:01.686707 1229 raft_consensus.cc:2749] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:01.687407 524 master_service.cc:960] ReplaceTablet: received request to replace tablet e8f7c36eac304694a96dcc41e2b1ea66 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.687455 780 raft_consensus.cc:1275] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:01.682544 1172 tablet_bootstrap.cc:492] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:01.685240 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf7f07441954d35916890efbfa4d836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.690405 1175 ts_tablet_manager.cc:1950] T fedebf6da6364fd093fc13ce54beee8c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.691504 1172 tablet_bootstrap.cc:654] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.692044 755 tablet_service.cc:1511] Processing CreateTablet for tablet a5b7b95327604ef8b43944c4821d4ed7 (DEFAULT_TABLE table=default.Table_5fcf50bba845478aa1765c2ac162b1c1 [id=0d961292ee114171bd682606f6df393d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.692453 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 2063248863ed46c196c93013230529fe with delete_type TABLET_DATA_DELETED (replaced by tablet ddb71e5f65cd4b9e8dbe5ddf44e70340) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.692770 758 tablet_service.cc:1511] Processing CreateTablet for tablet 875962c2e27a4ee1b9889769d53022cc (DEFAULT_TABLE table=default.Table_f7b44d219962403696014ced4ea87a19 [id=50331a51441b4912848b324292638c0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.692770 1171 raft_consensus.cc:359] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.692970 1171 raft_consensus.cc:385] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.693063 1171 raft_consensus.cc:740] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.693105 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b99b80966c94937baf7172b0c36af2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.693311 1171 consensus_queue.cc:260] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.695847 527 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_da1e8c81e4404eecb5c17d208ae890d2 [id=b917e24e4cee4805b575b97ac7068195]). Expected version 3 got 0
I20260617 07:53:01.695906 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet fedebf6da6364fd093fc13ce54beee8c (table default.Table_b5ea244188ba423a926d78f48e818554 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]) successfully deleted
I20260617 07:53:01.696043 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_3581e5e8a5934a608ee4f15216c02996"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:01.696487 1175 tablet_replica.cc:333] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:01.696615 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3581e5e8a5934a608ee4f15216c02996 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.696691 1175 raft_consensus.cc:2243] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.697022 1175 raft_consensus.cc:2272] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.697124 1171 ts_tablet_manager.cc:1434] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260617 07:53:01.697270 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b7b95327604ef8b43944c4821d4ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.697490 1171 tablet_bootstrap.cc:492] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.699774 1228 consensus_queue.cc:1048] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:01.700670 1175 ts_tablet_manager.cc:1916] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.702119 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875962c2e27a4ee1b9889769d53022cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.702378 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_45c63267e23f435fbd339cff71a43d48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.703006 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45c63267e23f435fbd339cff71a43d48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.704910 1178 tablet_bootstrap.cc:492] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:01.705509 1169 ts_tablet_manager.cc:1929] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.706447 1169 log.cc:1199] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/bb96aca7a8ee486e9d05290e53b95bbc
I20260617 07:53:01.706997 1169 ts_tablet_manager.cc:1950] T bb96aca7a8ee486e9d05290e53b95bbc P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.707602 1257 mvcc.cc:204] Tried to move back new op lower bound from 7297772673529696256 to 7297772672446410752. Current Snapshot: MvccSnapshot[applied={T|T < 7297772673529696256}]
I20260617 07:53:01.708897 1172 tablet_bootstrap.cc:492] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:01.709143 1172 ts_tablet_manager.cc:1403] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260617 07:53:01.710124 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet bb96aca7a8ee486e9d05290e53b95bbc (table default.Table_579d624a64244301bd5648e35f0d2a44 [id=fb7fb070eb1041c580e63ebc35d8558c]) successfully deleted
I20260617 07:53:01.710855 1172 raft_consensus.cc:359] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:01.711580 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 1481eb3482dd421f94556a1ce32eeed6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1481eb3482dd421f94556a1ce32eeed6 already in progress: creating tablet
I20260617 07:53:01.711910 1169 tablet_replica.cc:333] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.712715 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_6dd3b32c3f7c4ae58bf47ef40691387e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.713312 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dd3b32c3f7c4ae58bf47ef40691387e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.714645 1172 raft_consensus.cc:385] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.714830 1172 raft_consensus.cc:740] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.715122 1169 raft_consensus.cc:2243] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.715512 1172 consensus_queue.cc:260] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.715895 1169 raft_consensus.cc:2272] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.712055 1171 tablet_bootstrap.cc:654] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.717839 1169 ts_tablet_manager.cc:1916] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.719095 1172 ts_tablet_manager.cc:1434] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260617 07:53:01.721735 1172 tablet_bootstrap.cc:492] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:01.721868 1261 tablet.cc:1724] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:01.723814 1263 tablet.cc:1724] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:01.729543 1172 tablet_bootstrap.cc:654] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.730182 1178 ts_tablet_manager.cc:1403] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.311s user 0.009s sys 0.009s
I20260617 07:53:01.733067 1178 raft_consensus.cc:359] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.735306 1171 tablet_bootstrap.cc:492] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.735491 1171 ts_tablet_manager.cc:1403] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260617 07:53:01.735831 1178 raft_consensus.cc:385] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.736361 1171 raft_consensus.cc:359] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.736583 1171 raft_consensus.cc:385] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.736688 1171 raft_consensus.cc:740] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.737021 1171 consensus_queue.cc:260] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:01.737146 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 19f8525046964950884b0f9aa515ec81 has no consensus state
I20260617 07:53:01.738647 1171 ts_tablet_manager.cc:1434] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:01.739799 1171 tablet_bootstrap.cc:492] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.739925 1178 raft_consensus.cc:740] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.740347 1178 consensus_queue.cc:260] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.741017 1169 ts_tablet_manager.cc:1929] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.741209 1169 log.cc:1199] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d6d25b9220bc414b88a0cf3991f9ec5c
I20260617 07:53:01.742125 1169 ts_tablet_manager.cc:1950] T d6d25b9220bc414b88a0cf3991f9ec5c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.743382 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d6d25b9220bc414b88a0cf3991f9ec5c (table default.Table_2b271e2563664a57a954aa99a29e38ce [id=bfc8d977c5b4448cb8fb2a9cabe10281]) successfully deleted
W20260617 07:53:01.743664 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 1ffce17fe5c8405a94a93ad7dd67806e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ffce17fe5c8405a94a93ad7dd67806e already in progress: creating tablet
W20260617 07:53:01.743887 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 294a8bfd35d04105b6bc03946d25c17a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 294a8bfd35d04105b6bc03946d25c17a already in progress: creating tablet
W20260617 07:53:01.744050 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2063248863ed46c196c93013230529fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2063248863ed46c196c93013230529fe already in progress: creating tablet
I20260617 07:53:01.745184 1175 ts_tablet_manager.cc:1929] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.745337 1175 log.cc:1199] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d3fdc22bf2f24d028393401ae78bf7fb
I20260617 07:53:01.745697 1175 ts_tablet_manager.cc:1950] T d3fdc22bf2f24d028393401ae78bf7fb P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.746685 1171 tablet_bootstrap.cc:654] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.747088 1175 tablet_replica.cc:333] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.747352 1175 raft_consensus.cc:2243] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:01.747452 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d3fdc22bf2f24d028393401ae78bf7fb (table default.Table_8b1fdc750b3c4dcca79f18783124f6c1 [id=e5970e1075234e20928126042294cc16]) successfully deleted
I20260617 07:53:01.747754 1175 pending_rounds.cc:70] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: Trying to abort 1 pending ops.
I20260617 07:53:01.747917 1175 pending_rounds.cc:77] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772672508239872 op_type: NO_OP noop_request { }
I20260617 07:53:01.747969 1178 ts_tablet_manager.cc:1434] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260617 07:53:01.748143 1175 raft_consensus.cc:2889] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:01.748174 1255 mvcc.cc:204] Tried to move back new op lower bound from 7297772673529696256 to 7297772672446410752. Current Snapshot: MvccSnapshot[applied={T|T < 7297772673529696256}]
I20260617 07:53:01.748378 1175 raft_consensus.cc:2272] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.749504 1178 tablet_bootstrap.cc:492] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:01.749943 1175 ts_tablet_manager.cc:1916] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.752321 1171 tablet_bootstrap.cc:492] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:01.752485 1171 ts_tablet_manager.cc:1403] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.001s
I20260617 07:53:01.752878 1174 raft_consensus.cc:493] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.753027 1174 raft_consensus.cc:515] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.753252 1171 raft_consensus.cc:359] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.753695 1174 leader_election.cc:290] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:01.754734 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7c36eac304694a96dcc41e2b1ea66" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:01.755872 1171 raft_consensus.cc:385] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.756050 1171 raft_consensus.cc:740] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.754804 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7c36eac304694a96dcc41e2b1ea66" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:01.756422 917 raft_consensus.cc:2393] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc3bec007846459a9da0c7b8211e477b in current term 1: Already voted for candidate 6438857e0a7741ceaadf84cb9dc979e7 in this term.
I20260617 07:53:01.756455 1171 consensus_queue.cc:260] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.755604 1261 tablet.cc:1724] T f6fdc168bd4a4eaca86b24a986b4eb7d P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:01.756538 1263 tablet.cc:1724] T f6fdc168bd4a4eaca86b24a986b4eb7d P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:01.757727 988 leader_election.cc:304] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:01.758148 1171 ts_tablet_manager.cc:1434] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:01.758139 1174 raft_consensus.cc:3060] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.759433 1171 tablet_bootstrap.cc:492] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:01.760952 1174 raft_consensus.cc:2749] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:01.762349 1171 tablet_bootstrap.cc:654] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.766211 1178 tablet_bootstrap.cc:654] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.766549 1175 ts_tablet_manager.cc:1929] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:01.766676 1175 log.cc:1199] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/2c97be29a90f4b88b568b9f210f94248
I20260617 07:53:01.767163 1175 ts_tablet_manager.cc:1950] T 2c97be29a90f4b88b568b9f210f94248 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.767274 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_c4bed0983265433fb2c278c49377729a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.768103 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4bed0983265433fb2c278c49377729a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.768397 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 2c97be29a90f4b88b568b9f210f94248 (table default.Table_73499470b1494807ba75ea3917853761 [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
W20260617 07:53:01.769095 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 1ffce17fe5c8405a94a93ad7dd67806e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ffce17fe5c8405a94a93ad7dd67806e already in progress: creating tablet
W20260617 07:53:01.769759 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 294a8bfd35d04105b6bc03946d25c17a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 294a8bfd35d04105b6bc03946d25c17a already in progress: creating tablet
W20260617 07:53:01.770829 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 1481eb3482dd421f94556a1ce32eeed6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1481eb3482dd421f94556a1ce32eeed6 already in progress: creating tablet
W20260617 07:53:01.771468 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2063248863ed46c196c93013230529fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2063248863ed46c196c93013230529fe already in progress: creating tablet
I20260617 07:53:01.774893 1178 tablet_bootstrap.cc:492] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:01.775058 1178 ts_tablet_manager.cc:1403] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260617 07:53:01.775871 1178 raft_consensus.cc:359] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.776078 1178 raft_consensus.cc:385] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.776180 1178 raft_consensus.cc:740] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.776415 1178 consensus_queue.cc:260] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.777235 528 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_da1e8c81e4404eecb5c17d208ae890d2 [id=b917e24e4cee4805b575b97ac7068195]). Expected version 3 got 0
I20260617 07:53:01.783102 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cee843694bd4f268347e7fc8673816e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.783370 1175 tablet_replica.cc:333] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.783565 1175 raft_consensus.cc:2243] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.783759 1175 raft_consensus.cc:2272] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.784816 1175 ts_tablet_manager.cc:1916] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.794198 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet e8f7c36eac304694a96dcc41e2b1ea66
I20260617 07:53:01.794986 524 catalog_manager.cc:6784] ReplaceTablet: tablet e8f7c36eac304694a96dcc41e2b1ea66 deleted and replaced by tablet f1f2c87bd54249c282bb2b0213fd54ac
I20260617 07:53:01.797887 757 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f7c36eac304694a96dcc41e2b1ea66 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f2c87bd54249c282bb2b0213fd54ac) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.802109 525 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]). Expected version 1 got 0
I20260617 07:53:01.802713 527 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]). Expected version 1 got 0
I20260617 07:53:01.805094 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_791e9d42cb984c7fa9347e6d00266b68" } modify_external_catalogs: true
I20260617 07:53:01.805294 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_791e9d42cb984c7fa9347e6d00266b68" } modify_external_catalogs: true
I20260617 07:53:01.807655 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_8fa833038123494b9119b22687fe004a" } modify_external_catalogs: true
I20260617 07:53:01.807713 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_3581e5e8a5934a608ee4f15216c02996" } modify_external_catalogs: true
I20260617 07:53:01.807834 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_8fa833038123494b9119b22687fe004a" } modify_external_catalogs: true
I20260617 07:53:01.807904 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_3581e5e8a5934a608ee4f15216c02996" } modify_external_catalogs: true
I20260617 07:53:01.810204 898 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f7c36eac304694a96dcc41e2b1ea66 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f2c87bd54249c282bb2b0213fd54ac) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.810479 1169 tablet_replica.cc:333] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.810491 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_12efac8f00f3425cac18946f8560096a" } modify_external_catalogs: true
I20260617 07:53:01.810568 892 tablet_service.cc:1511] Processing CreateTablet for tablet 787467c65f68442aad071df16d4492f3 (DEFAULT_TABLE table=default.Table_860af7cb625c496bb781b7c1b478d606 [id=61342c668451423aafa602607f19a1db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.810698 1169 raft_consensus.cc:2243] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.810689 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_12efac8f00f3425cac18946f8560096a" } modify_external_catalogs: true
I20260617 07:53:01.810875 1169 raft_consensus.cc:2272] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.811049 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787467c65f68442aad071df16d4492f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.811437 1169 ts_tablet_manager.cc:1916] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.819139 1052 raft_consensus.cc:1275] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 6438857e0a7741ceaadf84cb9dc979e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:01.819940 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_ef07d99bfb1e43dc8d81cfe46a4b4be0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.820523 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef07d99bfb1e43dc8d81cfe46a4b4be0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:01.820686 716 consensus_peers.cc:597] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:01.821883 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_18022f62726247619f7b826a278aa15a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:01.822301 1175 ts_tablet_manager.cc:1929] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.822345 757 tablet_service.cc:1511] Processing CreateTablet for tablet 787467c65f68442aad071df16d4492f3 (DEFAULT_TABLE table=default.Table_860af7cb625c496bb781b7c1b478d606 [id=61342c668451423aafa602607f19a1db]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:01.822448 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18022f62726247619f7b826a278aa15a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.822911 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787467c65f68442aad071df16d4492f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.823143 1178 ts_tablet_manager.cc:1434] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.048s user 0.003s sys 0.000s
I20260617 07:53:01.823493 1178 tablet_bootstrap.cc:492] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:01.824612 892 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2cb23911614f9dab0767b1f6af3d00 (DEFAULT_TABLE table=default.Table_b4b3342eed21433e8924f22e9a41989b [id=7738095992784d1e80554f9f554fb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.825001 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2cb23911614f9dab0767b1f6af3d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.822451 1175 log.cc:1199] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/3cee843694bd4f268347e7fc8673816e
I20260617 07:53:01.831765 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_7e5bc7ff50154b6ea71d9df096938e22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.832370 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e5bc7ff50154b6ea71d9df096938e22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.833082 1175 ts_tablet_manager.cc:1950] T 3cee843694bd4f268347e7fc8673816e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.834187 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 3cee843694bd4f268347e7fc8673816e (table default.Table_49587b2e81f148a4a250f39749e158d3 [id=e4cac3bc7e8e4142b8168b04644a5194]) successfully deleted
I20260617 07:53:01.835568 753 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2cb23911614f9dab0767b1f6af3d00 (DEFAULT_TABLE table=default.Table_b4b3342eed21433e8924f22e9a41989b [id=7738095992784d1e80554f9f554fb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.835807 1178 tablet_bootstrap.cc:654] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.836024 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2cb23911614f9dab0767b1f6af3d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.838665 893 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9d9ed003c64b1abed6bd3bb14456cd (DEFAULT_TABLE table=default.Table_b80fd4d4286241409493bc531eb7fef8 [id=778d846ba4124b08a28bb83a2777841e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.838824 898 tablet_service.cc:1511] Processing CreateTablet for tablet 06e0f2f9a75d4f9ba8702e4da75c042f (DEFAULT_TABLE table=default.Table_a4932350eabc437790e3b63a38d8f951 [id=27c9cf5e8d154b13a0de73ee2c60c357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.838838 896 tablet_service.cc:1511] Processing CreateTablet for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 (DEFAULT_TABLE table=default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.839138 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9d9ed003c64b1abed6bd3bb14456cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.839089 891 tablet_service.cc:1511] Processing CreateTablet for tablet 074a3e08cc9a4be891016ce197a993be (DEFAULT_TABLE table=default.Table_eed83a50eb564951beba72394e06b0dc [id=3824f4c443804be49d851e39e23ce3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.839337 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.839537 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e0f2f9a75d4f9ba8702e4da75c042f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.839787 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074a3e08cc9a4be891016ce197a993be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.844295 1174 raft_consensus.cc:493] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.844940 1174 raft_consensus.cc:515] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.846046 1174 leader_election.cc:290] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:01.846593 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500ee0a225c43ebb75a69f9b44ef0dd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:01.846863 917 raft_consensus.cc:2468] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:01.847250 988 leader_election.cc:304] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:01.839680 1229 consensus_queue.cc:1048] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260617 07:53:01.839730 760 tablet_service.cc:1511] Processing CreateTablet for tablet 074a3e08cc9a4be891016ce197a993be (DEFAULT_TABLE table=default.Table_eed83a50eb564951beba72394e06b0dc [id=3824f4c443804be49d851e39e23ce3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.848564 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074a3e08cc9a4be891016ce197a993be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.839990 751 tablet_service.cc:1511] Processing CreateTablet for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 (DEFAULT_TABLE table=default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.850117 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.850425 1169 ts_tablet_manager.cc:1929] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.850569 1169 log.cc:1199] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/e8f7c36eac304694a96dcc41e2b1ea66
I20260617 07:53:01.850924 1169 ts_tablet_manager.cc:1950] T e8f7c36eac304694a96dcc41e2b1ea66 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.852978 1174 raft_consensus.cc:2804] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:01.853111 1174 raft_consensus.cc:493] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:01.853221 1174 raft_consensus.cc:3060] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.840209 758 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9d9ed003c64b1abed6bd3bb14456cd (DEFAULT_TABLE table=default.Table_b80fd4d4286241409493bc531eb7fef8 [id=778d846ba4124b08a28bb83a2777841e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.854477 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9d9ed003c64b1abed6bd3bb14456cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.854429 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet e8f7c36eac304694a96dcc41e2b1ea66 (table default.Table_791e9d42cb984c7fa9347e6d00266b68 [id=2a25b9145c5a4982aaf43047c8214926]) successfully deleted
I20260617 07:53:01.856528 1174 raft_consensus.cc:515] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.840473 755 tablet_service.cc:1511] Processing CreateTablet for tablet 06e0f2f9a75d4f9ba8702e4da75c042f (DEFAULT_TABLE table=default.Table_a4932350eabc437790e3b63a38d8f951 [id=27c9cf5e8d154b13a0de73ee2c60c357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.858265 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e0f2f9a75d4f9ba8702e4da75c042f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.847245 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500ee0a225c43ebb75a69f9b44ef0dd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:01.866192 780 raft_consensus.cc:2468] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
W20260617 07:53:01.875947 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:41615, user_credentials={real_user=slave}} blocked reactor thread for 85966.1us
I20260617 07:53:01.876636 898 tablet_service.cc:1511] Processing CreateTablet for tablet a460aee4eb514a87b272c4fc858335e7 (DEFAULT_TABLE table=default.Table_01592b03d24e492a9fb22885a4195c7f [id=325e591e926743a9ab92d48a1e73bf8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.877072 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a460aee4eb514a87b272c4fc858335e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.838294 1175 tablet_replica.cc:333] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:01.877799 1175 raft_consensus.cc:2243] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:01.878180 755 tablet_service.cc:1511] Processing CreateTablet for tablet a460aee4eb514a87b272c4fc858335e7 (DEFAULT_TABLE table=default.Table_01592b03d24e492a9fb22885a4195c7f [id=325e591e926743a9ab92d48a1e73bf8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.878672 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a460aee4eb514a87b272c4fc858335e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.881552 1175 pending_rounds.cc:70] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Trying to abort 2 pending ops.
I20260617 07:53:01.881629 1175 pending_rounds.cc:77] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7297772674321702912 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "e8f7c36eac304694a96dcc41e2b1ea66" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 3 new_table_name: "default.Table_791e9d42cb984c7fa9347e6d00266b68" dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" new_extra_config { } }
W20260617 07:53:01.882809 1175 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38066: Aborted: Op aborted
W20260617 07:53:01.885439 517 catalog_manager.cc:5106] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): alter failed for tablet e8f7c36eac304694a96dcc41e2b1ea66 (table default.Table_791e9d42cb984c7fa9347e6d00266b68 [id=2a25b9145c5a4982aaf43047c8214926]): Aborted: Op aborted
I20260617 07:53:01.885627 1178 tablet_bootstrap.cc:492] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:01.885797 1178 ts_tablet_manager.cc:1403] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.001s
I20260617 07:53:01.886571 1178 raft_consensus.cc:359] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.886771 1178 raft_consensus.cc:385] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.886833 1178 raft_consensus.cc:740] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.887326 1175 pending_rounds.cc:77] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772671623823360 op_type: NO_OP noop_request { }
I20260617 07:53:01.887454 1175 raft_consensus.cc:2889] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:01.887547 1175 raft_consensus.cc:2272] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.883440 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f7c36eac304694a96dcc41e2b1ea66 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f2c87bd54249c282bb2b0213fd54ac) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.883863 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 787467c65f68442aad071df16d4492f3 (DEFAULT_TABLE table=default.Table_860af7cb625c496bb781b7c1b478d606 [id=61342c668451423aafa602607f19a1db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.892886 1170 tablet_replica.cc:333] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:01.884240 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2cb23911614f9dab0767b1f6af3d00 (DEFAULT_TABLE table=default.Table_b4b3342eed21433e8924f22e9a41989b [id=7738095992784d1e80554f9f554fb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.884516 1028 tablet_service.cc:1511] Processing CreateTablet for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 (DEFAULT_TABLE table=default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.893574 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2cb23911614f9dab0767b1f6af3d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.894037 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500ee0a225c43ebb75a69f9b44ef0dd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:01.894294 780 raft_consensus.cc:3060] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.898008 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.897979 780 raft_consensus.cc:2468] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:01.898696 986 leader_election.cc:304] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:01.899945 898 tablet_service.cc:1511] Processing CreateTablet for tablet f345910256784d2085cb81473534dcaf (DEFAULT_TABLE table=default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.900411 1174 leader_election.cc:290] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:01.900455 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f345910256784d2085cb81473534dcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.901400 1029 tablet_service.cc:1511] Processing CreateTablet for tablet f345910256784d2085cb81473534dcaf (DEFAULT_TABLE table=default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.901795 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f345910256784d2085cb81473534dcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.901947 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500ee0a225c43ebb75a69f9b44ef0dd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:01.902591 917 raft_consensus.cc:3060] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:01.905404 917 raft_consensus.cc:2468] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:01.905972 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787467c65f68442aad071df16d4492f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.884608 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9d9ed003c64b1abed6bd3bb14456cd (DEFAULT_TABLE table=default.Table_b80fd4d4286241409493bc531eb7fef8 [id=778d846ba4124b08a28bb83a2777841e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.910044 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9d9ed003c64b1abed6bd3bb14456cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.910876 1273 raft_consensus.cc:2804] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:01.884826 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 06e0f2f9a75d4f9ba8702e4da75c042f (DEFAULT_TABLE table=default.Table_a4932350eabc437790e3b63a38d8f951 [id=27c9cf5e8d154b13a0de73ee2c60c357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.911048 1273 raft_consensus.cc:697] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:01.911358 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e0f2f9a75d4f9ba8702e4da75c042f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.912528 1175 ts_tablet_manager.cc:1916] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.884893 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a460aee4eb514a87b272c4fc858335e7 (DEFAULT_TABLE table=default.Table_01592b03d24e492a9fb22885a4195c7f [id=325e591e926743a9ab92d48a1e73bf8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.914026 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a460aee4eb514a87b272c4fc858335e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.914036 760 tablet_service.cc:1511] Processing CreateTablet for tablet f345910256784d2085cb81473534dcaf (DEFAULT_TABLE table=default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.885035 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 074a3e08cc9a4be891016ce197a993be (DEFAULT_TABLE table=default.Table_eed83a50eb564951beba72394e06b0dc [id=3824f4c443804be49d851e39e23ce3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.914415 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f345910256784d2085cb81473534dcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.914533 898 tablet_service.cc:1511] Processing CreateTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a (DEFAULT_TABLE table=default.Table_4537eb32b59649669393ab9cad5c44a6 [id=f7bea6866b9845f1a116293b182de7bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.914933 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69996eb4ab6e40f9b2d97e00d766822a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.921315 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: default.Table_da1e8c81e4404eecb5c17d208ae890d2 [id=b917e24e4cee4805b575b97ac7068195] alter complete (version 3)
I20260617 07:53:01.921607 1178 consensus_queue.cc:260] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.922219 1178 ts_tablet_manager.cc:1434] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260617 07:53:01.922544 1178 tablet_bootstrap.cc:492] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:01.922554 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_01592b03d24e492a9fb22885a4195c7f" } modify_external_catalogs: true
I20260617 07:53:01.922734 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_01592b03d24e492a9fb22885a4195c7f" } modify_external_catalogs: true
I20260617 07:53:01.923050 528 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 1e6fd623f731455d90105aa37b3d7cbc
I20260617 07:53:01.923365 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 5b99b80966c94937baf7172b0c36af2a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.925485 530 master_service.cc:960] ReplaceTablet: received request to replace tablet 5b99b80966c94937baf7172b0c36af2a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.925917 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cee843694bd4f268347e7fc8673816e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.925946 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_cb143d90a8394d7fbe1e54dc7f8c1166" } new_table_name: "default.Table_ac940c0f5a9d49babeff827981e9d7d3" modify_external_catalogs: true
I20260617 07:53:01.926087 891 tablet_service.cc:1558] Processing DeleteTablet for tablet fedebf6da6364fd093fc13ce54beee8c with delete_type TABLET_DATA_DELETED (replaced by tablet 8ac72fef1251446cbd3975d98fa2f4ae) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.926278 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_4537eb32b59649669393ab9cad5c44a6" } new_table_name: "default.Table_0e8fe92eb0e14e9ea3e8b68b977f1690" modify_external_catalogs: true
I20260617 07:53:01.926509 1169 tablet_replica.cc:333] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.926672 1169 raft_consensus.cc:2243] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.926839 1169 raft_consensus.cc:2272] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.927570 1169 ts_tablet_manager.cc:1916] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:01.927734 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet c3a29aeb0a224cabb642f4100c44b8f3
I20260617 07:53:01.928565 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b106b0223948469da9ef0246aceeed0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.929431 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b106b0223948469da9ef0246aceeed0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.929605 760 tablet_service.cc:1558] Processing DeleteTablet for tablet c3a29aeb0a224cabb642f4100c44b8f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.931142 1178 tablet_bootstrap.cc:654] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.931265 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_9453aea1d6914fcaa82124a775199814"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:01.931738 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9453aea1d6914fcaa82124a775199814 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.933508 525 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet f1f2c87bd54249c282bb2b0213fd54ac
I20260617 07:53:01.934469 891 tablet_service.cc:1558] Processing DeleteTablet for tablet c3a29aeb0a224cabb642f4100c44b8f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.934568 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_45d3051485a04d58ab910c518ff9b9b8" } new_table_name: "default.Table_e4f5053ee058492a96b46167bade387b" modify_external_catalogs: true
I20260617 07:53:01.935406 1169 ts_tablet_manager.cc:1929] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.935583 1169 log.cc:1199] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/3cee843694bd4f268347e7fc8673816e
I20260617 07:53:01.936069 1169 ts_tablet_manager.cc:1950] T 3cee843694bd4f268347e7fc8673816e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.936396 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet ddb71e5f65cd4b9e8dbe5ddf44e70340
I20260617 07:53:01.936430 1228 raft_consensus.cc:493] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.936596 1228 raft_consensus.cc:515] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.937225 1228 leader_election.cc:290] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:01.937407 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_23fcac675ff84eea8bea5945a0e604c6" } new_table_name: "default.Table_0da48fe3fdde4465a7439aba33ec5d15" modify_external_catalogs: true
I20260617 07:53:01.937592 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.937984 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedebf6da6364fd093fc13ce54beee8c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:01.938577 851 leader_election.cc:343] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:01.939554 1229 raft_consensus.cc:493] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:01.939530 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_540131f07d9249ec80a4db3900a4ed2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:01.939738 1229 raft_consensus.cc:515] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.940033 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 3cee843694bd4f268347e7fc8673816e (table default.Table_49587b2e81f148a4a250f39749e158d3 [id=e4cac3bc7e8e4142b8168b04644a5194]) successfully deleted
W20260617 07:53:01.940224 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_540131f07d9249ec80a4db3900a4ed2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:01.940364 1169 tablet_replica.cc:333] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:01.940376 1229 leader_election.cc:290] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:01.940572 1169 raft_consensus.cc:2243] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:01.940743 1169 raft_consensus.cc:2272] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:01.941581 1169 ts_tablet_manager.cc:1916] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:01.941627 716 leader_election.cc:343] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: d6d25b9220bc414b88a0cf3991f9ec5c
W20260617 07:53:01.941898 852 leader_election.cc:343] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: fedebf6da6364fd093fc13ce54beee8c
I20260617 07:53:01.942039 852 leader_election.cc:304] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:01.942468 852 raft_consensus.cc:2686] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 07:53:01.944692 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d25b9220bc414b88a0cf3991f9ec5c" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:01.945449 713 leader_election.cc:343] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:01.945580 713 leader_election.cc:304] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:01.945946 760 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.946038 1229 raft_consensus.cc:2749] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:01.947114 1172 tablet_bootstrap.cc:492] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:01.947278 1172 ts_tablet_manager.cc:1403] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.227s user 0.003s sys 0.000s
I20260617 07:53:01.948210 1172 raft_consensus.cc:359] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.948415 1172 raft_consensus.cc:385] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.948732 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ab29952346b44e68d58e5ee85754f4f with delete_type TABLET_DATA_DELETED (replaced by tablet b14f9f70461e49ccb4d318eab824a3e1) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.948772 1172 raft_consensus.cc:740] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.949083 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet c3a29aeb0a224cabb642f4100c44b8f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.949179 1172 consensus_queue.cc:260] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.949359 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.948551 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a (DEFAULT_TABLE table=default.Table_4537eb32b59649669393ab9cad5c44a6 [id=f7bea6866b9845f1a116293b182de7bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.949849 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074a3e08cc9a4be891016ce197a993be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.950098 1172 ts_tablet_manager.cc:1434] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260617 07:53:01.950426 1172 tablet_bootstrap.cc:492] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:01.951179 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69996eb4ab6e40f9b2d97e00d766822a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.952437 1172 tablet_bootstrap.cc:654] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.911478 1273 consensus_queue.cc:237] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.958544 1175 ts_tablet_manager.cc:1929] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:01.958719 1175 log.cc:1199] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/e8f7c36eac304694a96dcc41e2b1ea66
I20260617 07:53:01.959218 1175 ts_tablet_manager.cc:1950] T e8f7c36eac304694a96dcc41e2b1ea66 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:01.963328 753 tablet_service.cc:1511] Processing CreateTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a (DEFAULT_TABLE table=default.Table_4537eb32b59649669393ab9cad5c44a6 [id=f7bea6866b9845f1a116293b182de7bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.963758 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69996eb4ab6e40f9b2d97e00d766822a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.965946 1172 tablet_bootstrap.cc:492] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:01.966125 1172 ts_tablet_manager.cc:1403] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
I20260617 07:53:01.966341 1178 tablet_bootstrap.cc:492] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:01.966477 1178 ts_tablet_manager.cc:1403] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260617 07:53:01.966961 1172 raft_consensus.cc:359] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.967152 1172 raft_consensus.cc:385] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.967242 1172 raft_consensus.cc:740] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.967906 1172 consensus_queue.cc:260] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.969043 1172 ts_tablet_manager.cc:1434] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:01.969122 891 tablet_service.cc:1511] Processing CreateTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 (DEFAULT_TABLE table=default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35 [id=0552acfce4294af484ccd1f88c42c4cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.967213 1178 raft_consensus.cc:359] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.969528 760 tablet_service.cc:1511] Processing CreateTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 (DEFAULT_TABLE table=default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35 [id=0552acfce4294af484ccd1f88c42c4cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.969637 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f67a6c1dcf4a69842452c371a9c078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.969938 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f67a6c1dcf4a69842452c371a9c078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.971750 1172 tablet_bootstrap.cc:492] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:01.975912 1172 tablet_bootstrap.cc:654] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.976694 1178 raft_consensus.cc:385] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.977101 1178 raft_consensus.cc:740] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.977380 1178 consensus_queue.cc:260] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:01.979877 1178 ts_tablet_manager.cc:1434] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260617 07:53:01.980084 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 (DEFAULT_TABLE table=default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35 [id=0552acfce4294af484ccd1f88c42c4cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.980481 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f67a6c1dcf4a69842452c371a9c078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.981563 1169 ts_tablet_manager.cc:1929] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:01.981703 1169 log.cc:1199] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/fedebf6da6364fd093fc13ce54beee8c
I20260617 07:53:01.982066 1169 ts_tablet_manager.cc:1950] T fedebf6da6364fd093fc13ce54beee8c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:01.983105 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet fedebf6da6364fd093fc13ce54beee8c (table default.Table_b5ea244188ba423a926d78f48e818554 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]) successfully deleted
W20260617 07:53:01.985667 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c3a29aeb0a224cabb642f4100c44b8f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3a29aeb0a224cabb642f4100c44b8f3 already in progress: creating tablet
W20260617 07:53:01.986454 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 already in progress: creating tablet
I20260617 07:53:01.987061 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 19f8525046964950884b0f9aa515ec81 (DEFAULT_TABLE table=default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:01.987498 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f8525046964950884b0f9aa515ec81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:01.988125 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a460aee4eb514a87b272c4fc858335e7
I20260617 07:53:01.988726 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 52e9dc5fcd034eaab7a5548bccebd134 from {username='slave'} at 127.0.0.1:42828
W20260617 07:53:01.990134 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ecf80e090494539ae3d20448f8d1126 consensus state has no leader
I20260617 07:53:01.990182 1178 tablet_bootstrap.cc:492] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:01.990455 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 2a2ee285802f47b98c152daad8cfd9d7 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:01.991007 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_18022f62726247619f7b826a278aa15a" } new_table_name: "default.Table_31ff404d1549430d86af35a09cf62ec5" modify_external_catalogs: true
I20260617 07:53:01.991827 1178 tablet_bootstrap.cc:654] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:01.992619 1172 tablet_bootstrap.cc:492] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
W20260617 07:53:01.992611 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69996eb4ab6e40f9b2d97e00d766822a consensus state has no leader
I20260617 07:53:01.992792 1172 ts_tablet_manager.cc:1403] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20260617 07:53:01.993476 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 5b99b80966c94937baf7172b0c36af2a
I20260617 07:53:01.993568 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet a460aee4eb514a87b272c4fc858335e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:01.993868 1172 raft_consensus.cc:359] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.994000 528 catalog_manager.cc:6784] ReplaceTablet: tablet 5b99b80966c94937baf7172b0c36af2a deleted and replaced by tablet 82d682ae37d74b4b967da0f8e2de6301
I20260617 07:53:01.994045 1172 raft_consensus.cc:385] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:01.994134 1172 raft_consensus.cc:740] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:01.994381 1172 consensus_queue.cc:260] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:01.994779 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b99b80966c94937baf7172b0c36af2a with delete_type TABLET_DATA_DELETED (replaced by tablet 82d682ae37d74b4b967da0f8e2de6301) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:01.994786 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b99b80966c94937baf7172b0c36af2a with delete_type TABLET_DATA_DELETED (replaced by tablet 82d682ae37d74b4b967da0f8e2de6301) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:01.995186 1172 ts_tablet_manager.cc:1434] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260617 07:53:01.995525 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c3a29aeb0a224cabb642f4100c44b8f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3a29aeb0a224cabb642f4100c44b8f3 already in progress: creating tablet
W20260617 07:53:01.996538 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5b99b80966c94937baf7172b0c36af2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b99b80966c94937baf7172b0c36af2a already in progress: creating tablet
W20260617 07:53:01.996541 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 already in progress: creating tablet
W20260617 07:53:01.997125 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5b99b80966c94937baf7172b0c36af2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b99b80966c94937baf7172b0c36af2a already in progress: creating tablet
I20260617 07:53:01.997821 1172 tablet_bootstrap.cc:492] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:02.003261 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 006b71a3287240a5b15bfd489f514f4c consensus state has no leader
W20260617 07:53:02.004443 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b14f9f70461e49ccb4d318eab824a3e1 consensus state has no leader
I20260617 07:53:02.005797 1178 tablet_bootstrap.cc:492] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.005875 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b99b80966c94937baf7172b0c36af2a with delete_type TABLET_DATA_DELETED (replaced by tablet 82d682ae37d74b4b967da0f8e2de6301) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.005971 1178 ts_tablet_manager.cc:1403] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.001s
I20260617 07:53:02.006739 1178 raft_consensus.cc:359] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.006937 1178 raft_consensus.cc:385] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.007005 1178 raft_consensus.cc:740] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.009295 532 master_service.cc:960] ReplaceTablet: received request to replace tablet e364eed959174ef2a8fbbe7bb2215fa1 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.009565 1178 consensus_queue.cc:260] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.010051 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_94149217b8fd42f3a46ed6df137e9f82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.010447 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a460aee4eb514a87b272c4fc858335e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:02.011296 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a460aee4eb514a87b272c4fc858335e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a460aee4eb514a87b272c4fc858335e7 already in progress: creating tablet
I20260617 07:53:02.011919 1178 ts_tablet_manager.cc:1434] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 07:53:02.012174 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a460aee4eb514a87b272c4fc858335e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.010977 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5d4c38bce4ba4d0dbc2af4af682bee57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.012816 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d4c38bce4ba4d0dbc2af4af682bee57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:02.013053 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a460aee4eb514a87b272c4fc858335e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a460aee4eb514a87b272c4fc858335e7 already in progress: creating tablet
W20260617 07:53:02.011778 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94149217b8fd42f3a46ed6df137e9f82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:02.014216 1052 raft_consensus.cc:1579] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Could not prepare op 'term: 1 index: 2' and following 0 ops. Status for this op: Illegal state: STOPPING
I20260617 07:53:02.015364 1270 tablet.cc:1724] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:02.018260 891 tablet_service.cc:1511] Processing CreateTablet for tablet 19f8525046964950884b0f9aa515ec81 (DEFAULT_TABLE table=default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.018364 1170 raft_consensus.cc:2243] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.018818 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f8525046964950884b0f9aa515ec81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.019317 1170 pending_rounds.cc:70] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:02.019506 1170 pending_rounds.cc:77] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772671623823360 op_type: NO_OP noop_request { }
I20260617 07:53:02.019620 1170 raft_consensus.cc:2889] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:02.019754 1170 raft_consensus.cc:2272] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.021054 1178 tablet_bootstrap.cc:492] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:02.021303 523 catalog_manager.cc:5696] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:02.022330 523 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]). Expected version 1 got 0
I20260617 07:53:02.023684 1170 ts_tablet_manager.cc:1916] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.023692 1178 tablet_bootstrap.cc:654] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.025302 1172 tablet_bootstrap.cc:654] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.026919 532 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_da1e8c81e4404eecb5c17d208ae890d2 [id=b917e24e4cee4805b575b97ac7068195]). Expected version 3 got 0
I20260617 07:53:02.029265 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 966145c57a434dc68f004f93351e8ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.029553 1175 tablet_replica.cc:333] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.029798 1175 raft_consensus.cc:2243] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.029990 1175 raft_consensus.cc:2272] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.030742 1175 ts_tablet_manager.cc:1916] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.031406 1170 ts_tablet_manager.cc:1929] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:02.031596 1170 log.cc:1199] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/e8f7c36eac304694a96dcc41e2b1ea66
I20260617 07:53:02.032205 1170 ts_tablet_manager.cc:1950] T e8f7c36eac304694a96dcc41e2b1ea66 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:02.033423 1170 tablet_replica.cc:333] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:02.033682 1170 raft_consensus.cc:2243] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.034042 758 tablet_service.cc:1511] Processing CreateTablet for tablet 19f8525046964950884b0f9aa515ec81 (DEFAULT_TABLE table=default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.034507 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f8525046964950884b0f9aa515ec81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.034969 1170 raft_consensus.cc:2272] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.035593 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_06a54fcfd98445bbafab5f9750da86ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.035866 1170 ts_tablet_manager.cc:1916] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:02.036265 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06a54fcfd98445bbafab5f9750da86ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.037904 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c (DEFAULT_TABLE table=default.Table_456aace94223474f82d1801ec38d7b43 [id=cbd872cee78b4535b90941504bafc133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.038290 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa23bb0929440b1820afdce4b9e8d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.039846 1172 tablet_bootstrap.cc:492] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.040014 1172 ts_tablet_manager.cc:1403] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.002s
W20260617 07:53:02.040726 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a882ae04eeb94276bb78ded81fbea708 has no consensus state
I20260617 07:53:02.040974 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 52e9dc5fcd034eaab7a5548bccebd134
I20260617 07:53:02.041437 527 catalog_manager.cc:6784] ReplaceTablet: tablet 52e9dc5fcd034eaab7a5548bccebd134 deleted and replaced by tablet 4996cde4d1514aa081257c802339abe6
I20260617 07:53:02.042553 1172 raft_consensus.cc:359] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.042761 1172 raft_consensus.cc:385] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.042843 1172 raft_consensus.cc:740] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.043079 1172 consensus_queue.cc:260] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.043318 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e9dc5fcd034eaab7a5548bccebd134 with delete_type TABLET_DATA_DELETED (replaced by tablet 4996cde4d1514aa081257c802339abe6) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.043503 1170 ts_tablet_manager.cc:1929] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.043628 1170 log.cc:1199] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/9ab29952346b44e68d58e5ee85754f4f
I20260617 07:53:02.043879 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a8df3210685244ae8a9b7c9190d619a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.044003 1170 ts_tablet_manager.cc:1950] T 9ab29952346b44e68d58e5ee85754f4f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:02.045336 1172 ts_tablet_manager.cc:1434] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260617 07:53:02.046413 1172 tablet_bootstrap.cc:492] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.048079 1172 tablet_bootstrap.cc:654] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.048823 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d25b9220bc414b88a0cf3991f9ec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.050246 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e9dc5fcd034eaab7a5548bccebd134 with delete_type TABLET_DATA_DELETED (replaced by tablet 4996cde4d1514aa081257c802339abe6) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:02.051201 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet a31fba373a214b5a96bd11b930ed3b86 (table default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a31fba373a214b5a96bd11b930ed3b86 consensus state has no leader
W20260617 07:53:02.052263 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 52e9dc5fcd034eaab7a5548bccebd134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e9dc5fcd034eaab7a5548bccebd134 already in progress: creating tablet
I20260617 07:53:02.054814 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet fedebf6da6364fd093fc13ce54beee8c with delete_type TABLET_DATA_DELETED (replaced by tablet 8ac72fef1251446cbd3975d98fa2f4ae) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.055162 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cee843694bd4f268347e7fc8673816e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.055346 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e9dc5fcd034eaab7a5548bccebd134 with delete_type TABLET_DATA_DELETED (replaced by tablet 4996cde4d1514aa081257c802339abe6) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.055383 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 966145c57a434dc68f004f93351e8ce5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.055179 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet d3fdc22bf2f24d028393401ae78bf7fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.055559 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f7c36eac304694a96dcc41e2b1ea66 with delete_type TABLET_DATA_DELETED (replaced by tablet f1f2c87bd54249c282bb2b0213fd54ac) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.057174 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c (DEFAULT_TABLE table=default.Table_456aace94223474f82d1801ec38d7b43 [id=cbd872cee78b4535b90941504bafc133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.057631 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa23bb0929440b1820afdce4b9e8d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.061172 1175 ts_tablet_manager.cc:1929] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.061305 1175 log.cc:1199] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/966145c57a434dc68f004f93351e8ce5
I20260617 07:53:02.064308 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 9ab29952346b44e68d58e5ee85754f4f (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]) successfully deleted
I20260617 07:53:02.065230 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c (DEFAULT_TABLE table=default.Table_456aace94223474f82d1801ec38d7b43 [id=cbd872cee78b4535b90941504bafc133]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:02.065400 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c3a29aeb0a224cabb642f4100c44b8f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3a29aeb0a224cabb642f4100c44b8f3 already in progress: creating tablet
I20260617 07:53:02.065932 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa23bb0929440b1820afdce4b9e8d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.061676 1175 ts_tablet_manager.cc:1950] T 966145c57a434dc68f004f93351e8ce5 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.064610 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f92d26dd0d746a18f88058379ac7b83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:02.068372 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 already in progress: creating tablet
W20260617 07:53:02.068773 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a460aee4eb514a87b272c4fc858335e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a460aee4eb514a87b272c4fc858335e7 already in progress: creating tablet
W20260617 07:53:02.068992 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5b99b80966c94937baf7172b0c36af2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b99b80966c94937baf7172b0c36af2a already in progress: creating tablet
I20260617 07:53:02.069042 1170 tablet_replica.cc:333] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:02.069223 1170 raft_consensus.cc:2243] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.069437 1170 raft_consensus.cc:2272] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.072588 1170 ts_tablet_manager.cc:1916] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.072862 779 raft_consensus.cc:1275] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Refusing update from remote peer dc3bec007846459a9da0c7b8211e477b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:02.072996 917 raft_consensus.cc:1275] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Refusing update from remote peer dc3bec007846459a9da0c7b8211e477b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:02.073475 1272 consensus_queue.cc:1048] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:02.073689 1273 consensus_queue.cc:1048] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:02.078776 1170 ts_tablet_manager.cc:1929] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.078908 1170 log.cc:1199] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/fedebf6da6364fd093fc13ce54beee8c
I20260617 07:53:02.079282 1170 ts_tablet_manager.cc:1950] T fedebf6da6364fd093fc13ce54beee8c P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:02.080299 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet fedebf6da6364fd093fc13ce54beee8c (table default.Table_b5ea244188ba423a926d78f48e818554 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]) successfully deleted
I20260617 07:53:02.085500 1170 tablet_replica.cc:333] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:02.085819 1170 raft_consensus.cc:2243] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.086113 1170 raft_consensus.cc:2272] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.089052 1170 ts_tablet_manager.cc:1916] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.089273 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 966145c57a434dc68f004f93351e8ce5 (table default.Table_82181faa1432405cb6318acfa88304a3 [id=fc01741386744b208a3d0acaa963091b]) successfully deleted
I20260617 07:53:02.089593 1171 tablet_bootstrap.cc:492] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.090517 1270 tablet.cc:1724] T f6fdc168bd4a4eaca86b24a986b4eb7d P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260617 07:53:02.091039 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 52e9dc5fcd034eaab7a5548bccebd134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e9dc5fcd034eaab7a5548bccebd134 already in progress: creating tablet
I20260617 07:53:02.091195 1171 ts_tablet_manager.cc:1403] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.332s user 0.055s sys 0.062s
I20260617 07:53:02.091997 1175 tablet_replica.cc:333] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.092213 1175 raft_consensus.cc:2243] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.092103 1171 raft_consensus.cc:359] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.092312 1171 raft_consensus.cc:385] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.092381 1175 raft_consensus.cc:2272] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.092418 1171 raft_consensus.cc:740] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.096484 1172 tablet_bootstrap.cc:492] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.095579 1171 consensus_queue.cc:260] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.096935 1172 ts_tablet_manager.cc:1403] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.009s
I20260617 07:53:02.098539 1171 ts_tablet_manager.cc:1434] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 07:53:02.099493 1172 raft_consensus.cc:359] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.101063 1171 tablet_bootstrap.cc:492] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.103433 1171 tablet_bootstrap.cc:654] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.104086 532 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]). Expected version 1 got 0
I20260617 07:53:02.100098 1170 ts_tablet_manager.cc:1929] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.105929 1172 raft_consensus.cc:385] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.106052 1172 raft_consensus.cc:740] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.106175 1170 log.cc:1199] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/3cee843694bd4f268347e7fc8673816e
I20260617 07:53:02.106611 1170 ts_tablet_manager.cc:1950] T 3cee843694bd4f268347e7fc8673816e P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:02.106819 1172 consensus_queue.cc:260] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.107990 1170 tablet_replica.cc:333] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:02.107944 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 3cee843694bd4f268347e7fc8673816e (table default.Table_49587b2e81f148a4a250f39749e158d3 [id=e4cac3bc7e8e4142b8168b04644a5194]) successfully deleted
I20260617 07:53:02.108248 1170 raft_consensus.cc:2243] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.108511 1170 raft_consensus.cc:2272] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.110031 1170 ts_tablet_manager.cc:1916] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.110373 525 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]). Expected version 1 got 0
I20260617 07:53:02.111929 1263 tablet.cc:1724] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:02.112596 1284 mvcc.cc:204] Tried to move back new op lower bound from 7297772675363139584 to 7297772674912579584. Current Snapshot: MvccSnapshot[applied={T|T < 7297772675363139584}]
I20260617 07:53:02.113101 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet bb96aca7a8ee486e9d05290e53b95bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.121047 524 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]). Expected version 1 got 0
I20260617 07:53:02.122485 1172 ts_tablet_manager.cc:1434] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260617 07:53:02.122434 525 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]). Expected version 1 got 0
I20260617 07:53:02.122872 1172 tablet_bootstrap.cc:492] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.108788 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f92d26dd0d746a18f88058379ac7b83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.124292 1175 ts_tablet_manager.cc:1916] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.117925 1261 tablet.cc:1724] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:02.124835 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_540131f07d9249ec80a4db3900a4ed2d" } modify_external_catalogs: true
I20260617 07:53:02.125016 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_540131f07d9249ec80a4db3900a4ed2d" } modify_external_catalogs: true
I20260617 07:53:02.125147 1169 tablet_replica.cc:333] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.125347 1169 raft_consensus.cc:2243] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.125559 1169 raft_consensus.cc:2272] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.126462 1169 ts_tablet_manager.cc:1916] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.128736 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_c651ebd3c3eb4bc8a82dea4cf194f571"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.128674 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_37dfd90d2dcb4616afb087ae9ebfa366"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.129277 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37dfd90d2dcb4616afb087ae9ebfa366 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.130503 1172 tablet_bootstrap.cc:654] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.131217 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5fcf50bba845478aa1765c2ac162b1c1" } modify_external_catalogs: true
I20260617 07:53:02.131393 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5fcf50bba845478aa1765c2ac162b1c1" } modify_external_catalogs: true
W20260617 07:53:02.129277 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c651ebd3c3eb4bc8a82dea4cf194f571 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.134804 1178 tablet_bootstrap.cc:492] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.134330 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_9ab80d1558c249ce97356577215e7ab1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.134958 1178 ts_tablet_manager.cc:1403] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.114s user 0.006s sys 0.000s
W20260617 07:53:02.135331 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ab80d1558c249ce97356577215e7ab1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.136881 1178 raft_consensus.cc:359] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.136946 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_860af7cb625c496bb781b7c1b478d606" } modify_external_catalogs: true
I20260617 07:53:02.137066 1178 raft_consensus.cc:385] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.137012 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_70aa9f32556b4036ae770c6cb7a2c9e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.137109 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_860af7cb625c496bb781b7c1b478d606" } modify_external_catalogs: true
I20260617 07:53:02.137143 1178 raft_consensus.cc:740] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.137406 1178 consensus_queue.cc:260] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:02.137534 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70aa9f32556b4036ae770c6cb7a2c9e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.138860 1178 ts_tablet_manager.cc:1434] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260617 07:53:02.138931 1170 ts_tablet_manager.cc:1929] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.139045 1170 log.cc:1199] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/966145c57a434dc68f004f93351e8ce5
I20260617 07:53:02.139165 1178 tablet_bootstrap.cc:492] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:02.139407 1170 ts_tablet_manager.cc:1950] T 966145c57a434dc68f004f93351e8ce5 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:02.141492 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 966145c57a434dc68f004f93351e8ce5 (table default.Table_82181faa1432405cb6318acfa88304a3 [id=fc01741386744b208a3d0acaa963091b]) successfully deleted
I20260617 07:53:02.141826 1170 tablet_replica.cc:333] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:02.142005 1170 raft_consensus.cc:2243] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.142340 1178 tablet_bootstrap.cc:654] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.142549 1170 raft_consensus.cc:2272] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.144384 1175 ts_tablet_manager.cc:1929] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.144665 1175 log.cc:1199] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a8df3210685244ae8a9b7c9190d619a0
I20260617 07:53:02.145027 1175 ts_tablet_manager.cc:1950] T a8df3210685244ae8a9b7c9190d619a0 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.146052 1175 tablet_replica.cc:333] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.146222 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a8df3210685244ae8a9b7c9190d619a0 (table default.Table_f25afebccc084eb994072fd8ed9f99a6 [id=eac07ff3978e43898764f4ee3bf70397]) successfully deleted
I20260617 07:53:02.146358 1175 raft_consensus.cc:2243] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.146600 1175 raft_consensus.cc:2272] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.147512 1171 tablet_bootstrap.cc:492] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.147697 1171 ts_tablet_manager.cc:1403] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.002s
I20260617 07:53:02.148880 532 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f] alter complete (version 1)
I20260617 07:53:02.148947 1171 raft_consensus.cc:359] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.149137 1171 raft_consensus.cc:385] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.149238 1171 raft_consensus.cc:740] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.149339 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35" } modify_external_catalogs: true
I20260617 07:53:02.149507 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35" } modify_external_catalogs: true
I20260617 07:53:02.149471 1171 consensus_queue.cc:260] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.150882 1171 ts_tablet_manager.cc:1434] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:02.151175 1171 tablet_bootstrap.cc:492] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.155014 1171 tablet_bootstrap.cc:654] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.155764 1169 ts_tablet_manager.cc:1929] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.155884 1169 log.cc:1199] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5f92d26dd0d746a18f88058379ac7b83
I20260617 07:53:02.156375 1169 ts_tablet_manager.cc:1950] T 5f92d26dd0d746a18f88058379ac7b83 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.157536 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a8df3210685244ae8a9b7c9190d619a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.157574 1170 ts_tablet_manager.cc:1916] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.154193 1270 tablet.cc:1724] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:02.162518 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5f92d26dd0d746a18f88058379ac7b83 (table default.Table_e93f77eefbea46a6ac71a5b27dc0e63d [id=0e160fc0302048c2aaba651b3e67beb4]) successfully deleted
I20260617 07:53:02.162904 1169 tablet_replica.cc:333] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.167111 1175 ts_tablet_manager.cc:1916] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.173789 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 7582d201bc5843949d4be08ee7586f9d
I20260617 07:53:02.174844 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.175354 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 787467c65f68442aad071df16d4492f3
I20260617 07:53:02.176687 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 787467c65f68442aad071df16d4492f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.184665 685 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 7582d201bc5843949d4be08ee7586f9d
I20260617 07:53:02.185460 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.175091 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.176616 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 787467c65f68442aad071df16d4492f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.185479 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.186134 1169 raft_consensus.cc:2243] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.186730 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.187669 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a5b7b95327604ef8b43944c4821d4ed7
I20260617 07:53:02.187882 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 787467c65f68442aad071df16d4492f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.188161 1172 tablet_bootstrap.cc:492] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.188328 1172 ts_tablet_manager.cc:1403] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.009s
I20260617 07:53:02.189168 1172 raft_consensus.cc:359] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.189353 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet a5b7b95327604ef8b43944c4821d4ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.189392 1172 raft_consensus.cc:385] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.189460 1172 raft_consensus.cc:740] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.190346 753 tablet_service.cc:1558] Processing DeleteTablet for tablet a5b7b95327604ef8b43944c4821d4ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.192926 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 80f67a6c1dcf4a69842452c371a9c078
I20260617 07:53:02.194186 1172 consensus_queue.cc:260] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.194375 1175 ts_tablet_manager.cc:1929] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.194530 1175 log.cc:1199] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d6d25b9220bc414b88a0cf3991f9ec5c
I20260617 07:53:02.194700 1172 ts_tablet_manager.cc:1434] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:02.194980 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9453aea1d6914fcaa82124a775199814" } new_table_name: "default.Table_54be22b2fb3540f292a5ffa5ab372d0a" modify_external_catalogs: true
I20260617 07:53:02.195103 1172 tablet_bootstrap.cc:492] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.196309 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_80c7d1700afc48cfac169bb161d8597f" } modify_external_catalogs: true
I20260617 07:53:02.196486 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_80c7d1700afc48cfac169bb161d8597f" } modify_external_catalogs: true
I20260617 07:53:02.197479 1175 ts_tablet_manager.cc:1950] T d6d25b9220bc414b88a0cf3991f9ec5c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.198437 1175 tablet_replica.cc:333] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.199002 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 0435c4596b2d466c92d89ed41f132ea0 with delete_type TABLET_DATA_DELETED (replaced by tablet 80f67a6c1dcf4a69842452c371a9c078) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.198630 1175 raft_consensus.cc:2243] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.199455 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.200420 1172 tablet_bootstrap.cc:654] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.202066 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5b5a4062a59c4b3f811cc1d4441fd030"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.202593 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b5a4062a59c4b3f811cc1d4441fd030 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.202900 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d6d25b9220bc414b88a0cf3991f9ec5c (table default.Table_2b271e2563664a57a954aa99a29e38ce [id=bfc8d977c5b4448cb8fb2a9cabe10281]) successfully deleted
I20260617 07:53:02.201418 1175 raft_consensus.cc:2272] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.204131 1175 ts_tablet_manager.cc:1916] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.211009 526 master_service.cc:960] ReplaceTablet: received request to replace tablet c9c156733805461ca185f7797525392f from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.211329 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_17f44c6c535445ed85c8e6f67a88d5c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.211740 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_cd29e626941b41bfbd49bec00d3a7315"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.211952 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17f44c6c535445ed85c8e6f67a88d5c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:02.212227 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd29e626941b41bfbd49bec00d3a7315 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.213295 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_73499470b1494807ba75ea3917853761" } new_table_name: "default.Table_5062aff937d2497d8947cb2c4f1c87bb" modify_external_catalogs: true
I20260617 07:53:02.213896 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f7b44d219962403696014ced4ea87a19" } new_table_name: "default.Table_a041e570964040bfbc2958f16c222993" modify_external_catalogs: true
I20260617 07:53:02.214087 525 master_service.cc:960] ReplaceTablet: received request to replace tablet e364eed959174ef2a8fbbe7bb2215fa1 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.214721 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_7f7ca184d1ad499cb287399684677763" } new_table_name: "default.Table_6f686d428f8c4d9bacafed83c2a72029" modify_external_catalogs: true
I20260617 07:53:02.215449 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.215698 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d25b9220bc414b88a0cf3991f9ec5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.215888 1175 ts_tablet_manager.cc:1929] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.216073 1175 log.cc:1199] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/5f92d26dd0d746a18f88058379ac7b83
I20260617 07:53:02.216509 1175 ts_tablet_manager.cc:1950] T 5f92d26dd0d746a18f88058379ac7b83 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.217662 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 5f92d26dd0d746a18f88058379ac7b83 (table default.Table_e93f77eefbea46a6ac71a5b27dc0e63d [id=0e160fc0302048c2aaba651b3e67beb4]) successfully deleted
I20260617 07:53:02.218143 1175 tablet_replica.cc:333] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:02.218360 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7582d201bc5843949d4be08ee7586f9d because the tablet was not found. No further retry: Not found: Tablet not found: 7582d201bc5843949d4be08ee7586f9d
W20260617 07:53:02.218587 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 787467c65f68442aad071df16d4492f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 787467c65f68442aad071df16d4492f3 already in progress: creating tablet
W20260617 07:53:02.218776 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7582d201bc5843949d4be08ee7586f9d because the tablet was not found. No further retry: Not found: Tablet not found: 7582d201bc5843949d4be08ee7586f9d
W20260617 07:53:02.218971 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a5b7b95327604ef8b43944c4821d4ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5b7b95327604ef8b43944c4821d4ed7 already in progress: creating tablet
I20260617 07:53:02.218338 1175 raft_consensus.cc:2243] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.220649 1175 raft_consensus.cc:2272] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.221271 1175 ts_tablet_manager.cc:1916] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.188781 898 tablet_service.cc:1558] Processing DeleteTablet for tablet a5b7b95327604ef8b43944c4821d4ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.192412 1171 tablet_bootstrap.cc:492] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.199272 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.221582 1171 ts_tablet_manager.cc:1403] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.070s user 0.020s sys 0.007s
W20260617 07:53:02.222101 1228 raft_consensus.cc:670] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260617 07:53:02.222431 1171 raft_consensus.cc:359] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.222595 1171 raft_consensus.cc:385] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.222676 1171 raft_consensus.cc:740] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.222961 1169 raft_consensus.cc:2272] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.222908 1171 consensus_queue.cc:260] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.224781 1171 ts_tablet_manager.cc:1434] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:02.225098 1171 tablet_bootstrap.cc:492] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.228762 1171 tablet_bootstrap.cc:654] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.237249 1175 ts_tablet_manager.cc:1929] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.237390 1175 log.cc:1199] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/0435c4596b2d466c92d89ed41f132ea0
I20260617 07:53:02.237566 1169 ts_tablet_manager.cc:1916] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.237754 1175 ts_tablet_manager.cc:1950] T 0435c4596b2d466c92d89ed41f132ea0 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.238732 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 0435c4596b2d466c92d89ed41f132ea0 (table default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35 [id=0552acfce4294af484ccd1f88c42c4cb]) successfully deleted
W20260617 07:53:02.239703 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 80f67a6c1dcf4a69842452c371a9c078 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80f67a6c1dcf4a69842452c371a9c078 already in progress: creating tablet
W20260617 07:53:02.241161 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0dc0676db18c42259efb1ad7dbd140c8 consensus state has no leader
I20260617 07:53:02.242683 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 0435c4596b2d466c92d89ed41f132ea0 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.242944 1171 tablet_bootstrap.cc:492] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.243119 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 89d0b4bcb35c42fd8cd2844cd018b634 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.243598 1171 ts_tablet_manager.cc:1403] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.000s
I20260617 07:53:02.244946 1171 raft_consensus.cc:359] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.245193 1171 raft_consensus.cc:385] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.245283 1171 raft_consensus.cc:740] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.245390 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f with delete_type TABLET_DATA_DELETED (replaced by tablet a31fba373a214b5a96bd11b930ed3b86) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.245610 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 0500ee0a225c43ebb75a69f9b44ef0dd
I20260617 07:53:02.245577 1171 consensus_queue.cc:260] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.246069 1171 ts_tablet_manager.cc:1434] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:02.246306 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_ef07d99bfb1e43dc8d81cfe46a4b4be0" } new_table_name: "default.Table_222b195724fd4c0a86c636969ca9d0f0" modify_external_catalogs: true
I20260617 07:53:02.248209 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0500ee0a225c43ebb75a69f9b44ef0dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.248911 1175 tablet_replica.cc:333] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.249311 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 0500ee0a225c43ebb75a69f9b44ef0dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.249173 1175 raft_consensus.cc:2243] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.249759 1175 raft_consensus.cc:2272] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.250319 1171 tablet_bootstrap.cc:492] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.251230 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 0500ee0a225c43ebb75a69f9b44ef0dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.251598 1175 ts_tablet_manager.cc:1916] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.252445 1171 tablet_bootstrap.cc:654] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.253489 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e9dc5fcd034eaab7a5548bccebd134 with delete_type TABLET_DATA_DELETED (replaced by tablet 4996cde4d1514aa081257c802339abe6) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.255553 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a4b93563d9e4465ca378f7ec12a81250"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.256160 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4b93563d9e4465ca378f7ec12a81250 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.256223 1169 ts_tablet_manager.cc:1929] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.257225 1169 log.cc:1199] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a8df3210685244ae8a9b7c9190d619a0
I20260617 07:53:02.257398 1172 tablet_bootstrap.cc:492] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.257567 1172 ts_tablet_manager.cc:1403] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.002s
I20260617 07:53:02.258157 1169 ts_tablet_manager.cc:1950] T a8df3210685244ae8a9b7c9190d619a0 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.258425 1172 raft_consensus.cc:359] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.258648 1172 raft_consensus.cc:385] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.258757 1172 raft_consensus.cc:740] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.259027 1172 consensus_queue.cc:260] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.259781 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a8df3210685244ae8a9b7c9190d619a0 (table default.Table_f25afebccc084eb994072fd8ed9f99a6 [id=eac07ff3978e43898764f4ee3bf70397]) successfully deleted
W20260617 07:53:02.260190 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7582d201bc5843949d4be08ee7586f9d because the tablet was not found. No further retry: Not found: Tablet not found: 7582d201bc5843949d4be08ee7586f9d
W20260617 07:53:02.260748 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 787467c65f68442aad071df16d4492f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 787467c65f68442aad071df16d4492f3 already in progress: creating tablet
I20260617 07:53:02.261303 1172 ts_tablet_manager.cc:1434] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260617 07:53:02.261453 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7582d201bc5843949d4be08ee7586f9d because the tablet was not found. No further retry: Not found: Tablet not found: 7582d201bc5843949d4be08ee7586f9d
W20260617 07:53:02.261927 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a5b7b95327604ef8b43944c4821d4ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5b7b95327604ef8b43944c4821d4ed7 already in progress: creating tablet
W20260617 07:53:02.262440 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 80f67a6c1dcf4a69842452c371a9c078 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80f67a6c1dcf4a69842452c371a9c078 already in progress: creating tablet
I20260617 07:53:02.262681 1169 tablet_replica.cc:333] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.263123 1169 raft_consensus.cc:2243] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.263605 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.264863 1171 tablet_bootstrap.cc:492] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.264952 892 tablet_service.cc:1511] Processing CreateTablet for tablet ddd63aa802164f25aca72bea45ea3b96 (DEFAULT_TABLE table=default.Table_06a54fcfd98445bbafab5f9750da86ea [id=5a4c1e6d9cd541089b5e273664d73be9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.265071 1169 raft_consensus.cc:2272] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.265038 1171 ts_tablet_manager.cc:1403] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.007s
I20260617 07:53:02.265401 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd63aa802164f25aca72bea45ea3b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.266803 1171 raft_consensus.cc:359] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.266994 1171 raft_consensus.cc:385] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.267084 1171 raft_consensus.cc:740] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.267267 753 tablet_service.cc:1511] Processing CreateTablet for tablet ddd63aa802164f25aca72bea45ea3b96 (DEFAULT_TABLE table=default.Table_06a54fcfd98445bbafab5f9750da86ea [id=5a4c1e6d9cd541089b5e273664d73be9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.267361 1171 consensus_queue.cc:260] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.267671 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd63aa802164f25aca72bea45ea3b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.268251 1169 ts_tablet_manager.cc:1916] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.271776 1171 ts_tablet_manager.cc:1434] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260617 07:53:02.274307 1172 tablet_bootstrap.cc:492] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.274814 1171 tablet_bootstrap.cc:492] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.276072 1026 tablet_service.cc:1511] Processing CreateTablet for tablet ddd63aa802164f25aca72bea45ea3b96 (DEFAULT_TABLE table=default.Table_06a54fcfd98445bbafab5f9750da86ea [id=5a4c1e6d9cd541089b5e273664d73be9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.276278 1171 tablet_bootstrap.cc:654] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.276473 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd63aa802164f25aca72bea45ea3b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.281744 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet a8df3210685244ae8a9b7c9190d619a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.282980 1169 ts_tablet_manager.cc:1929] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.286026 1172 tablet_bootstrap.cc:654] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.286127 753 tablet_service.cc:1511] Processing CreateTablet for tablet d9968c8179c14d1b9bc9a2c2779fb86e (DEFAULT_TABLE table=default.Table_5d4c38bce4ba4d0dbc2af4af682bee57 [id=ba6bd5b57bfc49f6a91b95badafdcb03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.286545 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9968c8179c14d1b9bc9a2c2779fb86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.287225 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet c9c156733805461ca185f7797525392f
I20260617 07:53:02.288193 526 catalog_manager.cc:6784] ReplaceTablet: tablet c9c156733805461ca185f7797525392f deleted and replaced by tablet 62b7746239c54ab6828299968d18628d
I20260617 07:53:02.288427 757 tablet_service.cc:1558] Processing DeleteTablet for tablet c9c156733805461ca185f7797525392f with delete_type TABLET_DATA_DELETED (replaced by tablet 62b7746239c54ab6828299968d18628d) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.288638 1175 ts_tablet_manager.cc:1929] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:02.288795 1175 log.cc:1199] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/0500ee0a225c43ebb75a69f9b44ef0dd
I20260617 07:53:02.289209 1175 ts_tablet_manager.cc:1950] T 0500ee0a225c43ebb75a69f9b44ef0dd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.289813 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet c9c156733805461ca185f7797525392f with delete_type TABLET_DATA_DELETED (replaced by tablet 62b7746239c54ab6828299968d18628d) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.276049 1170 ts_tablet_manager.cc:1929] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.290059 1170 log.cc:1199] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d3fdc22bf2f24d028393401ae78bf7fb
I20260617 07:53:02.290208 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a97317a462514e6384cb34f5fa00851f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.290390 1170 ts_tablet_manager.cc:1950] T d3fdc22bf2f24d028393401ae78bf7fb P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:02.292027 1170 tablet_replica.cc:333] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:02.292330 1170 raft_consensus.cc:2243] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.293478 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d3fdc22bf2f24d028393401ae78bf7fb (table default.Table_8b1fdc750b3c4dcca79f18783124f6c1 [id=e5970e1075234e20928126042294cc16]) successfully deleted
W20260617 07:53:02.293782 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a97317a462514e6384cb34f5fa00851f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.293392 1170 raft_consensus.cc:2272] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:02.293840 516 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e8f7c36eac304694a96dcc41e2b1ea66 because the tablet was not found. No further retry: Not found: Tablet not found: e8f7c36eac304694a96dcc41e2b1ea66
I20260617 07:53:02.293582 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_06fa0ccce8ce4cfcaccd930305faeec5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.294178 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 52e9dc5fcd034eaab7a5548bccebd134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e9dc5fcd034eaab7a5548bccebd134 already in progress: creating tablet
W20260617 07:53:02.294385 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06fa0ccce8ce4cfcaccd930305faeec5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.296087 1172 tablet_bootstrap.cc:492] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.296042 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]) successfully deleted
I20260617 07:53:02.296236 1172 ts_tablet_manager.cc:1403] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
W20260617 07:53:02.296315 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c9c156733805461ca185f7797525392f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9c156733805461ca185f7797525392f already in progress: creating tablet
I20260617 07:53:02.297058 1172 raft_consensus.cc:359] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.297362 1172 raft_consensus.cc:385] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.297487 1172 raft_consensus.cc:740] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.297849 1172 consensus_queue.cc:260] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.298501 1170 ts_tablet_manager.cc:1916] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.301084 1172 ts_tablet_manager.cc:1434] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260617 07:53:02.283629 892 tablet_service.cc:1511] Processing CreateTablet for tablet d9968c8179c14d1b9bc9a2c2779fb86e (DEFAULT_TABLE table=default.Table_5d4c38bce4ba4d0dbc2af4af682bee57 [id=ba6bd5b57bfc49f6a91b95badafdcb03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.310349 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9968c8179c14d1b9bc9a2c2779fb86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.292855 898 tablet_service.cc:1558] Processing DeleteTablet for tablet c9c156733805461ca185f7797525392f with delete_type TABLET_DATA_DELETED (replaced by tablet 62b7746239c54ab6828299968d18628d) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.318786 1026 tablet_service.cc:1511] Processing CreateTablet for tablet d9968c8179c14d1b9bc9a2c2779fb86e (DEFAULT_TABLE table=default.Table_5d4c38bce4ba4d0dbc2af4af682bee57 [id=ba6bd5b57bfc49f6a91b95badafdcb03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.319233 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9968c8179c14d1b9bc9a2c2779fb86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.319708 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7582d201bc5843949d4be08ee7586f9d (DEFAULT_TABLE table=default.Table_540131f07d9249ec80a4db3900a4ed2d [id=f0d64527dd96463a94407118831d2de2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.320001 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7582d201bc5843949d4be08ee7586f9d (DEFAULT_TABLE table=default.Table_540131f07d9249ec80a4db3900a4ed2d [id=f0d64527dd96463a94407118831d2de2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.320204 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7582d201bc5843949d4be08ee7586f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.320418 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7582d201bc5843949d4be08ee7586f9d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:02.328327 518 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260617 07:53:02.330339 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7582d201bc5843949d4be08ee7586f9d (DEFAULT_TABLE table=default.Table_540131f07d9249ec80a4db3900a4ed2d [id=f0d64527dd96463a94407118831d2de2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.330541 1178 tablet_bootstrap.cc:492] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.330731 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7582d201bc5843949d4be08ee7586f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.330843 1178 ts_tablet_manager.cc:1403] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.192s user 0.028s sys 0.034s
I20260617 07:53:02.331899 1178 raft_consensus.cc:359] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.332152 1178 raft_consensus.cc:385] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.332230 1178 raft_consensus.cc:740] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.332526 1178 consensus_queue.cc:260] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.332720 1172 tablet_bootstrap.cc:492] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.335381 1178 ts_tablet_manager.cc:1434] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:02.335636 1169 log.cc:1199] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/67a3b2a9dd8f4861b9d1f4ababf3973f
I20260617 07:53:02.336403 1172 tablet_bootstrap.cc:654] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.336989 1169 ts_tablet_manager.cc:1950] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.342865 1178 tablet_bootstrap.cc:492] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:02.343555 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 076c6f6f406842ceb3db75e886e3ce50 from {username='slave'} at 127.0.0.1:42828
W20260617 07:53:02.344770 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89d0b4bcb35c42fd8cd2844cd018b634 consensus state has no leader
I20260617 07:53:02.348693 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f with delete_type TABLET_DATA_DELETED (replaced by tablet a31fba373a214b5a96bd11b930ed3b86) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.349256 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 67a3b2a9dd8f4861b9d1f4ababf3973f (table default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23]) successfully deleted
I20260617 07:53:02.349485 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f92d26dd0d746a18f88058379ac7b83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.349834 1175 tablet_replica.cc:333] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.350086 1175 raft_consensus.cc:2243] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.350317 1175 raft_consensus.cc:2272] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.351613 1175 ts_tablet_manager.cc:1916] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.352702 757 tablet_service.cc:1511] Processing CreateTablet for tablet 5203534569bd4da18bc06751f094735f (DEFAULT_TABLE table=default.Table_c4bed0983265433fb2c278c49377729a [id=77f9a3f7e2e441b888caf756936d7ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.353163 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5203534569bd4da18bc06751f094735f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.358208 892 tablet_service.cc:1511] Processing CreateTablet for tablet 5203534569bd4da18bc06751f094735f (DEFAULT_TABLE table=default.Table_c4bed0983265433fb2c278c49377729a [id=77f9a3f7e2e441b888caf756936d7ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.358721 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e63db29973b24c64be400ecb2982e867"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.359067 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5203534569bd4da18bc06751f094735f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:02.359529 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63db29973b24c64be400ecb2982e867 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.360708 1172 tablet_bootstrap.cc:492] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.360857 1172 ts_tablet_manager.cc:1403] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.002s
I20260617 07:53:02.361215 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b183bc35a91a499e9072fb1958111c81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.361698 1172 raft_consensus.cc:359] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.361933 1172 raft_consensus.cc:385] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 07:53:02.361698 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b183bc35a91a499e9072fb1958111c81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.361967 1169 tablet_replica.cc:333] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.362021 1172 raft_consensus.cc:740] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.362234 1169 raft_consensus.cc:2243] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.362298 1172 consensus_queue.cc:260] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.362480 1169 raft_consensus.cc:2272] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.365343 1178 tablet_bootstrap.cc:654] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.366102 1172 ts_tablet_manager.cc:1434] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
W20260617 07:53:02.370949 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 875962c2e27a4ee1b9889769d53022cc consensus state has no leader
I20260617 07:53:02.372495 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 5203534569bd4da18bc06751f094735f (DEFAULT_TABLE table=default.Table_c4bed0983265433fb2c278c49377729a [id=77f9a3f7e2e441b888caf756936d7ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.372521 898 tablet_service.cc:1511] Processing CreateTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 (DEFAULT_TABLE table=default.Table_ef07d99bfb1e43dc8d81cfe46a4b4be0 [id=544e7bcc34ae49688f95e64400ce17f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.372997 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5203534569bd4da18bc06751f094735f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.373155 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01721f68e3c41f4a2ffaf05bb180761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.376207 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 89d0b4bcb35c42fd8cd2844cd018b634
W20260617 07:53:02.376518 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 262a34e120f34689ba0b598d7a2999fd consensus state has no leader
I20260617 07:53:02.376667 528 catalog_manager.cc:6784] ReplaceTablet: tablet 89d0b4bcb35c42fd8cd2844cd018b634 deleted and replaced by tablet c7e43e1a3df54efe992a86dd0bd0c149
I20260617 07:53:02.376979 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_d9199c2565854964a10bba9e6474732f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.377430 1272 raft_consensus.cc:493] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:02.377553 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9199c2565854964a10bba9e6474732f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.377592 1272 raft_consensus.cc:515] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.378350 1272 leader_election.cc:290] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:02.379356 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d0b4bcb35c42fd8cd2844cd018b634 with delete_type TABLET_DATA_DELETED (replaced by tablet c7e43e1a3df54efe992a86dd0bd0c149) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.380009 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c156733805461ca185f7797525392f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:02.380250 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d0b4bcb35c42fd8cd2844cd018b634 with delete_type TABLET_DATA_DELETED (replaced by tablet c7e43e1a3df54efe992a86dd0bd0c149) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.380271 917 raft_consensus.cc:2468] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:02.382169 988 leader_election.cc:304] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:02.376932 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5c59a8f8f2d44424bdc1f5b1d61d29a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.383270 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c59a8f8f2d44424bdc1f5b1d61d29a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.383270 1272 raft_consensus.cc:2804] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:02.383363 1272 raft_consensus.cc:493] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:02.383464 1272 raft_consensus.cc:3060] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:02.379026 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c156733805461ca185f7797525392f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:02.381469 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d0b4bcb35c42fd8cd2844cd018b634 with delete_type TABLET_DATA_DELETED (replaced by tablet c7e43e1a3df54efe992a86dd0bd0c149) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.385017 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b80fd4d4286241409493bc531eb7fef8" } modify_external_catalogs: true
W20260617 07:53:02.385064 986 leader_election.cc:343] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:02.385161 1169 ts_tablet_manager.cc:1916] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.385211 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b80fd4d4286241409493bc531eb7fef8" } modify_external_catalogs: true
I20260617 07:53:02.387418 1272 raft_consensus.cc:515] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.388523 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c156733805461ca185f7797525392f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:02.388808 917 raft_consensus.cc:3060] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:02.388847 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c156733805461ca185f7797525392f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:02.389814 986 leader_election.cc:343] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:02.389987 1272 leader_election.cc:290] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:02.373946 1172 tablet_bootstrap.cc:492] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.390875 758 tablet_service.cc:1511] Processing CreateTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 (DEFAULT_TABLE table=default.Table_ef07d99bfb1e43dc8d81cfe46a4b4be0 [id=544e7bcc34ae49688f95e64400ce17f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.391273 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01721f68e3c41f4a2ffaf05bb180761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.391744 1172 tablet_bootstrap.cc:654] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.392623 917 raft_consensus.cc:2468] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:02.393069 988 leader_election.cc:304] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:02.393446 1272 raft_consensus.cc:2804] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:02.394557 1272 raft_consensus.cc:697] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:02.395072 1272 consensus_queue.cc:237] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.398788 1026 tablet_service.cc:1511] Processing CreateTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 (DEFAULT_TABLE table=default.Table_ef07d99bfb1e43dc8d81cfe46a4b4be0 [id=544e7bcc34ae49688f95e64400ce17f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.399210 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01721f68e3c41f4a2ffaf05bb180761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.400867 1175 ts_tablet_manager.cc:1929] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.401036 1175 log.cc:1199] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/67a3b2a9dd8f4861b9d1f4ababf3973f
I20260617 07:53:02.401561 1175 ts_tablet_manager.cc:1950] T 67a3b2a9dd8f4861b9d1f4ababf3973f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.402176 891 tablet_service.cc:1511] Processing CreateTablet for tablet a882ae04eeb94276bb78ded81fbea708 (DEFAULT_TABLE table=default.Table_31ff404d1549430d86af35a09cf62ec5 [id=b602ba9d92744e8bb82c4c57e9bfccab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.402609 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a882ae04eeb94276bb78ded81fbea708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.411013 1170 ts_tablet_manager.cc:1929] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.411271 1170 log.cc:1199] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/bb96aca7a8ee486e9d05290e53b95bbc
I20260617 07:53:02.411755 1170 ts_tablet_manager.cc:1950] T bb96aca7a8ee486e9d05290e53b95bbc P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:02.412883 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet bb96aca7a8ee486e9d05290e53b95bbc (table default.Table_579d624a64244301bd5648e35f0d2a44 [id=fb7fb070eb1041c580e63ebc35d8558c]) successfully deleted
W20260617 07:53:02.413601 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7582d201bc5843949d4be08ee7586f9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7582d201bc5843949d4be08ee7586f9d already in progress: creating tablet
I20260617 07:53:02.414193 1178 tablet_bootstrap.cc:492] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.414398 1178 ts_tablet_manager.cc:1403] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.072s user 0.005s sys 0.000s
W20260617 07:53:02.414600 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 787467c65f68442aad071df16d4492f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 787467c65f68442aad071df16d4492f3 already in progress: creating tablet
W20260617 07:53:02.415380 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a5b7b95327604ef8b43944c4821d4ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5b7b95327604ef8b43944c4821d4ed7 already in progress: creating tablet
I20260617 07:53:02.415465 1178 raft_consensus.cc:359] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.415731 1178 raft_consensus.cc:385] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.415853 1178 raft_consensus.cc:740] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.416520 1178 consensus_queue.cc:260] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.416998 1171 tablet_bootstrap.cc:492] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.417158 1171 ts_tablet_manager.cc:1403] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.143s user 0.058s sys 0.067s
I20260617 07:53:02.417961 1171 raft_consensus.cc:359] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.418169 1171 raft_consensus.cc:385] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.418256 1171 raft_consensus.cc:740] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.418406 1228 raft_consensus.cc:493] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:02.418547 1228 raft_consensus.cc:515] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.418565 1171 consensus_queue.cc:260] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.419294 1228 leader_election.cc:290] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:02.420297 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9dc5fcd034eaab7a5548bccebd134" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:02.420791 852 leader_election.cc:343] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:02.422477 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 67a3b2a9dd8f4861b9d1f4ababf3973f (table default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23]) successfully deleted
W20260617 07:53:02.423528 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b01721f68e3c41f4a2ffaf05bb180761 consensus state has no leader
I20260617 07:53:02.427013 898 tablet_service.cc:1511] Processing CreateTablet for tablet 950c1c44020a4586b3197f5f68a38963 (DEFAULT_TABLE table=default.Table_45c63267e23f435fbd339cff71a43d48 [id=025ad5e64ed3429b8844117f5ddec194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.427603 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950c1c44020a4586b3197f5f68a38963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.429339 1178 ts_tablet_manager.cc:1434] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260617 07:53:02.429481 1171 ts_tablet_manager.cc:1434] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.012s user 0.004s sys 0.004s
I20260617 07:53:02.429570 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 (DEFAULT_TABLE table=default.Table_54be22b2fb3540f292a5ffa5ab372d0a [id=fc566654678945ea95c7d40693557ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.430048 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 950c1c44020a4586b3197f5f68a38963 (DEFAULT_TABLE table=default.Table_45c63267e23f435fbd339cff71a43d48 [id=025ad5e64ed3429b8844117f5ddec194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.430792 1178 tablet_bootstrap.cc:492] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:02.430821 751 tablet_service.cc:1511] Processing CreateTablet for tablet 950c1c44020a4586b3197f5f68a38963 (DEFAULT_TABLE table=default.Table_45c63267e23f435fbd339cff71a43d48 [id=025ad5e64ed3429b8844117f5ddec194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.431293 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950c1c44020a4586b3197f5f68a38963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.432021 1171 tablet_bootstrap.cc:492] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.433485 532 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_e4f5053ee058492a96b46167bade387b [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 1 got 0
I20260617 07:53:02.434140 1171 tablet_bootstrap.cc:654] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.434867 760 tablet_service.cc:1558] Processing DeleteTablet for tablet c9c156733805461ca185f7797525392f with delete_type TABLET_DATA_DELETED (replaced by tablet 62b7746239c54ab6828299968d18628d) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.434597 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0e8fe92eb0e14e9ea3e8b68b977f1690" } modify_external_catalogs: true
I20260617 07:53:02.435794 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0e8fe92eb0e14e9ea3e8b68b977f1690" } modify_external_catalogs: true
I20260617 07:53:02.436468 1175 tablet_replica.cc:333] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.436755 1175 raft_consensus.cc:2243] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.436972 1175 raft_consensus.cc:2272] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.437697 1026 tablet_service.cc:1511] Processing CreateTablet for tablet a882ae04eeb94276bb78ded81fbea708 (DEFAULT_TABLE table=default.Table_31ff404d1549430d86af35a09cf62ec5 [id=b602ba9d92744e8bb82c4c57e9bfccab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.438210 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 (DEFAULT_TABLE table=default.Table_54be22b2fb3540f292a5ffa5ab372d0a [id=fc566654678945ea95c7d40693557ac2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:02.438441 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 89d0b4bcb35c42fd8cd2844cd018b634 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89d0b4bcb35c42fd8cd2844cd018b634 already in progress: creating tablet
I20260617 07:53:02.438668 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc0676db18c42259efb1ad7dbd140c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.439100 758 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 (DEFAULT_TABLE table=default.Table_54be22b2fb3540f292a5ffa5ab372d0a [id=fc566654678945ea95c7d40693557ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.439603 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc0676db18c42259efb1ad7dbd140c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.442977 1178 tablet_bootstrap.cc:654] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.445065 1175 ts_tablet_manager.cc:1916] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.445188 753 tablet_service.cc:1511] Processing CreateTablet for tablet a882ae04eeb94276bb78ded81fbea708 (DEFAULT_TABLE table=default.Table_31ff404d1549430d86af35a09cf62ec5 [id=b602ba9d92744e8bb82c4c57e9bfccab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.445695 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a882ae04eeb94276bb78ded81fbea708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.447525 1171 tablet_bootstrap.cc:492] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.447671 1171 ts_tablet_manager.cc:1403] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.007s
I20260617 07:53:02.448621 1171 raft_consensus.cc:359] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.448818 1171 raft_consensus.cc:385] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.448982 1171 raft_consensus.cc:740] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.454622 1178 tablet_bootstrap.cc:492] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.454825 1178 ts_tablet_manager.cc:1403] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260617 07:53:02.455917 1178 raft_consensus.cc:359] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.456142 1178 raft_consensus.cc:385] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.456250 1178 raft_consensus.cc:740] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.456528 1178 consensus_queue.cc:260] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.457134 1178 ts_tablet_manager.cc:1434] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260617 07:53:02.457492 1178 tablet_bootstrap.cc:492] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:02.460057 1175 ts_tablet_manager.cc:1929] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.460290 1175 log.cc:1199] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/c9c156733805461ca185f7797525392f
I20260617 07:53:02.461182 1175 ts_tablet_manager.cc:1950] T c9c156733805461ca185f7797525392f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.462728 527 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_e4f5053ee058492a96b46167bade387b [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 1 got 0
I20260617 07:53:02.462792 1178 tablet_bootstrap.cc:654] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.464676 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_45c63267e23f435fbd339cff71a43d48" } modify_external_catalogs: true
I20260617 07:53:02.464928 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_45c63267e23f435fbd339cff71a43d48" } modify_external_catalogs: true
I20260617 07:53:02.467128 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet c9c156733805461ca185f7797525392f (table default.Table_94ed63316c4c4d0ba63b1088757d1711 [id=0ab7b2d30cea43f0bcfee627747ca777]) successfully deleted
I20260617 07:53:02.474018 1171 consensus_queue.cc:260] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.475116 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e9dc5fcd034eaab7a5548bccebd134" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:02.475987 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc0676db18c42259efb1ad7dbd140c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.476052 1171 ts_tablet_manager.cc:1434] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260617 07:53:02.479990 1178 tablet_bootstrap.cc:492] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.480166 1178 ts_tablet_manager.cc:1403] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20260617 07:53:02.480357 1169 ts_tablet_manager.cc:1929] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:02.480551 1169 log.cc:1199] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0500ee0a225c43ebb75a69f9b44ef0dd
I20260617 07:53:02.480932 1169 ts_tablet_manager.cc:1950] T 0500ee0a225c43ebb75a69f9b44ef0dd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.481618 1169 tablet_replica.cc:333] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.481642 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]) successfully deleted
I20260617 07:53:02.481822 1169 raft_consensus.cc:2243] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.481158 1178 raft_consensus.cc:359] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.482048 1178 raft_consensus.cc:385] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.482172 1178 raft_consensus.cc:740] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.482513 1178 consensus_queue.cc:260] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.482875 1171 tablet_bootstrap.cc:492] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.484651 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950c1c44020a4586b3197f5f68a38963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.485179 1178 ts_tablet_manager.cc:1434] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260617 07:53:02.485955 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a882ae04eeb94276bb78ded81fbea708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.487246 1178 tablet_bootstrap.cc:492] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:02.487721 851 leader_election.cc:343] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:02.487855 851 leader_election.cc:304] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:02.490018 1171 tablet_bootstrap.cc:654] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.490281 1178 tablet_bootstrap.cc:654] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.490304 1169 raft_consensus.cc:2272] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.491091 1299 raft_consensus.cc:2706] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Received pre-election callback for term 1 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260617 07:53:02.492197 1169 ts_tablet_manager.cc:1916] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.503144 1170 tablet_replica.cc:333] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:02.503652 1170 raft_consensus.cc:2243] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.503857 1170 raft_consensus.cc:2272] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.509093 751 tablet_service.cc:1511] Processing CreateTablet for tablet b4c9a032007a412e95bbd2b229edd50b (DEFAULT_TABLE table=default.Table_94149217b8fd42f3a46ed6df137e9f82 [id=251c405acf1c444ca8d6817889ffeed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.509641 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c9a032007a412e95bbd2b229edd50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.516777 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7392ca4ba6a140e19c57e962a26162af (DEFAULT_TABLE table=default.Table_7e5bc7ff50154b6ea71d9df096938e22 [id=7b8289fa3bd0446d8c61e654188ef0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.517567 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7392ca4ba6a140e19c57e962a26162af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.530275 1170 ts_tablet_manager.cc:1916] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.532684 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7392ca4ba6a140e19c57e962a26162af (DEFAULT_TABLE table=default.Table_7e5bc7ff50154b6ea71d9df096938e22 [id=7b8289fa3bd0446d8c61e654188ef0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.533378 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7392ca4ba6a140e19c57e962a26162af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.533586 891 tablet_service.cc:1511] Processing CreateTablet for tablet b4c9a032007a412e95bbd2b229edd50b (DEFAULT_TABLE table=default.Table_94149217b8fd42f3a46ed6df137e9f82 [id=251c405acf1c444ca8d6817889ffeed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.533983 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c9a032007a412e95bbd2b229edd50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.536780 1169 ts_tablet_manager.cc:1929] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.539031 1169 log.cc:1199] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/52e9dc5fcd034eaab7a5548bccebd134
W20260617 07:53:02.539333 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:41615, user_credentials={real_user=slave}} blocked reactor thread for 66967.1us
I20260617 07:53:02.539597 1169 ts_tablet_manager.cc:1950] T 52e9dc5fcd034eaab7a5548bccebd134 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:02.540115 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 80f67a6c1dcf4a69842452c371a9c078 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80f67a6c1dcf4a69842452c371a9c078 already in progress: creating tablet
I20260617 07:53:02.543300 1169 tablet_replica.cc:333] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.543565 1169 raft_consensus.cc:2243] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.543773 1169 raft_consensus.cc:2272] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.543947 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 52e9dc5fcd034eaab7a5548bccebd134 (table default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]) successfully deleted
I20260617 07:53:02.544622 1169 ts_tablet_manager.cc:1916] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.546509 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 076c6f6f406842ceb3db75e886e3ce50
I20260617 07:53:02.547063 523 catalog_manager.cc:6784] ReplaceTablet: tablet 076c6f6f406842ceb3db75e886e3ce50 deleted and replaced by tablet 82cf9c672f3b4567b63e878a6ab11334
I20260617 07:53:02.547385 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 with delete_type TABLET_DATA_DELETED (replaced by tablet 82cf9c672f3b4567b63e878a6ab11334) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.548719 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_54be22b2fb3540f292a5ffa5ab372d0a" } modify_external_catalogs: true
I20260617 07:53:02.548993 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_54be22b2fb3540f292a5ffa5ab372d0a" } modify_external_catalogs: true
I20260617 07:53:02.550137 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 06e0f2f9a75d4f9ba8702e4da75c042f from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.553406 1169 ts_tablet_manager.cc:1929] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.554903 1169 log.cc:1199] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/c9c156733805461ca185f7797525392f
I20260617 07:53:02.554838 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b5ea244188ba423a926d78f48e818554" } new_table_name: "default.Table_2b8844c59c5946fca15f26e8d1463152" modify_external_catalogs: true
I20260617 07:53:02.555495 1169 ts_tablet_manager.cc:1950] T c9c156733805461ca185f7797525392f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.557178 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 0435c4596b2d466c92d89ed41f132ea0 with delete_type TABLET_DATA_DELETED (replaced by tablet 80f67a6c1dcf4a69842452c371a9c078) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.557523 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 with delete_type TABLET_DATA_DELETED (replaced by tablet 82cf9c672f3b4567b63e878a6ab11334) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.558336 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_17f44c6c535445ed85c8e6f67a88d5c3" } modify_external_catalogs: true
I20260617 07:53:02.558553 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_17f44c6c535445ed85c8e6f67a88d5c3" } modify_external_catalogs: true
I20260617 07:53:02.559904 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet c9c156733805461ca185f7797525392f (table default.Table_94ed63316c4c4d0ba63b1088757d1711 [id=0ab7b2d30cea43f0bcfee627747ca777]) successfully deleted
W20260617 07:53:02.560179 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 89d0b4bcb35c42fd8cd2844cd018b634 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89d0b4bcb35c42fd8cd2844cd018b634 already in progress: creating tablet
I20260617 07:53:02.560506 1169 tablet_replica.cc:333] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.560734 1169 raft_consensus.cc:2243] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.560948 1169 raft_consensus.cc:2272] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.563220 1169 ts_tablet_manager.cc:1916] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.564788 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7392ca4ba6a140e19c57e962a26162af (DEFAULT_TABLE table=default.Table_7e5bc7ff50154b6ea71d9df096938e22 [id=7b8289fa3bd0446d8c61e654188ef0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.565376 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7392ca4ba6a140e19c57e962a26162af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.571112 1169 ts_tablet_manager.cc:1929] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.571244 1169 log.cc:1199] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0435c4596b2d466c92d89ed41f132ea0
I20260617 07:53:02.571570 1169 ts_tablet_manager.cc:1950] T 0435c4596b2d466c92d89ed41f132ea0 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.572567 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0435c4596b2d466c92d89ed41f132ea0 (table default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35 [id=0552acfce4294af484ccd1f88c42c4cb]) successfully deleted
I20260617 07:53:02.576849 531 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_e4f5053ee058492a96b46167bade387b [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 1 got 0
I20260617 07:53:02.577682 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_11a8e4d802dd415ca735ae9375de8ce7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.578369 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11a8e4d802dd415ca735ae9375de8ce7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.584152 528 master_service.cc:960] ReplaceTablet: received request to replace tablet b01721f68e3c41f4a2ffaf05bb180761 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.586064 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_90eee67c1b8d48cfac17fa339cb10a2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.586777 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90eee67c1b8d48cfac17fa339cb10a2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:02.588941 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 076c6f6f406842ceb3db75e886e3ce50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 076c6f6f406842ceb3db75e886e3ce50 already in progress: creating tablet
I20260617 07:53:02.598598 1026 tablet_service.cc:1511] Processing CreateTablet for tablet b4c9a032007a412e95bbd2b229edd50b (DEFAULT_TABLE table=default.Table_94149217b8fd42f3a46ed6df137e9f82 [id=251c405acf1c444ca8d6817889ffeed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.599074 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c9a032007a412e95bbd2b229edd50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.599398 760 tablet_service.cc:1511] Processing CreateTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 (DEFAULT_TABLE table=default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.599773 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d682ae37d74b4b967da0f8e2de6301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.607671 1172 tablet_bootstrap.cc:492] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.608476 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e9dc5fcd034eaab7a5548bccebd134 with delete_type TABLET_DATA_DELETED (replaced by tablet 4996cde4d1514aa081257c802339abe6) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.608992 1175 tablet_replica.cc:333] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.609272 1175 raft_consensus.cc:2243] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.609499 1175 raft_consensus.cc:2272] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.609895 1172 ts_tablet_manager.cc:1403] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.236s user 0.016s sys 0.029s
I20260617 07:53:02.610356 1175 ts_tablet_manager.cc:1916] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.612685 1172 raft_consensus.cc:359] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.614435 1172 raft_consensus.cc:385] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.614531 1172 raft_consensus.cc:740] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.614856 1172 consensus_queue.cc:260] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.615628 898 tablet_service.cc:1511] Processing CreateTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 (DEFAULT_TABLE table=default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.616044 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d682ae37d74b4b967da0f8e2de6301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.616199 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 (DEFAULT_TABLE table=default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.616652 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d682ae37d74b4b967da0f8e2de6301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.617558 1172 ts_tablet_manager.cc:1434] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 07:53:02.618057 1172 tablet_bootstrap.cc:492] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.620726 1172 tablet_bootstrap.cc:654] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.626101 1178 tablet_bootstrap.cc:492] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.626281 1178 ts_tablet_manager.cc:1403] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.139s user 0.009s sys 0.028s
I20260617 07:53:02.627147 1178 raft_consensus.cc:359] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.627380 1178 raft_consensus.cc:385] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.627547 1178 raft_consensus.cc:740] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.627867 1178 consensus_queue.cc:260] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.628935 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4996cde4d1514aa081257c802339abe6 (DEFAULT_TABLE table=default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.629449 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4996cde4d1514aa081257c802339abe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.629469 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 4996cde4d1514aa081257c802339abe6 (DEFAULT_TABLE table=default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.630132 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4996cde4d1514aa081257c802339abe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.630164 1178 ts_tablet_manager.cc:1434] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:02.633153 1172 tablet_bootstrap.cc:492] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.633287 1175 ts_tablet_manager.cc:1929] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.633313 1172 ts_tablet_manager.cc:1403] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260617 07:53:02.633441 1175 log.cc:1199] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/52e9dc5fcd034eaab7a5548bccebd134
I20260617 07:53:02.633857 1175 ts_tablet_manager.cc:1950] T 52e9dc5fcd034eaab7a5548bccebd134 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.634140 1172 raft_consensus.cc:359] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.634375 1272 raft_consensus.cc:493] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:02.634505 1272 raft_consensus.cc:515] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.635183 1272 leader_election.cc:290] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:02.635885 1172 raft_consensus.cc:385] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.636066 1172 raft_consensus.cc:740] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:02.636469 986 leader_election.cc:343] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: a8df3210685244ae8a9b7c9190d619a0
I20260617 07:53:02.636340 1172 consensus_queue.cc:260] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:02.636686 988 leader_election.cc:343] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a8df3210685244ae8a9b7c9190d619a0
I20260617 07:53:02.636797 988 leader_election.cc:304] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:02.637182 1272 raft_consensus.cc:2749] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:02.638409 758 tablet_service.cc:1511] Processing CreateTablet for tablet 4996cde4d1514aa081257c802339abe6 (DEFAULT_TABLE table=default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.638550 1172 ts_tablet_manager.cc:1434] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:02.639118 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4996cde4d1514aa081257c802339abe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.640304 1172 tablet_bootstrap.cc:492] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.642724 1172 tablet_bootstrap.cc:654] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.644773 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 with delete_type TABLET_DATA_DELETED (replaced by tablet 82cf9c672f3b4567b63e878a6ab11334) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.645253 1171 tablet_bootstrap.cc:492] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.645490 1171 ts_tablet_manager.cc:1403] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.163s user 0.032s sys 0.031s
I20260617 07:53:02.646519 1171 raft_consensus.cc:359] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.646751 1171 raft_consensus.cc:385] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.646844 1171 raft_consensus.cc:740] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.647161 1171 consensus_queue.cc:260] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.650992 1172 tablet_bootstrap.cc:492] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.651175 1172 ts_tablet_manager.cc:1403] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260617 07:53:02.651480 1171 ts_tablet_manager.cc:1434] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260617 07:53:02.651970 1172 raft_consensus.cc:359] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.652498 1172 raft_consensus.cc:385] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.652590 1172 raft_consensus.cc:740] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.652868 1172 consensus_queue.cc:260] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.653481 1171 tablet_bootstrap.cc:492] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.653544 1170 ts_tablet_manager.cc:1929] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.654992 1172 ts_tablet_manager.cc:1434] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:02.655340 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 4d9d9ed003c64b1abed6bd3bb14456cd
I20260617 07:53:02.656699 529 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_e4f5053ee058492a96b46167bade387b [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 1 got 0
I20260617 07:53:02.657630 1171 tablet_bootstrap.cc:654] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.657845 1172 tablet_bootstrap.cc:492] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.658447 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9d9ed003c64b1abed6bd3bb14456cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:02.659237 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4d9d9ed003c64b1abed6bd3bb14456cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9d9ed003c64b1abed6bd3bb14456cd already in progress: creating tablet
I20260617 07:53:02.660876 1172 tablet_bootstrap.cc:654] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.661996 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a80c833560f46789a079bd7672e1874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.662264 1169 tablet_replica.cc:333] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.662447 1169 raft_consensus.cc:2243] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.662601 1169 raft_consensus.cc:2272] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.664013 1169 ts_tablet_manager.cc:1916] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.664445 529 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_e4f5053ee058492a96b46167bade387b [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 1 got 0
I20260617 07:53:02.666463 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 0435c4596b2d466c92d89ed41f132ea0 with delete_type TABLET_DATA_DELETED (replaced by tablet 80f67a6c1dcf4a69842452c371a9c078) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.667423 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3b2a9dd8f4861b9d1f4ababf3973f with delete_type TABLET_DATA_DELETED (replaced by tablet a31fba373a214b5a96bd11b930ed3b86) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.670130 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a80c833560f46789a079bd7672e1874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.670424 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9d9ed003c64b1abed6bd3bb14456cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.670655 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9d9ed003c64b1abed6bd3bb14456cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.670961 529 master_service.cc:960] ReplaceTablet: received request to replace tablet b14f9f70461e49ccb4d318eab824a3e1 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.671496 1169 ts_tablet_manager.cc:1929] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.671648 1169 log.cc:1199] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/2a80c833560f46789a079bd7672e1874
I20260617 07:53:02.672127 898 tablet_service.cc:1511] Processing CreateTablet for tablet c7343400555f447b8a1721ba36d7766d (DEFAULT_TABLE table=default.Table_b106b0223948469da9ef0246aceeed0d [id=4aac4497cee840e0a0d0c88abfdc229f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.672911 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7343400555f447b8a1721ba36d7766d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.673377 1172 tablet_bootstrap.cc:492] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.673342 891 tablet_service.cc:1511] Processing CreateTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 (DEFAULT_TABLE table=default.Table_6dd3b32c3f7c4ae58bf47ef40691387e [id=1e5fc863b63b40a384e18985aaba5ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.673523 1025 tablet_service.cc:1511] Processing CreateTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 (DEFAULT_TABLE table=default.Table_6dd3b32c3f7c4ae58bf47ef40691387e [id=1e5fc863b63b40a384e18985aaba5ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.673889 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f030d59f4e124f64bb62d05f0bb0f560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.673920 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f030d59f4e124f64bb62d05f0bb0f560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.674007 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c7343400555f447b8a1721ba36d7766d (DEFAULT_TABLE table=default.Table_b106b0223948469da9ef0246aceeed0d [id=4aac4497cee840e0a0d0c88abfdc229f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.674333 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7343400555f447b8a1721ba36d7766d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.673528 1172 ts_tablet_manager.cc:1403] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.005s
I20260617 07:53:02.675392 1172 raft_consensus.cc:359] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.675612 1172 raft_consensus.cc:385] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.675697 1172 raft_consensus.cc:740] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.675904 1172 consensus_queue.cc:260] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.676391 1172 ts_tablet_manager.cc:1434] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:02.676652 1172 tablet_bootstrap.cc:492] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.678460 1172 tablet_bootstrap.cc:654] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.680137 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 69996eb4ab6e40f9b2d97e00d766822a
I20260617 07:53:02.681485 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.683321 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_d96805f03e8f47b58040c4896878c01e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.683846 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d96805f03e8f47b58040c4896878c01e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.686015 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.686249 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e9dc5fcd034eaab7a5548bccebd134 with delete_type TABLET_DATA_DELETED (replaced by tablet 4996cde4d1514aa081257c802339abe6) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.686431 1272 raft_consensus.cc:493] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:02.686581 1272 raft_consensus.cc:515] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.688401 1272 leader_election.cc:290] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:02.688723 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.689987 1178 tablet_bootstrap.cc:492] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:02.690550 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 950c1c44020a4586b3197f5f68a38963
I20260617 07:53:02.691270 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bf7bd0bdbcaa4627bef32d8b9411f0c4" } new_table_name: "default.Table_d7a2cf493ddd427c9087f6b6b1971450" modify_external_catalogs: true
I20260617 07:53:02.691375 1169 ts_tablet_manager.cc:1950] T 2a80c833560f46789a079bd7672e1874 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.691635 1178 tablet_bootstrap.cc:654] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.692745 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 2a80c833560f46789a079bd7672e1874 (table default.Table_57339f59d3434cc6aa87310f32242731 [id=719427e0fac94f51a2d5189178be5a9f]) successfully deleted
I20260617 07:53:02.693260 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 950c1c44020a4586b3197f5f68a38963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.693462 1175 tablet_replica.cc:333] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.693650 1175 raft_consensus.cc:2243] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.693838 1175 raft_consensus.cc:2272] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.694661 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 52e9dc5fcd034eaab7a5548bccebd134 (table default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]) successfully deleted
W20260617 07:53:02.694891 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 076c6f6f406842ceb3db75e886e3ce50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 076c6f6f406842ceb3db75e886e3ce50 already in progress: creating tablet
I20260617 07:53:02.695019 1171 tablet_bootstrap.cc:492] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.695154 1171 ts_tablet_manager.cc:1403] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.001s
W20260617 07:53:02.695551 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 69996eb4ab6e40f9b2d97e00d766822a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69996eb4ab6e40f9b2d97e00d766822a already in progress: creating tablet
W20260617 07:53:02.695780 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 950c1c44020a4586b3197f5f68a38963 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 950c1c44020a4586b3197f5f68a38963 already in progress: creating tablet
I20260617 07:53:02.695932 1171 raft_consensus.cc:359] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.696096 1171 raft_consensus.cc:385] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.696178 1171 raft_consensus.cc:740] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.696436 1171 consensus_queue.cc:260] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.696537 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 950c1c44020a4586b3197f5f68a38963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.696880 1175 ts_tablet_manager.cc:1916] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.699016 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 06e0f2f9a75d4f9ba8702e4da75c042f
I20260617 07:53:02.699437 524 catalog_manager.cc:6784] ReplaceTablet: tablet 06e0f2f9a75d4f9ba8702e4da75c042f deleted and replaced by tablet 56c70f5c41e04ad0b913c15aa315353f
I20260617 07:53:02.699740 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5d4c38bce4ba4d0dbc2af4af682bee57" } new_table_name: "default.Table_cb1be17b08654d1989db263568fd1036" modify_external_catalogs: true
I20260617 07:53:02.700201 1171 ts_tablet_manager.cc:1434] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260617 07:53:02.701083 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8ac72fef1251446cbd3975d98fa2f4ae consensus state has no leader
I20260617 07:53:02.702167 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_eed83a50eb564951beba72394e06b0dc" } new_table_name: "default.Table_cf2b90b9a25a471aa34d0532b35cbff9" modify_external_catalogs: true
I20260617 07:53:02.702649 1171 tablet_bootstrap.cc:492] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.703935 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e0f2f9a75d4f9ba8702e4da75c042f with delete_type TABLET_DATA_DELETED (replaced by tablet 56c70f5c41e04ad0b913c15aa315353f) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.704437 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e0f2f9a75d4f9ba8702e4da75c042f with delete_type TABLET_DATA_DELETED (replaced by tablet 56c70f5c41e04ad0b913c15aa315353f) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:02.704735 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 06e0f2f9a75d4f9ba8702e4da75c042f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06e0f2f9a75d4f9ba8702e4da75c042f already in progress: creating tablet
I20260617 07:53:02.706019 1171 tablet_bootstrap.cc:654] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.706094 1175 ts_tablet_manager.cc:1929] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.706233 1175 log.cc:1199] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/2a80c833560f46789a079bd7672e1874
W20260617 07:53:02.707741 988 leader_election.cc:343] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 0435c4596b2d466c92d89ed41f132ea0
I20260617 07:53:02.708288 1175 ts_tablet_manager.cc:1950] T 2a80c833560f46789a079bd7672e1874 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:02.708774 986 leader_election.cc:343] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: 0435c4596b2d466c92d89ed41f132ea0
I20260617 07:53:02.709447 986 leader_election.cc:304] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:02.709908 1272 raft_consensus.cc:2749] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:02.710844 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e0f2f9a75d4f9ba8702e4da75c042f with delete_type TABLET_DATA_DELETED (replaced by tablet 56c70f5c41e04ad0b913c15aa315353f) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.710963 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 950c1c44020a4586b3197f5f68a38963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.708550 751 tablet_service.cc:1511] Processing CreateTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 (DEFAULT_TABLE table=default.Table_6dd3b32c3f7c4ae58bf47ef40691387e [id=1e5fc863b63b40a384e18985aaba5ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:02.711531 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f030d59f4e124f64bb62d05f0bb0f560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.718101 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 2a80c833560f46789a079bd7672e1874 (table default.Table_57339f59d3434cc6aa87310f32242731 [id=719427e0fac94f51a2d5189178be5a9f]) successfully deleted
W20260617 07:53:02.718957 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4d9d9ed003c64b1abed6bd3bb14456cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9d9ed003c64b1abed6bd3bb14456cd already in progress: creating tablet
W20260617 07:53:02.719887 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 69996eb4ab6e40f9b2d97e00d766822a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69996eb4ab6e40f9b2d97e00d766822a already in progress: creating tablet
I20260617 07:53:02.721006 753 tablet_service.cc:1511] Processing CreateTablet for tablet c7343400555f447b8a1721ba36d7766d (DEFAULT_TABLE table=default.Table_b106b0223948469da9ef0246aceeed0d [id=4aac4497cee840e0a0d0c88abfdc229f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:02.722020 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 950c1c44020a4586b3197f5f68a38963 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 950c1c44020a4586b3197f5f68a38963 already in progress: creating tablet
W20260617 07:53:02.722808 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 06e0f2f9a75d4f9ba8702e4da75c042f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06e0f2f9a75d4f9ba8702e4da75c042f already in progress: creating tablet
I20260617 07:53:02.723086 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7343400555f447b8a1721ba36d7766d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:02.653687 1170 log.cc:1199] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d6d25b9220bc414b88a0cf3991f9ec5c
I20260617 07:53:02.730367 1170 ts_tablet_manager.cc:1950] T d6d25b9220bc414b88a0cf3991f9ec5c P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:02.735021 1170 tablet_replica.cc:333] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:02.735288 1170 raft_consensus.cc:2243] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:02.735927 1170 raft_consensus.cc:2272] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.736799 1172 tablet_bootstrap.cc:492] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.737059 1172 ts_tablet_manager.cc:1403] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.060s user 0.023s sys 0.019s
I20260617 07:53:02.737335 1170 ts_tablet_manager.cc:1916] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.737823 1172 raft_consensus.cc:359] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.738077 1172 raft_consensus.cc:385] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.738162 1172 raft_consensus.cc:740] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.738508 1172 consensus_queue.cc:260] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.738734 1178 tablet_bootstrap.cc:492] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.739663 1178 ts_tablet_manager.cc:1403] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.006s
I20260617 07:53:02.740530 1178 raft_consensus.cc:359] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.740864 1178 raft_consensus.cc:385] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.741010 1178 raft_consensus.cc:740] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.741122 1172 ts_tablet_manager.cc:1434] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:02.741487 1178 consensus_queue.cc:260] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.743553 1172 tablet_bootstrap.cc:492] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.745762 1172 tablet_bootstrap.cc:654] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.746225 1178 ts_tablet_manager.cc:1434] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:02.748103 1178 tablet_bootstrap.cc:492] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:02.750274 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d6d25b9220bc414b88a0cf3991f9ec5c (table default.Table_2b271e2563664a57a954aa99a29e38ce [id=bfc8d977c5b4448cb8fb2a9cabe10281]) successfully deleted
I20260617 07:53:02.751784 526 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet e07a96bbc3fc4b26bc59f2418da463b3
I20260617 07:53:02.760968 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 0dc0676db18c42259efb1ad7dbd140c8
I20260617 07:53:02.761888 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:02.762887 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0dc0676db18c42259efb1ad7dbd140c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dc0676db18c42259efb1ad7dbd140c8 already in progress: creating tablet
I20260617 07:53:02.764120 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 69996eb4ab6e40f9b2d97e00d766822a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.764930 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.765688 1175 tablet_replica.cc:333] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.765879 1175 raft_consensus.cc:2243] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.766048 1175 raft_consensus.cc:2272] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.766258 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.767596 1172 tablet_bootstrap.cc:492] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.767760 1172 ts_tablet_manager.cc:1403] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.007s
I20260617 07:53:02.768607 1172 raft_consensus.cc:359] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.768800 1172 raft_consensus.cc:385] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.768880 1172 raft_consensus.cc:740] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.769091 1172 consensus_queue.cc:260] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.769608 1172 ts_tablet_manager.cc:1434] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260617 07:53:02.769752 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0dc0676db18c42259efb1ad7dbd140c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dc0676db18c42259efb1ad7dbd140c8 already in progress: creating tablet
I20260617 07:53:02.769982 1172 tablet_bootstrap.cc:492] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.770641 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.770864 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a80c833560f46789a079bd7672e1874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.764602 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a4932350eabc437790e3b63a38d8f951" } new_table_name: "default.Table_e324a127d3c9425a9d28163d7f13d6bc" modify_external_catalogs: true
W20260617 07:53:02.773649 518 consensus_peers.cc:597] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d -> Peer 3b274c37ad4445ba8b41d6784b3cd336 (127.0.105.188:33087): Couldn't send request to peer 3b274c37ad4445ba8b41d6784b3cd336. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260617 07:53:02.776736 898 tablet_service.cc:1558] Processing DeleteTablet for tablet cad8eca2f4184640a3eba751a7855abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.777043 1169 tablet_replica.cc:333] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.777257 1169 raft_consensus.cc:2243] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.777448 1169 raft_consensus.cc:2272] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.778045 1172 tablet_bootstrap.cc:654] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.778287 1169 ts_tablet_manager.cc:1916] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.780432 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet cad8eca2f4184640a3eba751a7855abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.780799 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.783066 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.786329 1175 ts_tablet_manager.cc:1916] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.786410 1169 ts_tablet_manager.cc:1929] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.786526 1169 log.cc:1199] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/cad8eca2f4184640a3eba751a7855abb
I20260617 07:53:02.786899 1169 ts_tablet_manager.cc:1950] T cad8eca2f4184640a3eba751a7855abb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.787940 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet cad8eca2f4184640a3eba751a7855abb (table default.Table_4d662781dac64b4eadfe4c99fb6515db [id=6323ccf9b79a4d01835f788a87d0c724]) successfully deleted
I20260617 07:53:02.792989 1178 tablet_bootstrap.cc:654] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.812016 898 tablet_service.cc:1558] Processing DeleteTablet for tablet cad8eca2f4184640a3eba751a7855abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.812949 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_bbc95ce139d8435387c7952fa8812d3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.813581 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbc95ce139d8435387c7952fa8812d3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:02.813689 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet cad8eca2f4184640a3eba751a7855abb because the tablet was not found. No further retry: Not found: Tablet not found: cad8eca2f4184640a3eba751a7855abb
I20260617 07:53:02.814683 1272 raft_consensus.cc:493] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:02.814836 1272 raft_consensus.cc:515] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.815503 1272 leader_election.cc:290] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:02.818511 986 leader_election.cc:343] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: 5f92d26dd0d746a18f88058379ac7b83
W20260617 07:53:02.819257 988 leader_election.cc:343] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 5f92d26dd0d746a18f88058379ac7b83
I20260617 07:53:02.819410 988 leader_election.cc:304] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:02.819792 1174 raft_consensus.cc:493] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:02.820072 1174 raft_consensus.cc:515] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.820788 1174 leader_election.cc:290] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:02.820955 1174 raft_consensus.cc:2749] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:02.821385 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet b01721f68e3c41f4a2ffaf05bb180761
I20260617 07:53:02.821954 528 catalog_manager.cc:6784] ReplaceTablet: tablet b01721f68e3c41f4a2ffaf05bb180761 deleted and replaced by tablet d6ab00c0be9545cc97a0f29d82de4877
I20260617 07:53:02.822866 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 with delete_type TABLET_DATA_DELETED (replaced by tablet d6ab00c0be9545cc97a0f29d82de4877) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.824122 1171 tablet_bootstrap.cc:492] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.824294 1171 ts_tablet_manager.cc:1403] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.122s user 0.016s sys 0.047s
I20260617 07:53:02.824827 898 tablet_service.cc:1558] Processing DeleteTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 with delete_type TABLET_DATA_DELETED (replaced by tablet d6ab00c0be9545cc97a0f29d82de4877) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.825085 1171 raft_consensus.cc:359] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.825300 1171 raft_consensus.cc:385] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.825377 1171 raft_consensus.cc:740] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.825614 1171 consensus_queue.cc:260] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:02.826077 986 leader_election.cc:343] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: 52e9dc5fcd034eaab7a5548bccebd134
W20260617 07:53:02.826545 988 leader_election.cc:343] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 52e9dc5fcd034eaab7a5548bccebd134
I20260617 07:53:02.826683 988 leader_election.cc:304] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:02.827119 1272 raft_consensus.cc:2749] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:02.827661 1171 ts_tablet_manager.cc:1434] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:02.828002 1171 tablet_bootstrap.cc:492] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:02.828445 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet b01721f68e3c41f4a2ffaf05bb180761 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b01721f68e3c41f4a2ffaf05bb180761 already in progress: creating tablet
I20260617 07:53:02.828984 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_d9b00fcc7cb444ae897bf42d20cb2e53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.829574 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9b00fcc7cb444ae897bf42d20cb2e53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.829843 1171 tablet_bootstrap.cc:654] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.831151 751 tablet_service.cc:1558] Processing DeleteTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 with delete_type TABLET_DATA_DELETED (replaced by tablet d6ab00c0be9545cc97a0f29d82de4877) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.838946 1171 tablet_bootstrap.cc:492] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.839121 1171 ts_tablet_manager.cc:1403] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.004s
I20260617 07:53:02.839933 1171 raft_consensus.cc:359] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.840116 1171 raft_consensus.cc:385] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.840214 1171 raft_consensus.cc:740] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.840456 1171 consensus_queue.cc:260] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.842339 1171 ts_tablet_manager.cc:1434] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:02.843042 1171 tablet_bootstrap.cc:492] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.844810 1171 tablet_bootstrap.cc:654] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.850513 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_f176abc5534f4cfca902243f1fa75f63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.851130 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f176abc5534f4cfca902243f1fa75f63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.852730 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:02.853096 1169 tablet_replica.cc:333] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.853304 1169 raft_consensus.cc:2243] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.853488 1169 raft_consensus.cc:2272] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.860247 1169 ts_tablet_manager.cc:1916] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.860630 1171 tablet_bootstrap.cc:492] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.860831 1171 ts_tablet_manager.cc:1403] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.008s
I20260617 07:53:02.861904 1171 raft_consensus.cc:359] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.862133 1171 raft_consensus.cc:385] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.862236 1171 raft_consensus.cc:740] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.862515 1171 consensus_queue.cc:260] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.865489 1172 tablet_bootstrap.cc:492] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.865665 1172 ts_tablet_manager.cc:1403] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.096s user 0.011s sys 0.028s
I20260617 07:53:02.865846 1178 tablet_bootstrap.cc:492] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.866007 1178 ts_tablet_manager.cc:1403] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.118s user 0.001s sys 0.003s
I20260617 07:53:02.866533 1172 raft_consensus.cc:359] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.866743 1172 raft_consensus.cc:385] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.866827 1172 raft_consensus.cc:740] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.867111 1172 consensus_queue.cc:260] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.867137 1178 raft_consensus.cc:359] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.867336 1178 raft_consensus.cc:385] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.868322 1178 raft_consensus.cc:740] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.868674 1169 ts_tablet_manager.cc:1929] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.868692 1178 consensus_queue.cc:260] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.869179 1169 log.cc:1199] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/1481eb3482dd421f94556a1ce32eeed6
I20260617 07:53:02.869300 1172 ts_tablet_manager.cc:1434] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:02.869616 1172 tablet_bootstrap.cc:492] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.869619 1169 ts_tablet_manager.cc:1950] T 1481eb3482dd421f94556a1ce32eeed6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.870919 1178 ts_tablet_manager.cc:1434] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:02.871409 1178 tablet_bootstrap.cc:492] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:02.871696 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 1481eb3482dd421f94556a1ce32eeed6 (table default.Table_d7b564096cd0495cb0f0a82db15e011e [id=816ac8741e6f485d9aa6fb6f93946193]) successfully deleted
I20260617 07:53:02.874074 1171 ts_tablet_manager.cc:1434] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.013s user 0.000s sys 0.003s
I20260617 07:53:02.874414 1171 tablet_bootstrap.cc:492] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.876212 1171 tablet_bootstrap.cc:654] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.877465 1175 ts_tablet_manager.cc:1929] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.877590 1175 log.cc:1199] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/1481eb3482dd421f94556a1ce32eeed6
I20260617 07:53:02.877970 1175 ts_tablet_manager.cc:1950] T 1481eb3482dd421f94556a1ce32eeed6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:02.878093 1172 tablet_bootstrap.cc:654] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.878978 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 1481eb3482dd421f94556a1ce32eeed6 (table default.Table_d7b564096cd0495cb0f0a82db15e011e [id=816ac8741e6f485d9aa6fb6f93946193]) successfully deleted
I20260617 07:53:02.880336 1178 tablet_bootstrap.cc:654] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.881286 1171 tablet_bootstrap.cc:492] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.881472 1171 ts_tablet_manager.cc:1403] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20260617 07:53:02.882427 1171 raft_consensus.cc:359] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.882613 1171 raft_consensus.cc:385] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.882759 1171 raft_consensus.cc:740] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.883136 1171 consensus_queue.cc:260] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.884584 1171 ts_tablet_manager.cc:1434] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 07:53:02.885219 1171 tablet_bootstrap.cc:492] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:02.887428 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ccf7f07441954d35916890efbfa4d836 consensus state has no leader
I20260617 07:53:02.887904 1171 tablet_bootstrap.cc:654] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.890618 1172 tablet_bootstrap.cc:492] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.890826 1172 ts_tablet_manager.cc:1403] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.000s
I20260617 07:53:02.891876 1172 raft_consensus.cc:359] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.892130 1172 raft_consensus.cc:385] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.892243 1172 raft_consensus.cc:740] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.892576 1172 consensus_queue.cc:260] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.895206 1172 ts_tablet_manager.cc:1434] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260617 07:53:02.895516 1172 tablet_bootstrap.cc:492] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:02.896456 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9968c8179c14d1b9bc9a2c2779fb86e consensus state has no leader
I20260617 07:53:02.898955 1172 tablet_bootstrap.cc:654] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.903481 1171 tablet_bootstrap.cc:492] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.903658 1171 ts_tablet_manager.cc:1403] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.001s
I20260617 07:53:02.904817 1171 raft_consensus.cc:359] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.905015 1171 raft_consensus.cc:385] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.905079 1171 raft_consensus.cc:740] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.905956 1171 consensus_queue.cc:260] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.906981 1171 ts_tablet_manager.cc:1434] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:02.907125 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 086e43b610f9430c872daeef35c5586a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:02.907290 1171 tablet_bootstrap.cc:492] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.909906 1171 tablet_bootstrap.cc:654] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.909897 751 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b725166d9c420e9aa4435f707ce6c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.910923 1172 tablet_bootstrap.cc:492] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.911095 1172 ts_tablet_manager.cc:1403] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260617 07:53:02.911836 1172 raft_consensus.cc:359] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.912062 1172 raft_consensus.cc:385] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.912138 1172 raft_consensus.cc:740] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.912425 1172 consensus_queue.cc:260] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.914844 1172 ts_tablet_manager.cc:1434] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260617 07:53:02.915726 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 074a3e08cc9a4be891016ce197a993be consensus state has no leader
I20260617 07:53:02.915169 1172 tablet_bootstrap.cc:492] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.919279 1172 tablet_bootstrap.cc:654] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.920914 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e43779214db14ba4b44ebf4eb478fae9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.921527 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e43779214db14ba4b44ebf4eb478fae9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:02.926311 1247 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 07:53:02.926777 1247 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 07:53:02.926936 1247 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260617 07:53:02.935067 1172 tablet_bootstrap.cc:492] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.935230 1172 ts_tablet_manager.cc:1403] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.008s
I20260617 07:53:02.935993 1172 raft_consensus.cc:359] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.936187 1172 raft_consensus.cc:385] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.936277 1172 raft_consensus.cc:740] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.937242 1171 tablet_bootstrap.cc:492] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.937407 1171 ts_tablet_manager.cc:1403] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.009s
I20260617 07:53:02.938197 1171 raft_consensus.cc:359] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.938390 1171 raft_consensus.cc:385] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.938475 1171 raft_consensus.cc:740] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.938745 1171 consensus_queue.cc:260] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.939852 1171 ts_tablet_manager.cc:1434] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:02.940160 1171 tablet_bootstrap.cc:492] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.940577 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet b14f9f70461e49ccb4d318eab824a3e1
I20260617 07:53:02.941102 529 catalog_manager.cc:6784] ReplaceTablet: tablet b14f9f70461e49ccb4d318eab824a3e1 deleted and replaced by tablet ce1cb2c879e6451886c55907678792de
W20260617 07:53:02.941417 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56c70f5c41e04ad0b913c15aa315353f has no consensus state
I20260617 07:53:02.941493 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_94ca7e593fc74524abf0ef739e7f986b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:02.941777 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b61c03f6c3284d4aa58a66884bf74d10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:02.942085 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94ca7e593fc74524abf0ef739e7f986b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:02.942220 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b61c03f6c3284d4aa58a66884bf74d10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:02.943001 1171 tablet_bootstrap.cc:654] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.936630 1172 consensus_queue.cc:260] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.945629 1172 ts_tablet_manager.cc:1434] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260617 07:53:02.946017 1172 tablet_bootstrap.cc:492] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.946096 1175 tablet_replica.cc:333] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:02.946311 1175 raft_consensus.cc:2243] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.946485 1175 raft_consensus.cc:2272] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:02.949331 1172 tablet_bootstrap.cc:654] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.950974 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_222b195724fd4c0a86c636969ca9d0f0" } modify_external_catalogs: true
I20260617 07:53:02.951143 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_222b195724fd4c0a86c636969ca9d0f0" } modify_external_catalogs: true
I20260617 07:53:02.951524 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet b14f9f70461e49ccb4d318eab824a3e1 with delete_type TABLET_DATA_DELETED (replaced by tablet ce1cb2c879e6451886c55907678792de) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:02.951792 751 tablet_service.cc:1558] Processing DeleteTablet for tablet b14f9f70461e49ccb4d318eab824a3e1 with delete_type TABLET_DATA_DELETED (replaced by tablet ce1cb2c879e6451886c55907678792de) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:02.952279 1247 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
I20260617 07:53:02.952307 898 tablet_service.cc:1558] Processing DeleteTablet for tablet b14f9f70461e49ccb4d318eab824a3e1 with delete_type TABLET_DATA_DELETED (replaced by tablet ce1cb2c879e6451886c55907678792de) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:02.952389 1247 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 07:53:02.952483 1247 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 07:53:02.952556 1247 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 07:53:02.952567 1169 tablet_replica.cc:333] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:02.952734 1169 raft_consensus.cc:2243] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:02.952924 1169 raft_consensus.cc:2272] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:02.953529 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet b01721f68e3c41f4a2ffaf05bb180761 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b01721f68e3c41f4a2ffaf05bb180761 already in progress: creating tablet
I20260617 07:53:02.953830 1169 ts_tablet_manager.cc:1916] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.956938 1170 ts_tablet_manager.cc:1929] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:02.957075 1170 log.cc:1199] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0500ee0a225c43ebb75a69f9b44ef0dd
I20260617 07:53:02.957538 1170 ts_tablet_manager.cc:1950] T 0500ee0a225c43ebb75a69f9b44ef0dd P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:02.961628 1169 ts_tablet_manager.cc:1929] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:02.961791 1169 log.cc:1199] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/b14f9f70461e49ccb4d318eab824a3e1
I20260617 07:53:02.962212 1169 ts_tablet_manager.cc:1950] T b14f9f70461e49ccb4d318eab824a3e1 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:02.963369 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet b14f9f70461e49ccb4d318eab824a3e1 (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]) successfully deleted
I20260617 07:53:02.967841 1175 ts_tablet_manager.cc:1916] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:02.969265 1172 tablet_bootstrap.cc:492] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:02.969419 1172 ts_tablet_manager.cc:1403] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.004s
I20260617 07:53:02.970253 1172 raft_consensus.cc:359] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.970441 1172 raft_consensus.cc:385] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.970511 1172 raft_consensus.cc:740] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.971244 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c651ebd3c3eb4bc8a82dea4cf194f571" } modify_external_catalogs: true
I20260617 07:53:02.971462 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c651ebd3c3eb4bc8a82dea4cf194f571" } modify_external_catalogs: true
I20260617 07:53:02.972244 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_109a002e502a44d99c0e775b394e5c38" } modify_external_catalogs: true
I20260617 07:53:02.972419 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_109a002e502a44d99c0e775b394e5c38" } modify_external_catalogs: true
I20260617 07:53:02.974530 1178 tablet_bootstrap.cc:492] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:02.974684 1178 ts_tablet_manager.cc:1403] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.001s
I20260617 07:53:02.975330 1172 consensus_queue.cc:260] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:02.976292 1178 raft_consensus.cc:359] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.976466 1178 raft_consensus.cc:385] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.976562 1178 raft_consensus.cc:740] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.976780 1178 consensus_queue.cc:260] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:02.977913 1171 tablet_bootstrap.cc:492] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.978091 1171 ts_tablet_manager.cc:1403] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.007s
I20260617 07:53:02.978818 1178 ts_tablet_manager.cc:1434] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:02.979239 1171 raft_consensus.cc:359] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.979437 1171 raft_consensus.cc:385] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:02.979517 1171 raft_consensus.cc:740] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:02.979105 1178 tablet_bootstrap.cc:492] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:02.980408 1171 consensus_queue.cc:260] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:02.982201 1171 ts_tablet_manager.cc:1434] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:02.982590 1171 tablet_bootstrap.cc:492] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:02.984912 1171 tablet_bootstrap.cc:654] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.985960 1172 ts_tablet_manager.cc:1434] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260617 07:53:02.987387 1172 tablet_bootstrap.cc:492] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:02.987574 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 0500ee0a225c43ebb75a69f9b44ef0dd (table default.Table_80c7d1700afc48cfac169bb161d8597f [id=659cc77082d04f239408931a673cd30f]) successfully deleted
I20260617 07:53:02.989092 1172 tablet_bootstrap.cc:654] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.989291 1178 tablet_bootstrap.cc:654] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:02.990839 1247 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:37851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:33087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.188
--webserver_port=43207
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 17 Jun 2026 07:43:25 UTC on bdcb31816ec0
build id 12434
ASAN enabled
I20260617 07:53:02.993266 1247 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 07:53:02.995694 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b183bc35a91a499e9072fb1958111c81" } new_table_name: "default.Table_b7a457c62ae64ddbb5d85988bd2992bc" modify_external_catalogs: true
I20260617 07:53:02.995983 1247 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260617 07:53:02.998627 751 tablet_service.cc:1558] Processing DeleteTablet for tablet cad8eca2f4184640a3eba751a7855abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:02.998885 1171 tablet_bootstrap.cc:492] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:02.999053 1171 ts_tablet_manager.cc:1403] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.007s
I20260617 07:53:02.999832 1171 raft_consensus.cc:359] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.000036 1171 raft_consensus.cc:385] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.000131 1171 raft_consensus.cc:740] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.000362 1171 consensus_queue.cc:260] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.001657 1171 ts_tablet_manager.cc:1434] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260617 07:53:03.002018 1171 tablet_bootstrap.cc:492] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:03.002753 1170 tablet_replica.cc:333] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.002975 1170 raft_consensus.cc:2243] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:03.002961 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7582d201bc5843949d4be08ee7586f9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7582d201bc5843949d4be08ee7586f9d already in progress: creating tablet
I20260617 07:53:03.003130 1170 raft_consensus.cc:2272] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.003983 1170 ts_tablet_manager.cc:1916] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.004202 1171 tablet_bootstrap.cc:654] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.006580 1172 tablet_bootstrap.cc:492] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.006742 1172 ts_tablet_manager.cc:1403] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.005s
I20260617 07:53:03.007521 1172 raft_consensus.cc:359] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.007699 1172 raft_consensus.cc:385] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.007802 1172 raft_consensus.cc:740] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.008069 1172 consensus_queue.cc:260] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.010393 1172 ts_tablet_manager.cc:1434] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:03.010773 1172 tablet_bootstrap.cc:492] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.013161 1172 tablet_bootstrap.cc:654] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.015208 530 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ac72fef1251446cbd3975d98fa2f4ae from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:03.018075 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b6f5a943489f4a44a8a7d448f9da6c3f" } modify_external_catalogs: true
I20260617 07:53:03.018252 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b6f5a943489f4a44a8a7d448f9da6c3f" } modify_external_catalogs: true
I20260617 07:53:03.018913 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_7e5bc7ff50154b6ea71d9df096938e22" } modify_external_catalogs: true
I20260617 07:53:03.018985 1172 tablet_bootstrap.cc:492] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.019089 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_7e5bc7ff50154b6ea71d9df096938e22" } modify_external_catalogs: true
I20260617 07:53:03.019158 1172 ts_tablet_manager.cc:1403] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260617 07:53:03.019961 1172 raft_consensus.cc:359] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.020141 1172 raft_consensus.cc:385] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.020216 1172 raft_consensus.cc:740] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.020475 1172 consensus_queue.cc:260] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.023537 1172 ts_tablet_manager.cc:1434] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:03.024678 1299 raft_consensus.cc:493] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.024917 1299 raft_consensus.cc:515] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.025815 1299 leader_election.cc:290] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.027789 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b725166d9c420e9aa4435f707ce6c8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:03.028460 852 leader_election.cc:343] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:03.027160 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b725166d9c420e9aa4435f707ce6c8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:03.029274 1052 raft_consensus.cc:2468] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:03.029928 851 leader_election.cc:304] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:03.030586 1299 raft_consensus.cc:2804] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:03.030690 1299 raft_consensus.cc:493] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:03.030787 1299 raft_consensus.cc:3060] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.031486 526 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet d6ab00c0be9545cc97a0f29d82de4877
W20260617 07:53:03.031422 1336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:53:03.031800 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 074a3e08cc9a4be891016ce197a993be from {username='slave'} at 127.0.0.1:42828
W20260617 07:53:03.035928 1337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:53:03.039772 1299 raft_consensus.cc:515] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.041152 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b725166d9c420e9aa4435f707ce6c8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:03.041400 1052 raft_consensus.cc:3060] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.044725 1052 raft_consensus.cc:2468] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:03.045938 851 leader_election.cc:304] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:03.047307 1299 leader_election.cc:290] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.047483 1299 raft_consensus.cc:2804] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:03.047616 1299 raft_consensus.cc:697] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:03.047797 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b725166d9c420e9aa4435f707ce6c8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:03.047895 1299 consensus_queue.cc:237] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:03.048434 852 leader_election.cc:343] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:03.050752 1229 raft_consensus.cc:493] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.050925 1229 raft_consensus.cc:515] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.051620 1229 leader_election.cc:290] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:03.052115 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad8eca2f4184640a3eba751a7855abb" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:03.052479 1052 raft_consensus.cc:2468] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
W20260617 07:53:03.052583 716 leader_election.cc:343] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: cad8eca2f4184640a3eba751a7855abb
I20260617 07:53:03.053045 713 leader_election.cc:304] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:03.054629 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 (DEFAULT_TABLE table=default.Table_d9199c2565854964a10bba9e6474732f [id=4e86a2cea5304843b61370201d4d13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.055162 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 3f51c76d93674a91b5ada7821393020a (DEFAULT_TABLE table=default.Table_c651ebd3c3eb4bc8a82dea4cf194f571 [id=cdace7368624415da1cd61263240f706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.055368 1030 tablet_service.cc:1511] Processing CreateTablet for tablet ab8388648475499db50cc16a7c36775a (DEFAULT_TABLE table=default.Table_cd29e626941b41bfbd49bec00d3a7315 [id=cd79fc14ef8c46309788c945c6267661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.055872 1032 tablet_service.cc:1511] Processing CreateTablet for tablet d7309d2b22c849ce980fd263a29ac77f (DEFAULT_TABLE table=default.Table_37dfd90d2dcb4616afb087ae9ebfa366 [id=f67703f0a40745f8982b89d83a3ecdea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.056147 1172 tablet_bootstrap.cc:492] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.056391 532 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 8ac72fef1251446cbd3975d98fa2f4ae (table default.Table_2b8844c59c5946fca15f26e8d1463152 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 1 got 0
I20260617 07:53:03.056499 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 (DEFAULT_TABLE table=default.Table_a4b93563d9e4465ca378f7ec12a81250 [id=408ae87558644eb799bec6ab8d1ad2c1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:03.056953 1340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:53:03.058449 1028 tablet_service.cc:1511] Processing CreateTablet for tablet d1c7ced951c34afa8dff243d275bfb36 (DEFAULT_TABLE table=default.Table_b183bc35a91a499e9072fb1958111c81 [id=9726df7d693441359861876ae1179b4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.058701 892 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 (DEFAULT_TABLE table=default.Table_a4b93563d9e4465ca378f7ec12a81250 [id=408ae87558644eb799bec6ab8d1ad2c1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:03.058903 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 2c97be29a90f4b88b568b9f210f94248 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2c97be29a90f4b88b568b9f210f94248 consensus state has no leader
I20260617 07:53:03.059126 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3b5cb887da4d86bdc3d69f350fdb40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.059286 898 tablet_service.cc:1511] Processing CreateTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 (DEFAULT_TABLE table=default.Table_d9199c2565854964a10bba9e6474732f [id=4e86a2cea5304843b61370201d4d13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.059612 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddfb822b5af4bb6b664936c769d9625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.060750 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 19f8525046964950884b0f9aa515ec81 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:03.061026 1175 ts_tablet_manager.cc:1929] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.061103 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.061187 1175 log.cc:1199] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a3b725166d9c420e9aa4435f707ce6c8
I20260617 07:53:03.061954 891 tablet_service.cc:1511] Processing CreateTablet for tablet d1c7ced951c34afa8dff243d275bfb36 (DEFAULT_TABLE table=default.Table_b183bc35a91a499e9072fb1958111c81 [id=9726df7d693441359861876ae1179b4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.062302 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c7ced951c34afa8dff243d275bfb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.062458 1178 tablet_bootstrap.cc:492] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:03.062893 893 tablet_service.cc:1511] Processing CreateTablet for tablet d7309d2b22c849ce980fd263a29ac77f (DEFAULT_TABLE table=default.Table_37dfd90d2dcb4616afb087ae9ebfa366 [id=f67703f0a40745f8982b89d83a3ecdea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.063205 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7309d2b22c849ce980fd263a29ac77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.063218 1178 ts_tablet_manager.cc:1403] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.084s user 0.000s sys 0.003s
I20260617 07:53:03.064074 1178 raft_consensus.cc:359] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.064271 1178 raft_consensus.cc:385] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.064337 1178 raft_consensus.cc:740] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.064548 1178 consensus_queue.cc:260] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.065065 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f51c76d93674a91b5ada7821393020a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.065277 751 tablet_service.cc:1511] Processing CreateTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 (DEFAULT_TABLE table=default.Table_d9199c2565854964a10bba9e6474732f [id=4e86a2cea5304843b61370201d4d13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.065631 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddfb822b5af4bb6b664936c769d9625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.066015 758 tablet_service.cc:1511] Processing CreateTablet for tablet d1c7ced951c34afa8dff243d275bfb36 (DEFAULT_TABLE table=default.Table_b183bc35a91a499e9072fb1958111c81 [id=9726df7d693441359861876ae1179b4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.066502 753 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 (DEFAULT_TABLE table=default.Table_a4b93563d9e4465ca378f7ec12a81250 [id=408ae87558644eb799bec6ab8d1ad2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.066560 896 tablet_service.cc:1511] Processing CreateTablet for tablet ab8388648475499db50cc16a7c36775a (DEFAULT_TABLE table=default.Table_cd29e626941b41bfbd49bec00d3a7315 [id=cd79fc14ef8c46309788c945c6267661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.066876 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8388648475499db50cc16a7c36775a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.066959 757 tablet_service.cc:1511] Processing CreateTablet for tablet ab8388648475499db50cc16a7c36775a (DEFAULT_TABLE table=default.Table_cd29e626941b41bfbd49bec00d3a7315 [id=cd79fc14ef8c46309788c945c6267661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.067400 760 tablet_service.cc:1511] Processing CreateTablet for tablet d7309d2b22c849ce980fd263a29ac77f (DEFAULT_TABLE table=default.Table_37dfd90d2dcb4616afb087ae9ebfa366 [id=f67703f0a40745f8982b89d83a3ecdea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.067870 755 tablet_service.cc:1511] Processing CreateTablet for tablet 3f51c76d93674a91b5ada7821393020a (DEFAULT_TABLE table=default.Table_c651ebd3c3eb4bc8a82dea4cf194f571 [id=cdace7368624415da1cd61263240f706]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:03.069922 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1c7ced951c34afa8dff243d275bfb36 consensus state has no leader
I20260617 07:53:03.069978 897 tablet_service.cc:1511] Processing CreateTablet for tablet 3f51c76d93674a91b5ada7821393020a (DEFAULT_TABLE table=default.Table_c651ebd3c3eb4bc8a82dea4cf194f571 [id=cdace7368624415da1cd61263240f706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.070304 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f51c76d93674a91b5ada7821393020a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.070564 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c7ced951c34afa8dff243d275bfb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.071535 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_754536afb14d459c82f275ef52707a7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.072048 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_754536afb14d459c82f275ef52707a7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.074333 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c7ced951c34afa8dff243d275bfb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.074463 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7309d2b22c849ce980fd263a29ac77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.075162 1172 tablet_bootstrap.cc:654] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.076835 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3b5cb887da4d86bdc3d69f350fdb40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.077663 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8388648475499db50cc16a7c36775a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.077695 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f51c76d93674a91b5ada7821393020a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.078636 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddfb822b5af4bb6b664936c769d9625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.079324 1175 ts_tablet_manager.cc:1950] T a3b725166d9c420e9aa4435f707ce6c8 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:03.079457 1171 tablet_bootstrap.cc:492] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:03.079604 1171 ts_tablet_manager.cc:1403] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.078s user 0.006s sys 0.006s
I20260617 07:53:03.080324 1171 raft_consensus.cc:359] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.080469 1175 tablet_replica.cc:333] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:03.080515 1171 raft_consensus.cc:385] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.080592 1171 raft_consensus.cc:740] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.080642 1175 raft_consensus.cc:2243] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.080813 1175 raft_consensus.cc:2272] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.080821 1171 consensus_queue.cc:260] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:03.081959 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 1481eb3482dd421f94556a1ce32eeed6 because the tablet was not found. No further retry: Not found: Tablet not found: 1481eb3482dd421f94556a1ce32eeed6
I20260617 07:53:03.082693 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7309d2b22c849ce980fd263a29ac77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.083667 1171 ts_tablet_manager.cc:1434] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:03.084823 1171 tablet_bootstrap.cc:492] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:03.085884 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8388648475499db50cc16a7c36775a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.089231 1171 tablet_bootstrap.cc:654] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.091008 1175 ts_tablet_manager.cc:1916] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.091172 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 4996cde4d1514aa081257c802339abe6
I20260617 07:53:03.093233 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 7392ca4ba6a140e19c57e962a26162af
I20260617 07:53:03.094363 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3b5cb887da4d86bdc3d69f350fdb40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:03.100251 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 54296.2us
I20260617 07:53:03.101161 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 7392ca4ba6a140e19c57e962a26162af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.101509 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 4996cde4d1514aa081257c802339abe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.101614 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a3b725166d9c420e9aa4435f707ce6c8 (table default.Table_46e203e35c294f2e936792a24c6b4011 [id=0d7c0472a2d346bdbfbe5d6409b7a3f8]) successfully deleted
W20260617 07:53:03.101887 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet b14f9f70461e49ccb4d318eab824a3e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b14f9f70461e49ccb4d318eab824a3e1 already in progress: creating tablet
I20260617 07:53:03.103693 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 4996cde4d1514aa081257c802339abe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:03.103933 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 7392ca4ba6a140e19c57e962a26162af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:03.104423 1171 tablet_bootstrap.cc:492] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:03.104533 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 82cf9c672f3b4567b63e878a6ab11334
I20260617 07:53:03.104606 1171 ts_tablet_manager.cc:1403] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.007s
I20260617 07:53:03.104557 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 074a3e08cc9a4be891016ce197a993be
I20260617 07:53:03.105093 526 catalog_manager.cc:6784] ReplaceTablet: tablet 074a3e08cc9a4be891016ce197a993be deleted and replaced by tablet cc4d21f9ad9543b0b90fc66f1a6e3b13
I20260617 07:53:03.105396 500 master_runner.cc:187] Error getting master registration for 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111),
I20260617 07:53:03.105571 500 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260617 07:53:03.105648 1171 raft_consensus.cc:359] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.105932 1171 raft_consensus.cc:385] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.106041 1171 raft_consensus.cc:740] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.106364 1171 consensus_queue.cc:260] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.107445 1171 ts_tablet_manager.cc:1434] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260617 07:53:03.057538 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_72eda13c56884241ab3153e5cb1a72d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:03.108259 1171 tablet_bootstrap.cc:492] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:03.108649 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72eda13c56884241ab3153e5cb1a72d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.109573 1178 ts_tablet_manager.cc:1434] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.046s user 0.001s sys 0.002s
I20260617 07:53:03.110042 1343 raft_consensus.cc:493] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:03.110288 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7392ca4ba6a140e19c57e962a26162af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7392ca4ba6a140e19c57e962a26162af already in progress: creating tablet
I20260617 07:53:03.110296 1343 raft_consensus.cc:515] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:03.110524 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4996cde4d1514aa081257c802339abe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4996cde4d1514aa081257c802339abe6 already in progress: creating tablet
I20260617 07:53:03.111455 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b71a3287240a5b15bfd489f514f4c" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:03.111668 917 raft_consensus.cc:2468] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:03.111829 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 074a3e08cc9a4be891016ce197a993be with delete_type TABLET_DATA_DELETED (replaced by tablet cc4d21f9ad9543b0b90fc66f1a6e3b13) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.112126 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 074a3e08cc9a4be891016ce197a993be with delete_type TABLET_DATA_DELETED (replaced by tablet cc4d21f9ad9543b0b90fc66f1a6e3b13) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:03.112174 1343 leader_election.cc:290] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:03.112200 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.112339 1178 tablet_bootstrap.cc:492] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:03.112417 716 leader_election.cc:304] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:03.112684 1343 raft_consensus.cc:2804] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:03.112308 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:03.112794 1343 raft_consensus.cc:493] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:03.112877 1343 raft_consensus.cc:3060] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:03.113168 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 074a3e08cc9a4be891016ce197a993be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 074a3e08cc9a4be891016ce197a993be already in progress: creating tablet
I20260617 07:53:03.114007 1171 tablet_bootstrap.cc:654] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.115269 1178 tablet_bootstrap.cc:654] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:03.116055 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 82cf9c672f3b4567b63e878a6ab11334 because the tablet was not found. No further retry: Not found: Tablet not found: 82cf9c672f3b4567b63e878a6ab11334
I20260617 07:53:03.117473 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a4b93563d9e4465ca378f7ec12a81250" } new_table_name: "default.Table_7a1f339bec3247f88e0532b180d8222a" modify_external_catalogs: true
I20260617 07:53:03.119684 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c4bed0983265433fb2c278c49377729a" } new_table_name: "default.Table_2facd19cc2a947059a467b44b1e2a0b4" modify_external_catalogs: true
I20260617 07:53:03.122143 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 086e43b610f9430c872daeef35c5586a
I20260617 07:53:03.122610 524 catalog_manager.cc:6784] ReplaceTablet: tablet 086e43b610f9430c872daeef35c5586a deleted and replaced by tablet 7934f5fa0287427cb45fe568f0de8758
I20260617 07:53:03.123366 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 086e43b610f9430c872daeef35c5586a with delete_type TABLET_DATA_DELETED (replaced by tablet 7934f5fa0287427cb45fe568f0de8758) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.123221 1171 tablet_bootstrap.cc:492] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:03.123780 1171 ts_tablet_manager.cc:1403] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.007s
I20260617 07:53:03.124364 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_93f67ad8807f4b61a8afe07babb7f45f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.124869 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93f67ad8807f4b61a8afe07babb7f45f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.124879 1171 raft_consensus.cc:359] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.125259 1171 raft_consensus.cc:385] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.125352 1171 raft_consensus.cc:740] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.125651 1171 consensus_queue.cc:260] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.126654 1171 ts_tablet_manager.cc:1434] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:03.126948 1171 tablet_bootstrap.cc:492] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:03.127137 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_2b8844c59c5946fca15f26e8d1463152" } new_table_name: "default.Table_828befbda7ff41f3adf71e43e7adf2e3" modify_external_catalogs: true
I20260617 07:53:03.128784 752 tablet_service.cc:1558] Processing DeleteTablet for tablet b14f9f70461e49ccb4d318eab824a3e1 with delete_type TABLET_DATA_DELETED (replaced by tablet ce1cb2c879e6451886c55907678792de) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:03.129091 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 086e43b610f9430c872daeef35c5586a with delete_type TABLET_DATA_DELETED (replaced by tablet 7934f5fa0287427cb45fe568f0de8758) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:03.129933 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 086e43b610f9430c872daeef35c5586a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 086e43b610f9430c872daeef35c5586a already in progress: creating tablet
I20260617 07:53:03.130080 1171 tablet_bootstrap.cc:654] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.130080 1341 raft_consensus.cc:493] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.130247 1341 raft_consensus.cc:515] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.131206 1341 leader_election.cc:290] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.132287 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbea7b0f024422bc281ea97f6d76d5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:03.132958 852 leader_election.cc:343] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.137120 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 8ac72fef1251446cbd3975d98fa2f4ae
I20260617 07:53:03.137614 530 catalog_manager.cc:6784] ReplaceTablet: tablet 8ac72fef1251446cbd3975d98fa2f4ae deleted and replaced by tablet d8b83fda0ce74779b4cca2ffd2a9b903
I20260617 07:53:03.137540 1343 raft_consensus.cc:515] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.138285 1343 leader_election.cc:290] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:03.138989 523 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 36cbea7b0f024422bc281ea97f6d76d5 (table default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]). Expected version 1 got 0
I20260617 07:53:03.139595 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b71a3287240a5b15bfd489f514f4c" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:03.139819 917 raft_consensus.cc:3060] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.140635 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ac72fef1251446cbd3975d98fa2f4ae with delete_type TABLET_DATA_DELETED (replaced by tablet d8b83fda0ce74779b4cca2ffd2a9b903) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.140944 1169 tablet_replica.cc:333] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:03.141232 1169 raft_consensus.cc:2243] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.141456 1169 raft_consensus.cc:2272] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.141788 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 3f51c76d93674a91b5ada7821393020a
I20260617 07:53:03.142418 1169 ts_tablet_manager.cc:1916] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.144078 917 raft_consensus.cc:2468] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:03.145005 716 leader_election.cc:304] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:03.145294 1343 raft_consensus.cc:2804] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:03.145435 1343 raft_consensus.cc:697] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:03.145823 1343 consensus_queue.cc:237] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.147451 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.147915 898 tablet_service.cc:1511] Processing CreateTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 (DEFAULT_TABLE table=default.Table_5b5a4062a59c4b3f811cc1d4441fd030 [id=f40e523aa8e943dbb46cd015d28c4c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.148188 891 tablet_service.cc:1511] Processing CreateTablet for tablet cc84665c7849469aa27e6505dbed1516 (DEFAULT_TABLE table=default.Table_9ab80d1558c249ce97356577215e7ab1 [id=bb603c5d52014c11bcf699ed474ed98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.148339 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80c2ffcf1b84df0bc6a468ea0929e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.148522 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc84665c7849469aa27e6505dbed1516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.148476 752 tablet_service.cc:1511] Processing CreateTablet for tablet cc84665c7849469aa27e6505dbed1516 (DEFAULT_TABLE table=default.Table_9ab80d1558c249ce97356577215e7ab1 [id=bb603c5d52014c11bcf699ed474ed98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.148900 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc84665c7849469aa27e6505dbed1516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.150023 754 tablet_service.cc:1511] Processing CreateTablet for tablet d21f61a35ca544568bcfca1a6230deca (DEFAULT_TABLE table=default.Table_5c59a8f8f2d44424bdc1f5b1d61d29a9 [id=d270e804a9a84991bcf8bef8fd5c3fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.150409 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21f61a35ca544568bcfca1a6230deca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.147917 896 tablet_service.cc:1511] Processing CreateTablet for tablet d21f61a35ca544568bcfca1a6230deca (DEFAULT_TABLE table=default.Table_5c59a8f8f2d44424bdc1f5b1d61d29a9 [id=d270e804a9a84991bcf8bef8fd5c3fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.153790 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21f61a35ca544568bcfca1a6230deca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.160207 1169 ts_tablet_manager.cc:1929] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.160343 1169 log.cc:1199] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/8ac72fef1251446cbd3975d98fa2f4ae
I20260617 07:53:03.160672 1169 ts_tablet_manager.cc:1950] T 8ac72fef1251446cbd3975d98fa2f4ae P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:03.163324 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 8ac72fef1251446cbd3975d98fa2f4ae (table default.Table_2b8844c59c5946fca15f26e8d1463152 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]) successfully deleted
W20260617 07:53:03.163599 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3f51c76d93674a91b5ada7821393020a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f51c76d93674a91b5ada7821393020a already in progress: creating tablet
I20260617 07:53:03.164635 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_31ff404d1549430d86af35a09cf62ec5" } new_table_name: "default.Table_aaf94418df824d9fa1fdc018d26cf9e7" modify_external_catalogs: true
I20260617 07:53:03.164675 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_1735b3a964d948ea9c83c11e8adf8c68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.165243 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1735b3a964d948ea9c83c11e8adf8c68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.168488 430 master_runner.cc:187] Error getting master registration for 127.0.105.188:33087: Network error: Client connection negotiation failed: client connection to 127.0.105.188:33087: connect: Connection refused (error 111),
I20260617 07:53:03.168707 430 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260617 07:53:03.172474 1171 tablet_bootstrap.cc:492] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:03.172492 1272 raft_consensus.cc:493] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.172731 1171 ts_tablet_manager.cc:1403] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.019s
I20260617 07:53:03.172662 1272 raft_consensus.cc:515] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.173663 1171 raft_consensus.cc:359] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.173879 1171 raft_consensus.cc:385] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.173890 1272 leader_election.cc:290] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:03.174001 1171 raft_consensus.cc:740] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.174347 1171 consensus_queue.cc:260] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.174540 1247 server_base.cc:1061] running on GCE node
I20260617 07:53:03.175391 1171 ts_tablet_manager.cc:1434] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:03.175683 1247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 07:53:03.175884 891 tablet_service.cc:1511] Processing CreateTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 (DEFAULT_TABLE table=default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.176433 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e43e1a3df54efe992a86dd0bd0c149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.180579 898 tablet_service.cc:1511] Processing CreateTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 (DEFAULT_TABLE table=default.Table_109a002e502a44d99c0e775b394e5c38 [id=6f5f5cfa42c54ca3964df6f9e25f18ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.180990 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82cf9c672f3b4567b63e878a6ab11334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.181784 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9db8a986b344548e435b77edc14cb6 (DEFAULT_TABLE table=default.Table_a97317a462514e6384cb34f5fa00851f [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.182202 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9db8a986b344548e435b77edc14cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.187575 1174 raft_consensus.cc:493] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.188881 1174 raft_consensus.cc:515] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.189049 891 tablet_service.cc:1511] Processing CreateTablet for tablet b7d9354c81df42fb9756045e659be26d (DEFAULT_TABLE table=default.Table_06fa0ccce8ce4cfcaccd930305faeec5 [id=cf45ee3bb58a4495a2930179a8532b9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.189373 1171 tablet_bootstrap.cc:492] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:03.189503 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d9354c81df42fb9756045e659be26d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.189555 1174 leader_election.cc:290] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.189848 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b71a3287240a5b15bfd489f514f4c" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:03.190546 1051 raft_consensus.cc:3060] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.192564 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b71a3287240a5b15bfd489f514f4c" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:03.193922 896 tablet_service.cc:1511] Processing CreateTablet for tablet 5a547dabaeb742ba941690f4895955bd (DEFAULT_TABLE table=default.Table_e63db29973b24c64be400ecb2982e867 [id=361b241d29f5458b9bfec6e97c3f37dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.194267 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b71a3287240a5b15bfd489f514f4c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:03.194509 918 raft_consensus.cc:2393] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc3bec007846459a9da0c7b8211e477b in current term 1: Already voted for candidate 6438857e0a7741ceaadf84cb9dc979e7 in this term.
I20260617 07:53:03.194792 897 tablet_service.cc:1511] Processing CreateTablet for tablet 763581e2baeb46149bfb38d81301b9c5 (DEFAULT_TABLE table=default.Table_70aa9f32556b4036ae770c6cb7a2c9e6 [id=2654154ff09642f28fd8510054d7178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.196229 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbea7b0f024422bc281ea97f6d76d5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:03.197743 1050 raft_consensus.cc:2468] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:03.198216 851 leader_election.cc:304] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:03.199004 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a547dabaeb742ba941690f4895955bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.199340 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763581e2baeb46149bfb38d81301b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.200234 1299 raft_consensus.cc:2804] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:03.200337 1299 raft_consensus.cc:493] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:03.200526 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 4996cde4d1514aa081257c802339abe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.200671 1299 raft_consensus.cc:3060] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.200680 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 7392ca4ba6a140e19c57e962a26162af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:03.201054 988 leader_election.cc:343] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 8ac72fef1251446cbd3975d98fa2f4ae
I20260617 07:53:03.202419 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 086e43b610f9430c872daeef35c5586a with delete_type TABLET_DATA_DELETED (replaced by tablet 7934f5fa0287427cb45fe568f0de8758) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.204531 898 tablet_service.cc:1511] Processing CreateTablet for tablet 62b7746239c54ab6828299968d18628d (DEFAULT_TABLE table=default.Table_94ed63316c4c4d0ba63b1088757d1711 [id=0ab7b2d30cea43f0bcfee627747ca777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.208010 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 074a3e08cc9a4be891016ce197a993be with delete_type TABLET_DATA_DELETED (replaced by tablet cc4d21f9ad9543b0b90fc66f1a6e3b13) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.208155 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.211122 1299 raft_consensus.cc:515] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.213496 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.214732 1021 tablet_service.cc:1511] Processing CreateTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 (DEFAULT_TABLE table=default.Table_5b5a4062a59c4b3f811cc1d4441fd030 [id=f40e523aa8e943dbb46cd015d28c4c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.215166 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ac72fef1251446cbd3975d98fa2f4ae with delete_type TABLET_DATA_DELETED (replaced by tablet d8b83fda0ce74779b4cca2ffd2a9b903) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.216917 1171 tablet_bootstrap.cc:654] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.216948 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62b7746239c54ab6828299968d18628d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.217872 1019 tablet_service.cc:1511] Processing CreateTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 (DEFAULT_TABLE table=default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.217947 1024 tablet_service.cc:1511] Processing CreateTablet for tablet d21f61a35ca544568bcfca1a6230deca (DEFAULT_TABLE table=default.Table_5c59a8f8f2d44424bdc1f5b1d61d29a9 [id=d270e804a9a84991bcf8bef8fd5c3fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.219408 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbea7b0f024422bc281ea97f6d76d5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:03.219597 1050 raft_consensus.cc:3060] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.216655 1022 tablet_service.cc:1511] Processing CreateTablet for tablet b7d9354c81df42fb9756045e659be26d (DEFAULT_TABLE table=default.Table_06fa0ccce8ce4cfcaccd930305faeec5 [id=cf45ee3bb58a4495a2930179a8532b9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.220336 1299 leader_election.cc:290] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.222610 1051 raft_consensus.cc:2468] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:03.225090 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80c2ffcf1b84df0bc6a468ea0929e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.225196 1171 tablet_bootstrap.cc:492] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:03.225364 1171 ts_tablet_manager.cc:1403] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260617 07:53:03.226064 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e43e1a3df54efe992a86dd0bd0c149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.226266 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21f61a35ca544568bcfca1a6230deca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.226420 1171 raft_consensus.cc:359] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.226640 1171 raft_consensus.cc:385] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.226646 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d9354c81df42fb9756045e659be26d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.226713 1171 raft_consensus.cc:740] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.227011 1171 consensus_queue.cc:260] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.227638 1171 ts_tablet_manager.cc:1434] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:03.227994 1171 tablet_bootstrap.cc:492] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:03.230149 1171 tablet_bootstrap.cc:654] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.225672 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9db8a986b344548e435b77edc14cb6 (DEFAULT_TABLE table=default.Table_a97317a462514e6384cb34f5fa00851f [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.230623 1247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 07:53:03.236495 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ac72fef1251446cbd3975d98fa2f4ae with delete_type TABLET_DATA_DELETED (replaced by tablet d8b83fda0ce74779b4cca2ffd2a9b903) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:03.236569 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:03.237483 758 tablet_service.cc:1511] Processing CreateTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 (DEFAULT_TABLE table=default.Table_5b5a4062a59c4b3f811cc1d4441fd030 [id=f40e523aa8e943dbb46cd015d28c4c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.224387 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 (DEFAULT_TABLE table=default.Table_109a002e502a44d99c0e775b394e5c38 [id=6f5f5cfa42c54ca3964df6f9e25f18ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.238626 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 1481eb3482dd421f94556a1ce32eeed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.238698 1171 tablet_bootstrap.cc:492] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:03.238818 1171 ts_tablet_manager.cc:1403] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.002s
I20260617 07:53:03.240092 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_868af3e5fa6c43ab8593b4e6a0073a62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.240669 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_868af3e5fa6c43ab8593b4e6a0073a62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.240814 1171 raft_consensus.cc:359] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.240973 1171 raft_consensus.cc:385] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.241047 1171 raft_consensus.cc:740] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.241254 1171 consensus_queue.cc:260] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.241743 1171 ts_tablet_manager.cc:1434] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:03.242184 1171 tablet_bootstrap.cc:492] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:03.239711 1247 hybrid_clock.cc:648] HybridClock initialized: now 1781682783236686 us; error 3027 us; skew 500 ppm
I20260617 07:53:03.243870 1171 tablet_bootstrap.cc:654] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.244307 1247 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 07:53:03.252990 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 62b7746239c54ab6828299968d18628d (DEFAULT_TABLE table=default.Table_94ed63316c4c4d0ba63b1088757d1711 [id=0ab7b2d30cea43f0bcfee627747ca777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.253509 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62b7746239c54ab6828299968d18628d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.256433 1050 raft_consensus.cc:2468] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:03.237483 1020 tablet_service.cc:1511] Processing CreateTablet for tablet cc84665c7849469aa27e6505dbed1516 (DEFAULT_TABLE table=default.Table_9ab80d1558c249ce97356577215e7ab1 [id=bb603c5d52014c11bcf699ed474ed98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.258096 1299 raft_consensus.cc:493] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.258319 1299 raft_consensus.cc:515] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.259142 1299 leader_election.cc:290] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.259749 1247 webserver.cc:533] Webserver started at http://127.0.105.188:43207/ using document root <none> and password file <none>
I20260617 07:53:03.260737 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 19f8525046964950884b0f9aa515ec81
I20260617 07:53:03.261296 527 catalog_manager.cc:6784] ReplaceTablet: tablet 19f8525046964950884b0f9aa515ec81 deleted and replaced by tablet 9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:03.262259 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_2bbb8fb1462c4af1bd93e616c9ba20c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.262934 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bbb8fb1462c4af1bd93e616c9ba20c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.264768 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 19f8525046964950884b0f9aa515ec81 with delete_type TABLET_DATA_DELETED (replaced by tablet 9cddb9e82c354f26b3abe56ebdefd008) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.265623 1299 raft_consensus.cc:493] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.265830 1299 raft_consensus.cc:515] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:03.266084 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 19f8525046964950884b0f9aa515ec81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19f8525046964950884b0f9aa515ec81 already in progress: creating tablet
I20260617 07:53:03.266620 1299 leader_election.cc:290] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:03.266791 1247 fs_manager.cc:362] Metadata directory not provided
I20260617 07:53:03.266992 1247 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260617 07:53:03.267424 988 consensus_peers.cc:597] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9c156733805461ca185f7797525392f. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:03.269160 851 leader_election.cc:304] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:03.269728 1299 raft_consensus.cc:2804] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:03.269923 1299 raft_consensus.cc:697] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:03.270255 1299 consensus_queue.cc:237] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.272773 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d0b4bcb35c42fd8cd2844cd018b634" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:03.273729 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9db8a986b344548e435b77edc14cb6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:03.274488 851 leader_election.cc:343] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.278263 1174 raft_consensus.cc:493] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.278451 1174 raft_consensus.cc:515] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.280257 1247 fs_manager.cc:714] Time spent opening directory manager: real 0.010s user 0.006s sys 0.000s
W20260617 07:53:03.280720 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5203534569bd4da18bc06751f094735f consensus state has no leader
I20260617 07:53:03.280596 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 5a547dabaeb742ba941690f4895955bd (DEFAULT_TABLE table=default.Table_e63db29973b24c64be400ecb2982e867 [id=361b241d29f5458b9bfec6e97c3f37dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.284420 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a479873a764443988e25350cedbbcc16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.288597 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a479873a764443988e25350cedbbcc16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.289742 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 19f8525046964950884b0f9aa515ec81 with delete_type TABLET_DATA_DELETED (replaced by tablet 9cddb9e82c354f26b3abe56ebdefd008) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.289954 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82cf9c672f3b4567b63e878a6ab11334. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:03.290343 988 leader_election.cc:343] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 67a3b2a9dd8f4861b9d1f4ababf3973f
I20260617 07:53:03.291160 1359 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 07:53:03.293234 1247 fs_manager.cc:730] Time spent opening block manager: real 0.010s user 0.006s sys 0.003s
I20260617 07:53:03.294121 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 763581e2baeb46149bfb38d81301b9c5 (DEFAULT_TABLE table=default.Table_70aa9f32556b4036ae770c6cb7a2c9e6 [id=2654154ff09642f28fd8510054d7178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.293438 1247 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data,/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
uuid: "3b274c37ad4445ba8b41d6784b3cd336"
format_stamp: "Formatted at 2026-06-17 07:52:57 on dist-test-slave-v0n2"
I20260617 07:53:03.294550 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc84665c7849469aa27e6505dbed1516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.294764 1174 leader_election.cc:290] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.294606 1247 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 07:53:03.297537 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3b1f601ac04fe996e63725f2d12e56" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:03.299137 851 leader_election.cc:343] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:03.299389 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e3b5cb887da4d86bdc3d69f350fdb40 consensus state has no leader
I20260617 07:53:03.299687 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 4d9d9ed003c64b1abed6bd3bb14456cd from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:03.301996 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_57d8a7f4af774adeb25c6a592b0c0800"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.302565 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57d8a7f4af774adeb25c6a592b0c0800 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.304790 1170 ts_tablet_manager.cc:1929] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.305395 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763581e2baeb46149bfb38d81301b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.305795 1170 log.cc:1199] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a8df3210685244ae8a9b7c9190d619a0
I20260617 07:53:03.306730 1170 ts_tablet_manager.cc:1950] T a8df3210685244ae8a9b7c9190d619a0 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.310289 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_9439306243c4451db8d00e183b7dbeda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.310818 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9439306243c4451db8d00e183b7dbeda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.313584 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a547dabaeb742ba941690f4895955bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.313910 1341 raft_consensus.cc:493] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.314079 1341 raft_consensus.cc:515] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.314819 1341 leader_election.cc:290] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:03.316304 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8b83fda0ce74779b4cca2ffd2a9b903 has no consensus state
I20260617 07:53:03.320931 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_549f28edd3154174b8b8bca2e1ab902e" } modify_external_catalogs: true
I20260617 07:53:03.321134 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_549f28edd3154174b8b8bca2e1ab902e" } modify_external_catalogs: true
I20260617 07:53:03.322044 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_656646625fa14241aca849fa3503ddd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.322604 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_656646625fa14241aca849fa3503ddd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.329344 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2063248863ed46c196c93013230529fe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:03.329981 851 leader_election.cc:343] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:03.330536 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a882ae04eeb94276bb78ded81fbea708 consensus state has no leader
I20260617 07:53:03.333811 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_456aace94223474f82d1801ec38d7b43" } modify_external_catalogs: true
I20260617 07:53:03.333864 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet e364eed959174ef2a8fbbe7bb2215fa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.333967 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_456aace94223474f82d1801ec38d7b43" } modify_external_catalogs: true
I20260617 07:53:03.334475 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 141) took 1040 ms. Trace:
I20260617 07:53:03.334834 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b725166d9c420e9aa4435f707ce6c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:03.344466 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_d9b00fcc7cb444ae897bf42d20cb2e53" } new_table_name: "default.Table_5d59656f1cf74e4dbea879fb08583021" modify_external_catalogs: true
I20260617 07:53:03.354305 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6dd3b32c3f7c4ae58bf47ef40691387e" } modify_external_catalogs: true
I20260617 07:53:03.354511 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6dd3b32c3f7c4ae58bf47ef40691387e" } modify_external_catalogs: true
I20260617 07:53:03.364537 1299 raft_consensus.cc:493] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.364773 1299 raft_consensus.cc:515] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.366206 1299 leader_election.cc:290] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.367746 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294a8bfd35d04105b6bc03946d25c17a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:03.368350 851 leader_election.cc:343] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.368798 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_da86397a452b40d085e68d6df9132dbe" } modify_external_catalogs: true
I20260617 07:53:03.368990 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_da86397a452b40d085e68d6df9132dbe" } modify_external_catalogs: true
I20260617 07:53:03.371984 754 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9db8a986b344548e435b77edc14cb6 (DEFAULT_TABLE table=default.Table_a97317a462514e6384cb34f5fa00851f [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.373799 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b71a3287240a5b15bfd489f514f4c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.373982 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac72fef1251446cbd3975d98fa2f4ae" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.358805 1170 rpcz_store.cc:276] 0617 07:53:02.281608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:02.281657 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:03.002682 (+721025us) ts_tablet_manager.cc:1151] Deleting tablet a8df3210685244ae8a9b7c9190d619a0
0617 07:53:03.002691 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:03.065481 (+ 62790us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:03.304730 (+239249us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:03.321993 (+ 17263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10360,"tablet-delete.queue_time_us":720812}
I20260617 07:53:03.375751 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a8df3210685244ae8a9b7c9190d619a0 (table default.Table_f25afebccc084eb994072fd8ed9f99a6 [id=eac07ff3978e43898764f4ee3bf70397]) successfully deleted
I20260617 07:53:03.375463 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbea7b0f024422bc281ea97f6d76d5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:03.376680 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3b1f601ac04fe996e63725f2d12e56" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:03.378616 986 leader_election.cc:343] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: 67a3b2a9dd8f4861b9d1f4ababf3973f
I20260617 07:53:03.378751 986 leader_election.cc:304] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:03.379149 986 leader_election.cc:304] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:03.379494 986 leader_election.cc:343] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.379601 986 leader_election.cc:304] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:03.379999 1174 raft_consensus.cc:2749] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.380226 1174 raft_consensus.cc:2749] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.380357 1174 raft_consensus.cc:2749] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.381636 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80c2ffcf1b84df0bc6a468ea0929e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.382180 755 tablet_service.cc:1511] Processing CreateTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 (DEFAULT_TABLE table=default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.382730 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9db8a986b344548e435b77edc14cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.383709 1170 tablet_replica.cc:333] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.383945 1170 raft_consensus.cc:2243] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:03.384704 1170 pending_rounds.cc:70] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:03.384785 1170 pending_rounds.cc:77] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772676693393408 op_type: NO_OP noop_request { }
I20260617 07:53:03.385444 1170 raft_consensus.cc:2889] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:03.385576 1170 raft_consensus.cc:2272] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.385751 760 tablet_service.cc:1511] Processing CreateTablet for tablet 5a547dabaeb742ba941690f4895955bd (DEFAULT_TABLE table=default.Table_e63db29973b24c64be400ecb2982e867 [id=361b241d29f5458b9bfec6e97c3f37dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.385646 753 tablet_service.cc:1511] Processing CreateTablet for tablet 62b7746239c54ab6828299968d18628d (DEFAULT_TABLE table=default.Table_94ed63316c4c4d0ba63b1088757d1711 [id=0ab7b2d30cea43f0bcfee627747ca777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.386701 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d0b4bcb35c42fd8cd2844cd018b634" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.394726 1170 ts_tablet_manager.cc:1916] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.395008 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294a8bfd35d04105b6bc03946d25c17a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.395591 752 tablet_service.cc:1511] Processing CreateTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 (DEFAULT_TABLE table=default.Table_109a002e502a44d99c0e775b394e5c38 [id=6f5f5cfa42c54ca3964df6f9e25f18ae]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:03.396660 852 leader_election.cc:343] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:03.397014 852 leader_election.cc:343] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.397135 852 leader_election.cc:304] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:03.397509 852 leader_election.cc:343] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.397646 852 leader_election.cc:304] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:03.397995 852 leader_election.cc:343] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.404469 757 tablet_service.cc:1511] Processing CreateTablet for tablet b7d9354c81df42fb9756045e659be26d (DEFAULT_TABLE table=default.Table_06fa0ccce8ce4cfcaccd930305faeec5 [id=cf45ee3bb58a4495a2930179a8532b9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.404891 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e43e1a3df54efe992a86dd0bd0c149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.405311 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 19f8525046964950884b0f9aa515ec81 with delete_type TABLET_DATA_DELETED (replaced by tablet 9cddb9e82c354f26b3abe56ebdefd008) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:03.407550 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a547dabaeb742ba941690f4895955bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.411235 1247 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 07:53:03.412319 1247 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 07:53:03.412608 1247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 07:53:03.414789 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62b7746239c54ab6828299968d18628d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.417824 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2063248863ed46c196c93013230529fe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.419624 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82cf9c672f3b4567b63e878a6ab11334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.425906 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d9354c81df42fb9756045e659be26d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.426991 1170 ts_tablet_manager.cc:1929] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:03.427170 1170 log.cc:1199] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/c9c156733805461ca185f7797525392f
I20260617 07:53:03.427655 1170 ts_tablet_manager.cc:1950] T c9c156733805461ca185f7797525392f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.429344 852 leader_election.cc:304] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:03.429771 1341 raft_consensus.cc:2749] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.430022 1341 raft_consensus.cc:2749] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.430115 1366 raft_consensus.cc:2749] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:03.432091 852 leader_election.cc:343] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.432284 852 leader_election.cc:304] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:03.432818 1299 raft_consensus.cc:2749] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.436492 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 142) took 1146 ms. Trace:
I20260617 07:53:03.436656 1170 rpcz_store.cc:276] 0617 07:53:02.289633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:02.289698 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:03.374842 (+1085144us) ts_tablet_manager.cc:1151] Deleting tablet c9c156733805461ca185f7797525392f
0617 07:53:03.374851 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:03.412595 (+ 37744us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:03.426899 (+ 14304us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:03.436409 (+ 9510us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1084910}
I20260617 07:53:03.437882 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet c9c156733805461ca185f7797525392f (table default.Table_94ed63316c4c4d0ba63b1088757d1711 [id=0ab7b2d30cea43f0bcfee627747ca777]) successfully deleted
I20260617 07:53:03.438037 758 tablet_service.cc:1511] Processing CreateTablet for tablet 763581e2baeb46149bfb38d81301b9c5 (DEFAULT_TABLE table=default.Table_70aa9f32556b4036ae770c6cb7a2c9e6 [id=2654154ff09642f28fd8510054d7178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.438511 1170 tablet_replica.cc:333] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.438781 1170 raft_consensus.cc:2243] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.439013 1170 raft_consensus.cc:2272] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.439715 1170 ts_tablet_manager.cc:1916] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.450610 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763581e2baeb46149bfb38d81301b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.457365 1172 tablet_bootstrap.cc:492] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.457576 1172 ts_tablet_manager.cc:1403] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.402s user 0.004s sys 0.018s
I20260617 07:53:03.458609 1172 raft_consensus.cc:359] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.458841 1172 raft_consensus.cc:385] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.458947 1172 raft_consensus.cc:740] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.459211 1172 consensus_queue.cc:260] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.460913 1366 raft_consensus.cc:493] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.461071 1366 raft_consensus.cc:515] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.461799 1366 leader_election.cc:290] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.461861 1172 ts_tablet_manager.cc:1434] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260617 07:53:03.463127 1172 tablet_bootstrap.cc:492] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.463985 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3d05dcda274f288aebc279aba3e10a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:03.464242 1051 raft_consensus.cc:2468] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:03.464774 851 leader_election.cc:304] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:03.465308 1366 raft_consensus.cc:2804] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:03.465391 1366 raft_consensus.cc:493] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:03.465476 1366 raft_consensus.cc:3060] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.467530 1172 tablet_bootstrap.cc:654] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.469944 1366 raft_consensus.cc:515] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.470904 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3d05dcda274f288aebc279aba3e10a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:03.471094 1051 raft_consensus.cc:3060] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.474218 1051 raft_consensus.cc:2468] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:03.474352 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3d05dcda274f288aebc279aba3e10a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.474717 851 leader_election.cc:304] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:03.475131 852 leader_election.cc:343] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.475466 1366 leader_election.cc:290] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.475157 1299 raft_consensus.cc:2804] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:03.476578 1299 raft_consensus.cc:697] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:03.476953 1299 consensus_queue.cc:237] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.479588 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3d05dcda274f288aebc279aba3e10a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:03.485232 1170 ts_tablet_manager.cc:1929] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.485416 1170 log.cc:1199] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5f92d26dd0d746a18f88058379ac7b83
I20260617 07:53:03.487555 1172 tablet_bootstrap.cc:492] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.488636 1172 ts_tablet_manager.cc:1403] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260617 07:53:03.490540 1172 raft_consensus.cc:359] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.490999 1172 raft_consensus.cc:385] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.491210 1172 raft_consensus.cc:740] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.491606 1172 consensus_queue.cc:260] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:03.487067 852 leader_election.cc:343] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.493989 1170 ts_tablet_manager.cc:1950] T 5f92d26dd0d746a18f88058379ac7b83 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.494740 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 145) took 1146 ms. Trace:
I20260617 07:53:03.494855 1170 rpcz_store.cc:276] 0617 07:53:02.348081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:02.349049 (+ 968us) service_pool.cc:224] Handling call
0617 07:53:03.438395 (+1089346us) ts_tablet_manager.cc:1151] Deleting tablet 5f92d26dd0d746a18f88058379ac7b83
0617 07:53:03.438412 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:03.455600 (+ 17188us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:03.485103 (+ 29503us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:03.494705 (+ 9602us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1088712}
I20260617 07:53:03.495311 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 5f92d26dd0d746a18f88058379ac7b83 (table default.Table_e93f77eefbea46a6ac71a5b27dc0e63d [id=0e160fc0302048c2aaba651b3e67beb4]) successfully deleted
I20260617 07:53:03.496151 1172 ts_tablet_manager.cc:1434] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:03.497037 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 147) took 1116 ms. Trace:
I20260617 07:53:03.497151 1170 rpcz_store.cc:276] 0617 07:53:02.380100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:02.380157 (+ 57us) service_pool.cc:224] Handling call
0617 07:53:03.496866 (+1116709us) ts_tablet_manager.cc:1151] Deleting tablet 89d0b4bcb35c42fd8cd2844cd018b634
0617 07:53:03.496880 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:03.496991 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1116482}
W20260617 07:53:03.498776 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 89d0b4bcb35c42fd8cd2844cd018b634 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89d0b4bcb35c42fd8cd2844cd018b634 already in progress: creating tablet
I20260617 07:53:03.500030 1170 tablet_replica.cc:333] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.500257 1170 raft_consensus.cc:2243] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.500442 1170 raft_consensus.cc:2272] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.500497 1172 tablet_bootstrap.cc:492] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.500684 1178 tablet_bootstrap.cc:492] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:03.500948 1178 ts_tablet_manager.cc:1403] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.390s user 0.006s sys 0.010s
I20260617 07:53:03.501014 1170 ts_tablet_manager.cc:1916] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.502888 1178 raft_consensus.cc:359] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.503239 1178 raft_consensus.cc:385] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.503415 1178 raft_consensus.cc:740] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.503805 1178 consensus_queue.cc:260] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.506026 1178 ts_tablet_manager.cc:1434] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:03.507710 1172 tablet_bootstrap.cc:654] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.509140 1178 tablet_bootstrap.cc:492] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:03.512074 1178 tablet_bootstrap.cc:654] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.513582 1171 tablet_bootstrap.cc:492] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:03.514173 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 134656us
I20260617 07:53:03.514456 1172 tablet_bootstrap.cc:492] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.514595 1172 ts_tablet_manager.cc:1403] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.003s
I20260617 07:53:03.515213 1272 raft_consensus.cc:493] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.515376 1272 raft_consensus.cc:515] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.516048 1272 leader_election.cc:290] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.516474 1171 ts_tablet_manager.cc:1403] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.272s user 0.057s sys 0.105s
I20260617 07:53:03.517998 1171 raft_consensus.cc:359] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:03.518427 988 leader_election.cc:343] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 2a80c833560f46789a079bd7672e1874
I20260617 07:53:03.518929 1171 raft_consensus.cc:385] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.519121 1171 raft_consensus.cc:740] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.519443 1171 consensus_queue.cc:260] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.520049 1171 ts_tablet_manager.cc:1434] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:03.515213 1364 raft_consensus.cc:493] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.522471 1364 raft_consensus.cc:515] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:03.524845 988 leader_election.cc:343] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 1481eb3482dd421f94556a1ce32eeed6
W20260617 07:53:03.525229 986 leader_election.cc:343] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: 2a80c833560f46789a079bd7672e1874
I20260617 07:53:03.525538 986 leader_election.cc:304] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:03.525413 1364 leader_election.cc:290] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:03.526140 986 leader_election.cc:343] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: 1481eb3482dd421f94556a1ce32eeed6
I20260617 07:53:03.526306 1299 raft_consensus.cc:493] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.526435 527 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 36cbea7b0f024422bc281ea97f6d76d5 (table default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]). Expected version 1 got 0
I20260617 07:53:03.526484 986 leader_election.cc:304] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:03.526464 1299 raft_consensus.cc:515] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.526342 1364 raft_consensus.cc:2749] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.526485 529 catalog_manager.cc:5696] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "6438857e0a7741ceaadf84cb9dc979e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:03.526808 1272 raft_consensus.cc:2749] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.526882 529 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_e4f5053ee058492a96b46167bade387b [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 1 got 0
I20260617 07:53:03.527390 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e364eed959174ef2a8fbbe7bb2215fa1" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:03.527575 1051 raft_consensus.cc:2468] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:03.527973 851 leader_election.cc:304] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:03.528333 1299 leader_election.cc:290] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.528489 1299 raft_consensus.cc:2804] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:03.528559 1299 raft_consensus.cc:493] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:03.528645 1299 raft_consensus.cc:3060] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.529197 1171 tablet_bootstrap.cc:492] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:03.529251 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a3b725166d9c420e9aa4435f707ce6c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:00 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.529498 1169 tablet_replica.cc:333] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:03.529680 1169 raft_consensus.cc:2243] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:03.529948 1169 pending_rounds.cc:70] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:03.530023 1169 pending_rounds.cc:77] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772679366316032 op_type: NO_OP noop_request { }
I20260617 07:53:03.530162 1169 raft_consensus.cc:2889] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:03.530279 1169 raft_consensus.cc:2272] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.530923 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d0b4bcb35c42fd8cd2844cd018b634 with delete_type TABLET_DATA_DELETED (replaced by tablet c7e43e1a3df54efe992a86dd0bd0c149) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.531227 1169 ts_tablet_manager.cc:1916] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.533106 1172 raft_consensus.cc:359] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.533279 1172 raft_consensus.cc:385] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.533363 1172 raft_consensus.cc:740] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.533771 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 with delete_type TABLET_DATA_DELETED (replaced by tablet 82cf9c672f3b4567b63e878a6ab11334) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.534125 1171 tablet_bootstrap.cc:654] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.535627 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 0c21efcad98348ebabcee4821dc4682e (DEFAULT_TABLE table=default.Table_754536afb14d459c82f275ef52707a7f [id=878537b828364bd29c9b6c93591acea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.535741 1172 consensus_queue.cc:260] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.536288 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c21efcad98348ebabcee4821dc4682e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.536477 1172 ts_tablet_manager.cc:1434] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.022s user 0.000s sys 0.002s
I20260617 07:53:03.536780 1172 tablet_bootstrap.cc:492] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.537667 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0c21efcad98348ebabcee4821dc4682e (DEFAULT_TABLE table=default.Table_754536afb14d459c82f275ef52707a7f [id=878537b828364bd29c9b6c93591acea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.538105 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c21efcad98348ebabcee4821dc4682e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.543254 1169 ts_tablet_manager.cc:1929] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:03.545143 1170 ts_tablet_manager.cc:1929] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.545311 1170 log.cc:1199] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0435c4596b2d466c92d89ed41f132ea0
I20260617 07:53:03.545655 1170 ts_tablet_manager.cc:1950] T 0435c4596b2d466c92d89ed41f132ea0 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.547715 1169 log.cc:1199] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a3b725166d9c420e9aa4435f707ce6c8
I20260617 07:53:03.548197 1169 ts_tablet_manager.cc:1950] T a3b725166d9c420e9aa4435f707ce6c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:03.546984 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 39b291b1c9794faa9305f7d936604a44 (DEFAULT_TABLE table=default.Table_94ca7e593fc74524abf0ef739e7f986b [id=1951a43bb71a41bfaa40c0d3bedc99d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.549161 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b291b1c9794faa9305f7d936604a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.547119 898 tablet_service.cc:1511] Processing CreateTablet for tablet 39b291b1c9794faa9305f7d936604a44 (DEFAULT_TABLE table=default.Table_94ca7e593fc74524abf0ef739e7f986b [id=1951a43bb71a41bfaa40c0d3bedc99d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.550102 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b291b1c9794faa9305f7d936604a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.551762 1169 tablet_replica.cc:333] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:03.553604 1169 raft_consensus.cc:2243] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.553887 1169 raft_consensus.cc:2272] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.554121 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a3b725166d9c420e9aa4435f707ce6c8 (table default.Table_46e203e35c294f2e936792a24c6b4011 [id=0d7c0472a2d346bdbfbe5d6409b7a3f8]) successfully deleted
I20260617 07:53:03.554471 1169 ts_tablet_manager.cc:1916] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.556679 891 tablet_service.cc:1511] Processing CreateTablet for tablet df705c2300064db680bec1fefab08d2f (DEFAULT_TABLE table=default.Table_d9b00fcc7cb444ae897bf42d20cb2e53 [id=e6636bb52b0b42028b8a92ebeee0a41d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.557060 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df705c2300064db680bec1fefab08d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.560798 1169 ts_tablet_manager.cc:1929] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.561863 1030 tablet_service.cc:1511] Processing CreateTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 (DEFAULT_TABLE table=default.Table_bbc95ce139d8435387c7952fa8812d3b [id=7a019b84bca74a3cbd26a8fe985488ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.562260 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.563848 1172 tablet_bootstrap.cc:654] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.565249 1020 tablet_service.cc:1511] Processing CreateTablet for tablet b7c5ff28367b42d3a3922d2b789bc7ec (DEFAULT_TABLE table=default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 [id=d079dbab725b43c0807868020b551ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.565764 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c5ff28367b42d3a3922d2b789bc7ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.561198 896 tablet_service.cc:1511] Processing CreateTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 (DEFAULT_TABLE table=default.Table_bbc95ce139d8435387c7952fa8812d3b [id=7a019b84bca74a3cbd26a8fe985488ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.566740 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.565243 1023 tablet_service.cc:1511] Processing CreateTablet for tablet df705c2300064db680bec1fefab08d2f (DEFAULT_TABLE table=default.Table_d9b00fcc7cb444ae897bf42d20cb2e53 [id=e6636bb52b0b42028b8a92ebeee0a41d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.568173 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df705c2300064db680bec1fefab08d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.566716 1366 raft_consensus.cc:493] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.572760 1366 raft_consensus.cc:515] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.561398 1299 raft_consensus.cc:515] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.565797 897 tablet_service.cc:1511] Processing CreateTablet for tablet b7c5ff28367b42d3a3922d2b789bc7ec (DEFAULT_TABLE table=default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 [id=d079dbab725b43c0807868020b551ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.573904 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c5ff28367b42d3a3922d2b789bc7ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.573897 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31fba373a214b5a96bd11b930ed3b86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:03.574467 851 leader_election.cc:343] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.574863 1366 leader_election.cc:290] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:03.576627 1366 raft_consensus.cc:493] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.576768 1366 raft_consensus.cc:515] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.578523 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ee285802f47b98c152daad8cfd9d7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:03.579135 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 0435c4596b2d466c92d89ed41f132ea0 (table default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35 [id=0552acfce4294af484ccd1f88c42c4cb]) successfully deleted
W20260617 07:53:03.579368 851 leader_election.cc:343] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.579859 1366 leader_election.cc:290] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.580368 1170 tablet_replica.cc:333] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.581372 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e364eed959174ef2a8fbbe7bb2215fa1" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:03.581548 1051 raft_consensus.cc:3060] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.584349 1051 raft_consensus.cc:2468] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:03.584960 851 leader_election.cc:304] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:03.585494 1366 raft_consensus.cc:2804] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:03.585696 1366 raft_consensus.cc:697] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:03.580587 1170 raft_consensus.cc:2243] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.587019 1170 raft_consensus.cc:2272] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.587548 1366 consensus_queue.cc:237] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.587708 1170 ts_tablet_manager.cc:1916] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.587944 1299 leader_election.cc:290] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.566298 1171 tablet_bootstrap.cc:492] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:03.589564 1171 ts_tablet_manager.cc:1403] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.000s
I20260617 07:53:03.590776 1171 raft_consensus.cc:359] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.591020 1171 raft_consensus.cc:385] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.591167 1171 raft_consensus.cc:740] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.591446 1171 consensus_queue.cc:260] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.592068 1171 ts_tablet_manager.cc:1434] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:03.592758 1171 tablet_bootstrap.cc:492] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:03.596549 1172 tablet_bootstrap.cc:492] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.596827 1172 ts_tablet_manager.cc:1403] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.002s
I20260617 07:53:03.597681 1172 raft_consensus.cc:359] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.597973 1172 raft_consensus.cc:385] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.598093 1172 raft_consensus.cc:740] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.598408 1172 consensus_queue.cc:260] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.598994 1169 log.cc:1199] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/89d0b4bcb35c42fd8cd2844cd018b634
I20260617 07:53:03.599747 1172 ts_tablet_manager.cc:1434] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 07:53:03.600214 1169 ts_tablet_manager.cc:1950] T 89d0b4bcb35c42fd8cd2844cd018b634 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:03.599262 1171 tablet_bootstrap.cc:654] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.603866 1172 tablet_bootstrap.cc:492] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.605454 1169 tablet_replica.cc:333] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:03.605747 1169 raft_consensus.cc:2243] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.605963 1169 raft_consensus.cc:2272] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.606429 1170 ts_tablet_manager.cc:1929] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.606557 1170 log.cc:1199] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/67a3b2a9dd8f4861b9d1f4ababf3973f
I20260617 07:53:03.606940 1170 ts_tablet_manager.cc:1950] T 67a3b2a9dd8f4861b9d1f4ababf3973f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.607219 1169 ts_tablet_manager.cc:1916] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.607755 1172 tablet_bootstrap.cc:654] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.608204 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 67a3b2a9dd8f4861b9d1f4ababf3973f (table default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23]) successfully deleted
I20260617 07:53:03.612325 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 89d0b4bcb35c42fd8cd2844cd018b634 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
W20260617 07:53:03.614454 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4d9d9ed003c64b1abed6bd3bb14456cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9d9ed003c64b1abed6bd3bb14456cd already in progress: creating tablet
W20260617 07:53:03.615618 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 69996eb4ab6e40f9b2d97e00d766822a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69996eb4ab6e40f9b2d97e00d766822a already in progress: creating tablet
I20260617 07:53:03.615949 1170 tablet_replica.cc:333] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.616252 1170 raft_consensus.cc:2243] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.616477 1170 raft_consensus.cc:2272] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.617141 1170 ts_tablet_manager.cc:1916] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.624940 1169 ts_tablet_manager.cc:1929] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.626892 1172 tablet_bootstrap.cc:492] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.627556 1030 tablet_service.cc:1511] Processing CreateTablet for tablet df5bbdbcf3044128a4cb274f83d5d29b (DEFAULT_TABLE table=default.Table_d96805f03e8f47b58040c4896878c01e [id=e42c6141367a4922ace753fd8ccf8463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.628021 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5bbdbcf3044128a4cb274f83d5d29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.630010 1170 ts_tablet_manager.cc:1929] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.630144 1170 log.cc:1199] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/52e9dc5fcd034eaab7a5548bccebd134
I20260617 07:53:03.631484 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f (DEFAULT_TABLE table=default.Table_90eee67c1b8d48cfac17fa339cb10a2b [id=951e230ec1f84717b9ed7d19f4dfbc16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.632000 1172 ts_tablet_manager.cc:1403] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.005s
I20260617 07:53:03.632056 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.635155 1170 ts_tablet_manager.cc:1950] T 52e9dc5fcd034eaab7a5548bccebd134 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.636611 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adee4d54cd94c4b9c45991762d91622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:03.637197 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 06e0f2f9a75d4f9ba8702e4da75c042f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06e0f2f9a75d4f9ba8702e4da75c042f already in progress: creating tablet
W20260617 07:53:03.638096 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 950c1c44020a4586b3197f5f68a38963 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 950c1c44020a4586b3197f5f68a38963 already in progress: creating tablet
W20260617 07:53:03.639788 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0dc0676db18c42259efb1ad7dbd140c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dc0676db18c42259efb1ad7dbd140c8 already in progress: creating tablet
I20260617 07:53:03.640120 1170 tablet_replica.cc:333] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.640347 1170 raft_consensus.cc:2243] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.640527 1170 raft_consensus.cc:2272] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.641036 1170 ts_tablet_manager.cc:1916] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.641980 1172 raft_consensus.cc:359] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.642161 1172 raft_consensus.cc:385] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.642258 1172 raft_consensus.cc:740] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.642486 1172 consensus_queue.cc:260] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.642982 1172 ts_tablet_manager.cc:1434] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:03.626358 891 tablet_service.cc:1511] Processing CreateTablet for tablet df5bbdbcf3044128a4cb274f83d5d29b (DEFAULT_TABLE table=default.Table_d96805f03e8f47b58040c4896878c01e [id=e42c6141367a4922ace753fd8ccf8463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.627653 1171 tablet_bootstrap.cc:492] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:03.630759 897 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f (DEFAULT_TABLE table=default.Table_90eee67c1b8d48cfac17fa339cb10a2b [id=951e230ec1f84717b9ed7d19f4dfbc16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.635720 896 tablet_service.cc:1511] Processing CreateTablet for tablet 28e1fd7f91f94221884be2166f0cc793 (DEFAULT_TABLE table=default.Table_11a8e4d802dd415ca735ae9375de8ce7 [id=d98cbc567cf246c98834f633ba6f8a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.643508 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5bbdbcf3044128a4cb274f83d5d29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.643776 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e1fd7f91f94221884be2166f0cc793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.644794 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.643618 1171 ts_tablet_manager.cc:1403] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.051s user 0.006s sys 0.002s
I20260617 07:53:03.650713 1171 raft_consensus.cc:359] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.650962 1171 raft_consensus.cc:385] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.651504 1171 raft_consensus.cc:740] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.651784 1171 consensus_queue.cc:260] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.653120 1171 ts_tablet_manager.cc:1434] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:03.653252 1169 log.cc:1199] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/076c6f6f406842ceb3db75e886e3ce50
I20260617 07:53:03.653661 1169 ts_tablet_manager.cc:1950] T 076c6f6f406842ceb3db75e886e3ce50 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:03.654136 1171 tablet_bootstrap.cc:492] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:03.655963 1171 tablet_bootstrap.cc:654] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.657569 1172 tablet_bootstrap.cc:492] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.659760 1172 tablet_bootstrap.cc:654] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.662127 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 076c6f6f406842ceb3db75e886e3ce50 (table default.Table_109a002e502a44d99c0e775b394e5c38 [id=6f5f5cfa42c54ca3964df6f9e25f18ae]) successfully deleted
I20260617 07:53:03.663281 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 28e1fd7f91f94221884be2166f0cc793 (DEFAULT_TABLE table=default.Table_11a8e4d802dd415ca735ae9375de8ce7 [id=d98cbc567cf246c98834f633ba6f8a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.663756 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e1fd7f91f94221884be2166f0cc793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.513552 1175 ts_tablet_manager.cc:1929] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.532282 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e364eed959174ef2a8fbbe7bb2215fa1" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.555080 753 tablet_service.cc:1511] Processing CreateTablet for tablet df705c2300064db680bec1fefab08d2f (DEFAULT_TABLE table=default.Table_d9b00fcc7cb444ae897bf42d20cb2e53 [id=e6636bb52b0b42028b8a92ebeee0a41d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.563330 760 tablet_service.cc:1511] Processing CreateTablet for tablet b7c5ff28367b42d3a3922d2b789bc7ec (DEFAULT_TABLE table=default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 [id=d079dbab725b43c0807868020b551ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.673529 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c5ff28367b42d3a3922d2b789bc7ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:03.675489 852 leader_election.cc:343] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.675591 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df705c2300064db680bec1fefab08d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.678777 1364 raft_consensus.cc:493] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.678963 1364 raft_consensus.cc:515] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.679800 1364 leader_election.cc:290] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:03.680241 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14f9f70461e49ccb4d318eab824a3e1" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.680428 779 raft_consensus.cc:2468] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
W20260617 07:53:03.680742 988 leader_election.cc:343] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: b14f9f70461e49ccb4d318eab824a3e1
I20260617 07:53:03.680902 988 leader_election.cc:304] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:03.681329 1364 raft_consensus.cc:2804] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:03.681456 1364 raft_consensus.cc:493] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:03.681548 1364 raft_consensus.cc:3060] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.684710 1364 raft_consensus.cc:515] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.685750 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14f9f70461e49ccb4d318eab824a3e1" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:03.685938 779 raft_consensus.cc:3060] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.574236 755 tablet_service.cc:1511] Processing CreateTablet for tablet 39b291b1c9794faa9305f7d936604a44 (DEFAULT_TABLE table=default.Table_94ca7e593fc74524abf0ef739e7f986b [id=1951a43bb71a41bfaa40c0d3bedc99d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.575165 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31fba373a214b5a96bd11b930ed3b86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:03.687808 852 leader_election.cc:343] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.687995 852 leader_election.cc:304] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:03.688529 1366 raft_consensus.cc:2749] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.688879 1170 ts_tablet_manager.cc:1929] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.688992 1170 log.cc:1199] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/2a80c833560f46789a079bd7672e1874
I20260617 07:53:03.579833 757 tablet_service.cc:1511] Processing CreateTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 (DEFAULT_TABLE table=default.Table_bbc95ce139d8435387c7952fa8812d3b [id=7a019b84bca74a3cbd26a8fe985488ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.689368 1170 ts_tablet_manager.cc:1950] T 2a80c833560f46789a079bd7672e1874 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.689525 1364 leader_election.cc:290] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:03.690490 1170 tablet_replica.cc:333] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:03.690466 988 leader_election.cc:343] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: b14f9f70461e49ccb4d318eab824a3e1
I20260617 07:53:03.580294 752 tablet_service.cc:1511] Processing CreateTablet for tablet 0c21efcad98348ebabcee4821dc4682e (DEFAULT_TABLE table=default.Table_754536afb14d459c82f275ef52707a7f [id=878537b828364bd29c9b6c93591acea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.580385 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ee285802f47b98c152daad8cfd9d7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.690732 1170 raft_consensus.cc:2243] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.588595 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e364eed959174ef2a8fbbe7bb2215fa1" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:03.626117 754 tablet_service.cc:1511] Processing CreateTablet for tablet df5bbdbcf3044128a4cb274f83d5d29b (DEFAULT_TABLE table=default.Table_d96805f03e8f47b58040c4896878c01e [id=e42c6141367a4922ace753fd8ccf8463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.690795 1172 tablet_bootstrap.cc:492] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.629052 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f (DEFAULT_TABLE table=default.Table_90eee67c1b8d48cfac17fa339cb10a2b [id=951e230ec1f84717b9ed7d19f4dfbc16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.634526 756 tablet_service.cc:1511] Processing CreateTablet for tablet 28e1fd7f91f94221884be2166f0cc793 (DEFAULT_TABLE table=default.Table_11a8e4d802dd415ca735ae9375de8ce7 [id=d98cbc567cf246c98834f633ba6f8a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.691092 1172 ts_tablet_manager.cc:1403] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.007s
W20260617 07:53:03.691071 852 leader_election.cc:343] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.671082 758 tablet_service.cc:1511] Processing CreateTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 (DEFAULT_TABLE table=default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.691193 852 leader_election.cc:304] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:03.691470 1366 raft_consensus.cc:2749] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.690896 1170 raft_consensus.cc:2272] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.692247 1170 ts_tablet_manager.cc:1916] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.692526 1172 raft_consensus.cc:359] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.692729 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b291b1c9794faa9305f7d936604a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.692781 1172 raft_consensus.cc:385] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.692875 1172 raft_consensus.cc:740] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.693915 1172 consensus_queue.cc:260] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:03.695600 852 leader_election.cc:343] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.696728 1172 ts_tablet_manager.cc:1434] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260617 07:53:03.698086 779 raft_consensus.cc:2468] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:03.698558 986 leader_election.cc:304] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:03.698782 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.699056 1364 raft_consensus.cc:2804] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:03.699772 1364 raft_consensus.cc:697] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:03.700328 1170 ts_tablet_manager.cc:1929] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.700451 1170 log.cc:1199] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/cad8eca2f4184640a3eba751a7855abb
I20260617 07:53:03.700258 1364 consensus_queue.cc:237] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.700775 1170 ts_tablet_manager.cc:1950] T cad8eca2f4184640a3eba751a7855abb P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.701972 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.702026 1170 tablet_replica.cc:333] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.702728 1170 raft_consensus.cc:2243] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:03.702979 1170 pending_rounds.cc:70] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:03.703052 1170 pending_rounds.cc:77] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772682043568128 op_type: NO_OP noop_request { }
I20260617 07:53:03.703181 1170 raft_consensus.cc:2889] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:03.703392 1170 raft_consensus.cc:2272] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.704290 1172 tablet_bootstrap.cc:492] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:03.704522 1381 consensus_queue.cc:1175] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dc3bec007846459a9da0c7b8211e477b" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260617 07:53:03.705283 1170 ts_tablet_manager.cc:1916] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.706151 1172 tablet_bootstrap.cc:654] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.709806 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5bbdbcf3044128a4cb274f83d5d29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.711365 1172 tablet_bootstrap.cc:492] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.711513 1172 ts_tablet_manager.cc:1403] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260617 07:53:03.704656 1175 log.cc:1199] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/cad8eca2f4184640a3eba751a7855abb
I20260617 07:53:03.712448 1172 raft_consensus.cc:359] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.712625 1172 raft_consensus.cc:385] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.712714 1172 raft_consensus.cc:740] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.714078 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e1fd7f91f94221884be2166f0cc793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.714568 1170 ts_tablet_manager.cc:1929] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:03.714840 1170 log.cc:1199] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/b14f9f70461e49ccb4d318eab824a3e1
I20260617 07:53:03.714901 1172 consensus_queue.cc:260] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.715498 1170 ts_tablet_manager.cc:1950] T b14f9f70461e49ccb4d318eab824a3e1 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.717464 1172 ts_tablet_manager.cc:1434] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260617 07:53:03.717491 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c21efcad98348ebabcee4821dc4682e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.717763 1172 tablet_bootstrap.cc:492] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.717981 1170 tablet_replica.cc:333] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.718233 1170 raft_consensus.cc:2243] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.718797 1170 raft_consensus.cc:2272] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.719734 1170 ts_tablet_manager.cc:1916] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.720037 1175 ts_tablet_manager.cc:1950] T cad8eca2f4184640a3eba751a7855abb P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:03.721359 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet cad8eca2f4184640a3eba751a7855abb (table default.Table_4d662781dac64b4eadfe4c99fb6515db [id=6323ccf9b79a4d01835f788a87d0c724]) successfully deleted
W20260617 07:53:03.721639 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4996cde4d1514aa081257c802339abe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4996cde4d1514aa081257c802339abe6 already in progress: creating tablet
W20260617 07:53:03.721889 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7392ca4ba6a140e19c57e962a26162af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7392ca4ba6a140e19c57e962a26162af already in progress: creating tablet
I20260617 07:53:03.721920 1172 tablet_bootstrap.cc:654] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.727918 1170 ts_tablet_manager.cc:1929] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.728070 1170 log.cc:1199] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/086e43b610f9430c872daeef35c5586a
I20260617 07:53:03.728504 1170 ts_tablet_manager.cc:1950] T 086e43b610f9430c872daeef35c5586a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.731233 1170 tablet_replica.cc:333] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.731468 1170 raft_consensus.cc:2243] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.731655 1170 raft_consensus.cc:2272] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.732378 1170 ts_tablet_manager.cc:1916] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.739168 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cddb9e82c354f26b3abe56ebdefd008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.740330 1170 ts_tablet_manager.cc:1929] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.740494 1170 log.cc:1199] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/8ac72fef1251446cbd3975d98fa2f4ae
I20260617 07:53:03.740914 1170 ts_tablet_manager.cc:1950] T 8ac72fef1251446cbd3975d98fa2f4ae P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.742494 1172 tablet_bootstrap.cc:492] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.742682 1172 ts_tablet_manager.cc:1403] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.003s
I20260617 07:53:03.743854 1172 raft_consensus.cc:359] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.744098 1172 raft_consensus.cc:385] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.744194 1172 raft_consensus.cc:740] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.744494 1172 consensus_queue.cc:260] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:03.744835 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 074a3e08cc9a4be891016ce197a993be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 074a3e08cc9a4be891016ce197a993be already in progress: creating tablet
I20260617 07:53:03.745934 1172 ts_tablet_manager.cc:1434] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 07:53:03.747327 1172 tablet_bootstrap.cc:492] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:03.748739 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 82cf9c672f3b4567b63e878a6ab11334 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82cf9c672f3b4567b63e878a6ab11334 already in progress: creating tablet
I20260617 07:53:03.749589 1172 tablet_bootstrap.cc:654] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.751250 1170 tablet_replica.cc:333] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.751513 1170 raft_consensus.cc:2243] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.751713 1170 raft_consensus.cc:2272] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.752405 1170 ts_tablet_manager.cc:1916] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.752772 1175 tablet_replica.cc:333] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:03.753086 1175 raft_consensus.cc:2243] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.753358 1175 raft_consensus.cc:2272] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.754093 1175 ts_tablet_manager.cc:1916] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.761204 1170 ts_tablet_manager.cc:1929] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.761363 1170 log.cc:1199] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/1481eb3482dd421f94556a1ce32eeed6
I20260617 07:53:03.761623 1366 raft_consensus.cc:493] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.761899 1170 ts_tablet_manager.cc:1950] T 1481eb3482dd421f94556a1ce32eeed6 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.761859 1366 raft_consensus.cc:515] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.762598 1172 tablet_bootstrap.cc:492] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.762746 1172 ts_tablet_manager.cc:1403] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.003s
I20260617 07:53:03.762753 1366 leader_election.cc:290] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.763267 1170 tablet_replica.cc:333] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.763470 1170 raft_consensus.cc:2243] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.763631 1170 raft_consensus.cc:2272] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.763576 1172 raft_consensus.cc:359] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.763767 1172 raft_consensus.cc:385] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.763756 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adee4d54cd94c4b9c45991762d91622" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:03.763904 1172 raft_consensus.cc:740] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.764050 1051 raft_consensus.cc:2468] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:03.764139 1170 ts_tablet_manager.cc:1916] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.764138 1172 consensus_queue.cc:260] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.764719 1172 ts_tablet_manager.cc:1434] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:03.764776 851 leader_election.cc:304] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:03.765012 1172 tablet_bootstrap.cc:492] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.765228 1366 raft_consensus.cc:2804] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:03.765373 1366 raft_consensus.cc:493] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:03.765475 1366 raft_consensus.cc:3060] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.766774 1172 tablet_bootstrap.cc:654] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.769061 1366 raft_consensus.cc:515] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.770442 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adee4d54cd94c4b9c45991762d91622" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:03.770649 1051 raft_consensus.cc:3060] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.770704 1172 tablet_bootstrap.cc:492] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.770865 1172 ts_tablet_manager.cc:1403] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260617 07:53:03.771665 1172 raft_consensus.cc:359] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.772311 1172 raft_consensus.cc:385] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.772409 1172 raft_consensus.cc:740] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.772637 1170 ts_tablet_manager.cc:1929] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.772682 1172 consensus_queue.cc:260] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.772814 1170 log.cc:1199] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/e364eed959174ef2a8fbbe7bb2215fa1
I20260617 07:53:03.773322 1172 ts_tablet_manager.cc:1434] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:03.773605 1172 tablet_bootstrap.cc:492] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.774214 1170 ts_tablet_manager.cc:1950] T e364eed959174ef2a8fbbe7bb2215fa1 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.774855 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adee4d54cd94c4b9c45991762d91622" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.775375 1172 tablet_bootstrap.cc:654] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:03.775525 852 leader_election.cc:343] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.775585 1051 raft_consensus.cc:2468] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:03.776314 851 leader_election.cc:304] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:03.776618 1299 raft_consensus.cc:2804] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:03.776809 1299 raft_consensus.cc:697] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:03.777000 1170 tablet_replica.cc:333] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.777084 1299 consensus_queue.cc:237] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.777187 1170 raft_consensus.cc:2243] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.777340 1170 raft_consensus.cc:2272] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.777885 1170 ts_tablet_manager.cc:1916] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.778121 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adee4d54cd94c4b9c45991762d91622" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:03.779644 852 leader_election.cc:343] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.779906 1366 leader_election.cc:290] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.786478 1170 ts_tablet_manager.cc:1929] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.786630 1170 log.cc:1199] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a3b725166d9c420e9aa4435f707ce6c8
I20260617 07:53:03.787492 1170 ts_tablet_manager.cc:1950] T a3b725166d9c420e9aa4435f707ce6c8 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:03.790694 1172 tablet_bootstrap.cc:492] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.790889 1172 ts_tablet_manager.cc:1403] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260617 07:53:03.791939 1172 raft_consensus.cc:359] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.792188 1172 raft_consensus.cc:385] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.792275 1172 raft_consensus.cc:740] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.792539 1172 consensus_queue.cc:260] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.805187 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 (DEFAULT_TABLE table=default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.805941 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cddb9e82c354f26b3abe56ebdefd008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.805917 1172 ts_tablet_manager.cc:1434] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.015s user 0.001s sys 0.002s
I20260617 07:53:03.806296 1172 tablet_bootstrap.cc:492] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.808521 1172 tablet_bootstrap.cc:654] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.809790 1170 tablet_replica.cc:333] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:03.810089 1170 raft_consensus.cc:2243] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:03.810743 1170 raft_consensus.cc:2272] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:03.815641 1364 raft_consensus.cc:493] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.815832 1364 raft_consensus.cc:515] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.816547 1364 leader_election.cc:290] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:03.818259 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2063248863ed46c196c93013230529fe" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.818452 1170 ts_tablet_manager.cc:1916] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:03.818550 1172 tablet_bootstrap.cc:492] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.818706 1172 ts_tablet_manager.cc:1403] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s
W20260617 07:53:03.819357 986 leader_election.cc:343] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.819808 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2063248863ed46c196c93013230529fe" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:03.820089 917 raft_consensus.cc:2468] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:03.820061 1172 raft_consensus.cc:359] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.820276 1172 raft_consensus.cc:385] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.820360 1172 raft_consensus.cc:740] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.820627 1172 consensus_queue.cc:260] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.821192 1172 ts_tablet_manager.cc:1434] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:03.821693 988 leader_election.cc:304] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:03.823809 1364 raft_consensus.cc:2804] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:03.823922 1364 raft_consensus.cc:493] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:03.824091 1364 raft_consensus.cc:3060] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.824184 1172 tablet_bootstrap.cc:492] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:03.826505 1170 ts_tablet_manager.cc:1929] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:03.826650 1170 log.cc:1199] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5adee4d54cd94c4b9c45991762d91622
I20260617 07:53:03.826867 1364 raft_consensus.cc:515] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.827230 1172 tablet_bootstrap.cc:654] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.828071 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2063248863ed46c196c93013230529fe" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:03.828678 986 leader_election.cc:343] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.829782 897 tablet_service.cc:1511] Processing CreateTablet for tablet ce1cb2c879e6451886c55907678792de (DEFAULT_TABLE table=default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.829913 1364 leader_election.cc:290] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:03.830333 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1cb2c879e6451886c55907678792de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.834264 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2063248863ed46c196c93013230529fe" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:03.834544 917 raft_consensus.cc:3060] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.835320 1172 tablet_bootstrap.cc:492] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:03.835454 1172 ts_tablet_manager.cc:1403] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260617 07:53:03.836304 1172 raft_consensus.cc:359] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.836468 1172 raft_consensus.cc:385] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.836553 1172 raft_consensus.cc:740] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.836755 1172 consensus_queue.cc:260] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.838080 1343 raft_consensus.cc:493] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.838254 1343 raft_consensus.cc:515] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.838460 1172 ts_tablet_manager.cc:1434] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:03.838932 1343 leader_election.cc:290] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:03.838728 1172 tablet_bootstrap.cc:492] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:03.839965 716 leader_election.cc:343] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 8ac72fef1251446cbd3975d98fa2f4ae
I20260617 07:53:03.841398 1172 tablet_bootstrap.cc:654] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:03.827034 1170 ts_tablet_manager.cc:1950] T 5adee4d54cd94c4b9c45991762d91622 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:03.846640 713 leader_election.cc:343] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 8ac72fef1251446cbd3975d98fa2f4ae
I20260617 07:53:03.846844 713 leader_election.cc:304] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:03.847512 1343 raft_consensus.cc:2749] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:03.850603 917 raft_consensus.cc:2468] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:03.851419 988 leader_election.cc:304] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:03.851997 1364 raft_consensus.cc:2804] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:03.852211 1364 raft_consensus.cc:697] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:03.852591 1364 consensus_queue.cc:237] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:03.862238 753 tablet_service.cc:1511] Processing CreateTablet for tablet ce1cb2c879e6451886c55907678792de (DEFAULT_TABLE table=default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.862928 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1cb2c879e6451886c55907678792de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:03.870064 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:41615, user_credentials={real_user=slave}} blocked reactor thread for 205246us
I20260617 07:53:03.871152 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 2a80c833560f46789a079bd7672e1874 (table default.Table_57339f59d3434cc6aa87310f32242731 [id=719427e0fac94f51a2d5189178be5a9f]) successfully deleted
I20260617 07:53:03.871428 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet cad8eca2f4184640a3eba751a7855abb (table default.Table_4d662781dac64b4eadfe4c99fb6515db [id=6323ccf9b79a4d01835f788a87d0c724]) successfully deleted
I20260617 07:53:03.871735 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet b14f9f70461e49ccb4d318eab824a3e1 (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]) successfully deleted
W20260617 07:53:03.872020 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4996cde4d1514aa081257c802339abe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4996cde4d1514aa081257c802339abe6 already in progress: creating tablet
W20260617 07:53:03.872339 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7392ca4ba6a140e19c57e962a26162af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7392ca4ba6a140e19c57e962a26162af already in progress: creating tablet
I20260617 07:53:03.872578 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 086e43b610f9430c872daeef35c5586a (table default.Table_09a7839ef9df4c6cb77cf0a55a133446 [id=e2e28ecbf16446ae9e53e20ff4537b7d]) successfully deleted
W20260617 07:53:03.872787 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 074a3e08cc9a4be891016ce197a993be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 074a3e08cc9a4be891016ce197a993be already in progress: creating tablet
W20260617 07:53:03.873018 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 82cf9c672f3b4567b63e878a6ab11334 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82cf9c672f3b4567b63e878a6ab11334 already in progress: creating tablet
W20260617 07:53:03.873236 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3f51c76d93674a91b5ada7821393020a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f51c76d93674a91b5ada7821393020a already in progress: creating tablet
I20260617 07:53:03.873433 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 8ac72fef1251446cbd3975d98fa2f4ae (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]) successfully deleted
I20260617 07:53:03.873647 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 1481eb3482dd421f94556a1ce32eeed6 (table default.Table_d7b564096cd0495cb0f0a82db15e011e [id=816ac8741e6f485d9aa6fb6f93946193]) successfully deleted
W20260617 07:53:03.873914 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 19f8525046964950884b0f9aa515ec81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19f8525046964950884b0f9aa515ec81 already in progress: creating tablet
I20260617 07:53:03.874112 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet e364eed959174ef2a8fbbe7bb2215fa1 (table default.Table_1aea035e85d3436abb2bfaea4f748368 [id=b30bf68f0a1649398cd7c8a8c0ca116e]) successfully deleted
I20260617 07:53:03.874457 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a3b725166d9c420e9aa4435f707ce6c8 (table default.Table_46e203e35c294f2e936792a24c6b4011 [id=0d7c0472a2d346bdbfbe5d6409b7a3f8]) successfully deleted
I20260617 07:53:03.874646 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 5adee4d54cd94c4b9c45991762d91622 (table default.Table_4e5b772c907d45be9a233d194ecf89fd [id=30af12af77d74211bfb66830c1787615]) successfully deleted
I20260617 07:53:03.878511 1030 tablet_service.cc:1511] Processing CreateTablet for tablet ce1cb2c879e6451886c55907678792de (DEFAULT_TABLE table=default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.879091 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1cb2c879e6451886c55907678792de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.895219 1178 tablet_bootstrap.cc:492] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
W20260617 07:53:03.898010 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df705c2300064db680bec1fefab08d2f consensus state has no leader
I20260617 07:53:03.898411 531 master_service.cc:960] ReplaceTablet: received request to replace tablet f345910256784d2085cb81473534dcaf from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:03.899240 524 master_service.cc:960] ReplaceTablet: received request to replace tablet f345910256784d2085cb81473534dcaf from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:03.915771 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 (DEFAULT_TABLE table=default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.916468 1178 ts_tablet_manager.cc:1403] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.408s user 0.005s sys 0.000s
I20260617 07:53:03.932565 1178 raft_consensus.cc:359] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.935411 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cddb9e82c354f26b3abe56ebdefd008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.947659 891 tablet_service.cc:1511] Processing CreateTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec (DEFAULT_TABLE table=default.Table_b61c03f6c3284d4aa58a66884bf74d10 [id=3735e299178a4fe2876f1a11535fa4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.948462 1364 raft_consensus.cc:493] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.948666 1364 raft_consensus.cc:515] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.949551 1364 leader_election.cc:290] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:03.950616 529 master_service.cc:960] ReplaceTablet: received request to replace tablet a460aee4eb514a87b272c4fc858335e7 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:03.957819 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89783bab2e584fe9a8eda963f78bf3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:03.958554 1364 raft_consensus.cc:493] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:03.958739 1364 raft_consensus.cc:515] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.959740 1364 leader_election.cc:290] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:03.961438 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 52ae3c99bec7426caac18a6e3880bf51
W20260617 07:53:03.961511 988 leader_election.cc:343] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 076c6f6f406842ceb3db75e886e3ce50
I20260617 07:53:03.962723 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 52ae3c99bec7426caac18a6e3880bf51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:03.963745 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 52ae3c99bec7426caac18a6e3880bf51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52ae3c99bec7426caac18a6e3880bf51 already in progress: creating tablet
I20260617 07:53:03.964164 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31fba373a214b5a96bd11b930ed3b86" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:03.964622 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 52ae3c99bec7426caac18a6e3880bf51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:03.964623 917 raft_consensus.cc:2468] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:03.965493 988 leader_election.cc:304] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:03.966053 1364 raft_consensus.cc:2804] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:03.966147 1364 raft_consensus.cc:493] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:03.966111 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_37dfd90d2dcb4616afb087ae9ebfa366" } modify_external_catalogs: true
I20260617 07:53:03.966260 1364 raft_consensus.cc:3060] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.969245 1364 raft_consensus.cc:515] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.969965 523 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_e4f5053ee058492a96b46167bade387b [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 1 got 0
W20260617 07:53:03.970552 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 52ae3c99bec7426caac18a6e3880bf51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52ae3c99bec7426caac18a6e3880bf51 already in progress: creating tablet
I20260617 07:53:03.971125 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_428923b4ea044270a5649d6060de0539"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:03.971259 1364 leader_election.cc:290] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:03.971352 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31fba373a214b5a96bd11b930ed3b86" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
W20260617 07:53:03.971830 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_428923b4ea044270a5649d6060de0539 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.972111 917 raft_consensus.cc:3060] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:03.972337 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b365fa4f3a0147ef9b28a320dab6f49f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:03.972936 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b365fa4f3a0147ef9b28a320dab6f49f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:03.973325 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_37dfd90d2dcb4616afb087ae9ebfa366" } modify_external_catalogs: true
I20260617 07:53:03.976027 917 raft_consensus.cc:2468] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:03.976665 988 leader_election.cc:304] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:03.977031 1364 raft_consensus.cc:2804] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:03.977217 1364 raft_consensus.cc:697] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:03.977545 1364 consensus_queue.cc:237] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:03.936933 760 tablet_service.cc:1511] Processing CreateTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec (DEFAULT_TABLE table=default.Table_b61c03f6c3284d4aa58a66884bf74d10 [id=3735e299178a4fe2876f1a11535fa4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:03.950819 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076c6f6f406842ceb3db75e886e3ce50" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.961205 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31fba373a214b5a96bd11b930ed3b86" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:03.970299 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31fba373a214b5a96bd11b930ed3b86" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:03.998996 1178 raft_consensus.cc:385] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:03.999084 1178 raft_consensus.cc:740] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:03.999423 1178 consensus_queue.cc:260] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:03.979777 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 52ae3c99bec7426caac18a6e3880bf51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:03.998867 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89783bab2e584fe9a8eda963f78bf3ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:03.999641 986 leader_election.cc:343] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:03.999967 779 raft_consensus.cc:2468] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:04.000609 986 leader_election.cc:304] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:04.001017 1364 raft_consensus.cc:2804] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.001108 1364 raft_consensus.cc:493] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.001202 1364 raft_consensus.cc:3060] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.004354 1364 raft_consensus.cc:515] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.005534 1364 leader_election.cc:290] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.005676 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076c6f6f406842ceb3db75e886e3ce50" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:04.005903 779 raft_consensus.cc:3060] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:04.009814 988 leader_election.cc:343] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 076c6f6f406842ceb3db75e886e3ce50
I20260617 07:53:04.010125 1364 raft_consensus.cc:493] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.010337 1364 raft_consensus.cc:515] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.011181 1364 leader_election.cc:290] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.012045 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3b1f601ac04fe996e63725f2d12e56" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:04.012428 1175 ts_tablet_manager.cc:1929] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 07:53:04.012805 986 leader_election.cc:343] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.013613 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec (DEFAULT_TABLE table=default.Table_b61c03f6c3284d4aa58a66884bf74d10 [id=3735e299178a4fe2876f1a11535fa4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.014142 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89783bab2e584fe9a8eda963f78bf3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.018195 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3b1f601ac04fe996e63725f2d12e56" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:04.018422 917 raft_consensus.cc:2468] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:04.018671 1171 tablet_bootstrap.cc:492] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.019064 1171 ts_tablet_manager.cc:1403] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.365s user 0.102s sys 0.154s
I20260617 07:53:04.019388 988 leader_election.cc:304] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.019903 1364 raft_consensus.cc:2804] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.019914 1171 raft_consensus.cc:359] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.020008 1364 raft_consensus.cc:493] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.020071 1171 raft_consensus.cc:385] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.020107 1364 raft_consensus.cc:3060] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.020150 1171 raft_consensus.cc:740] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.020355 1171 consensus_queue.cc:260] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.020939 1171 ts_tablet_manager.cc:1434] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:04.021311 1171 tablet_bootstrap.cc:492] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.023051 1364 raft_consensus.cc:515] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.023178 1171 tablet_bootstrap.cc:654] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.024045 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3b1f601ac04fe996e63725f2d12e56" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:04.024245 917 raft_consensus.cc:3060] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.026240 1171 tablet_bootstrap.cc:492] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.026407 1171 ts_tablet_manager.cc:1403] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260617 07:53:04.027300 1171 raft_consensus.cc:359] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.027487 1171 raft_consensus.cc:385] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.027565 1171 raft_consensus.cc:740] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.027839 1171 consensus_queue.cc:260] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.028730 1171 ts_tablet_manager.cc:1434] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 07:53:04.029039 1171 tablet_bootstrap.cc:492] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.018174 779 raft_consensus.cc:2468] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:04.029969 1175 log.cc:1199] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/b14f9f70461e49ccb4d318eab824a3e1
I20260617 07:53:04.031437 1171 tablet_bootstrap.cc:654] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.034288 1175 ts_tablet_manager.cc:1950] T b14f9f70461e49ccb4d318eab824a3e1 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:04.035562 1172 tablet_bootstrap.cc:492] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:04.035732 1172 ts_tablet_manager.cc:1403] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.197s user 0.027s sys 0.066s
I20260617 07:53:04.036649 1172 raft_consensus.cc:359] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.036891 1172 raft_consensus.cc:385] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.036965 1172 raft_consensus.cc:740] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.037209 1172 consensus_queue.cc:260] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.037843 1172 ts_tablet_manager.cc:1434] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:04.038228 986 leader_election.cc:304] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:04.039041 1272 raft_consensus.cc:2804] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.044605 917 raft_consensus.cc:2468] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:04.047621 988 leader_election.cc:304] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:04.049269 1364 leader_election.cc:290] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.049558 1364 raft_consensus.cc:2804] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.049741 1364 raft_consensus.cc:697] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:04.049875 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3b1f601ac04fe996e63725f2d12e56" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:04.050447 986 leader_election.cc:343] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.051482 1364 consensus_queue.cc:237] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.056978 1172 tablet_bootstrap.cc:492] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:04.057825 1171 tablet_bootstrap.cc:492] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.058048 1171 ts_tablet_manager.cc:1403] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.029s user 0.014s sys 0.007s
I20260617 07:53:04.058888 1172 tablet_bootstrap.cc:654] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.059007 1171 raft_consensus.cc:359] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.059264 1171 raft_consensus.cc:385] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.059394 1171 raft_consensus.cc:740] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.059696 1171 consensus_queue.cc:260] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.060509 1171 ts_tablet_manager.cc:1434] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:04.060916 1171 tablet_bootstrap.cc:492] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.063324 1171 tablet_bootstrap.cc:654] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.065320 1171 tablet_bootstrap.cc:492] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.065486 1171 ts_tablet_manager.cc:1403] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260617 07:53:04.066390 1171 raft_consensus.cc:359] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.066635 1171 raft_consensus.cc:385] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.066723 1171 raft_consensus.cc:740] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.067068 1171 consensus_queue.cc:260] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.068076 1272 raft_consensus.cc:697] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:04.068488 1272 consensus_queue.cc:237] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.069164 1171 ts_tablet_manager.cc:1434] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260617 07:53:04.069864 1171 tablet_bootstrap.cc:492] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.072992 1171 tablet_bootstrap.cc:654] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.075425 753 tablet_service.cc:1511] Processing CreateTablet for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (DEFAULT_TABLE table=default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.075911 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b83fda0ce74779b4cca2ffd2a9b903. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:04.080063 517 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_e324a127d3c9425a9d28163d7f13d6bc [id=27c9cf5e8d154b13a0de73ee2c60c357], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 56c70f5c41e04ad0b913c15aa315353f consensus state has no leader
I20260617 07:53:04.084440 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet f030d59f4e124f64bb62d05f0bb0f560
I20260617 07:53:04.085110 1175 tablet_replica.cc:333] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:04.085289 1175 raft_consensus.cc:2243] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.085467 1175 raft_consensus.cc:2272] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.085932 525 master_service.cc:960] ReplaceTablet: received request to replace tablet 89d0b4bcb35c42fd8cd2844cd018b634 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:04.086218 1175 ts_tablet_manager.cc:1916] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.086532 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_cb1be17b08654d1989db263568fd1036" } new_table_name: "default.Table_b1130f99f87744ee91f907e95346d984" modify_external_catalogs: true
I20260617 07:53:04.089062 891 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.089349 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.089242 527 catalog_manager.cc:5696] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:04.089661 527 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 36cbea7b0f024422bc281ea97f6d76d5 (table default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]). Expected version 1 got 0
I20260617 07:53:04.090003 527 catalog_manager.cc:5696] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } }
W20260617 07:53:04.090648 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet f030d59f4e124f64bb62d05f0bb0f560 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f030d59f4e124f64bb62d05f0bb0f560 already in progress: creating tablet
I20260617 07:53:04.091594 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a31fba373a214b5a96bd11b930ed3b86
I20260617 07:53:04.092087 1299 consensus_queue.cc:1048] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:04.092689 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_2facd19cc2a947059a467b44b1e2a0b4" } new_table_name: "default.Table_0fe95c790e874e80b3d3e10ca23cc31e" modify_external_catalogs: true
I20260617 07:53:04.093339 1175 ts_tablet_manager.cc:1929] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.093464 1175 log.cc:1199] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/8ac72fef1251446cbd3975d98fa2f4ae
I20260617 07:53:04.093679 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet a31fba373a214b5a96bd11b930ed3b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.093956 1175 ts_tablet_manager.cc:1950] T 8ac72fef1251446cbd3975d98fa2f4ae P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:04.094007 1170 tablet_replica.cc:333] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:04.094201 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet f030d59f4e124f64bb62d05f0bb0f560 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f030d59f4e124f64bb62d05f0bb0f560 already in progress: creating tablet
I20260617 07:53:04.094235 1170 raft_consensus.cc:2243] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:04.094523 1170 pending_rounds.cc:70] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:04.094513 1178 ts_tablet_manager.cc:1434] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.163s user 0.002s sys 0.000s
I20260617 07:53:04.094586 1170 pending_rounds.cc:77] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772683175157760 op_type: NO_OP noop_request { }
I20260617 07:53:04.094718 1170 raft_consensus.cc:2889] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:04.094821 1170 raft_consensus.cc:2272] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.095237 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet b14f9f70461e49ccb4d318eab824a3e1 (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]) successfully deleted
W20260617 07:53:04.095470 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 086e43b610f9430c872daeef35c5586a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 086e43b610f9430c872daeef35c5586a already in progress: creating tablet
I20260617 07:53:04.095562 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a31fba373a214b5a96bd11b930ed3b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.095827 1169 tablet_replica.cc:333] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:04.096036 1169 raft_consensus.cc:2243] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.096230 1169 raft_consensus.cc:2272] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.096817 756 tablet_service.cc:1558] Processing DeleteTablet for tablet a31fba373a214b5a96bd11b930ed3b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.096833 1169 ts_tablet_manager.cc:1916] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.097224 755 tablet_service.cc:1511] Processing CreateTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 (DEFAULT_TABLE table=default.Table_e43779214db14ba4b44ebf4eb478fae9 [id=f2f2591e0ed7444d87b0149a964ba958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.097556 753 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.098708 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb95639e16ed423fbe60b15a1bcdf5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.099675 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7934f5fa0287427cb45fe568f0de8758 (DEFAULT_TABLE table=default.Table_09a7839ef9df4c6cb77cf0a55a133446 [id=e2e28ecbf16446ae9e53e20ff4537b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.100033 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7934f5fa0287427cb45fe568f0de8758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.102453 897 tablet_service.cc:1511] Processing CreateTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 (DEFAULT_TABLE table=default.Table_e43779214db14ba4b44ebf4eb478fae9 [id=f2f2591e0ed7444d87b0149a964ba958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.103003 896 tablet_service.cc:1511] Processing CreateTablet for tablet 7934f5fa0287427cb45fe568f0de8758 (DEFAULT_TABLE table=default.Table_09a7839ef9df4c6cb77cf0a55a133446 [id=e2e28ecbf16446ae9e53e20ff4537b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.103509 891 tablet_service.cc:1511] Processing CreateTablet for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (DEFAULT_TABLE table=default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.104871 1020 tablet_service.cc:1511] Processing CreateTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 (DEFAULT_TABLE table=default.Table_e43779214db14ba4b44ebf4eb478fae9 [id=f2f2591e0ed7444d87b0149a964ba958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.105358 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb95639e16ed423fbe60b15a1bcdf5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.106011 1178 tablet_bootstrap.cc:492] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:04.108148 1178 tablet_bootstrap.cc:654] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.109664 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 8ac72fef1251446cbd3975d98fa2f4ae (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]) successfully deleted
W20260617 07:53:04.109989 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3f51c76d93674a91b5ada7821393020a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f51c76d93674a91b5ada7821393020a already in progress: creating tablet
I20260617 07:53:04.110051 1030 tablet_service.cc:1511] Processing CreateTablet for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (DEFAULT_TABLE table=default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:04.110350 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 19f8525046964950884b0f9aa515ec81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19f8525046964950884b0f9aa515ec81 already in progress: creating tablet
I20260617 07:53:04.110423 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b83fda0ce74779b4cca2ffd2a9b903. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:04.110883 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 52ae3c99bec7426caac18a6e3880bf51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52ae3c99bec7426caac18a6e3880bf51 already in progress: creating tablet
W20260617 07:53:04.111475 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a31fba373a214b5a96bd11b930ed3b86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a31fba373a214b5a96bd11b930ed3b86 already in progress: creating tablet
W20260617 07:53:04.112030 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f030d59f4e124f64bb62d05f0bb0f560 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f030d59f4e124f64bb62d05f0bb0f560 already in progress: creating tablet
I20260617 07:53:04.115165 1170 ts_tablet_manager.cc:1916] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.119215 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb95639e16ed423fbe60b15a1bcdf5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.119750 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7934f5fa0287427cb45fe568f0de8758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.120246 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b83fda0ce74779b4cca2ffd2a9b903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.120664 758 tablet_service.cc:1511] Processing CreateTablet for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (DEFAULT_TABLE table=default.Table_cf2b90b9a25a471aa34d0532b35cbff9 [id=3824f4c443804be49d851e39e23ce3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.121054 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.124897 1169 ts_tablet_manager.cc:1929] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.125026 1169 log.cc:1199] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a31fba373a214b5a96bd11b930ed3b86
I20260617 07:53:04.126428 1172 tablet_bootstrap.cc:492] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:04.126590 1172 ts_tablet_manager.cc:1403] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.088s user 0.005s sys 0.000s
I20260617 07:53:04.127583 1172 raft_consensus.cc:359] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.127807 1172 raft_consensus.cc:385] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.127938 1172 raft_consensus.cc:740] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.128410 1172 consensus_queue.cc:260] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.128832 1364 raft_consensus.cc:493] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.125442 1169 ts_tablet_manager.cc:1950] T a31fba373a214b5a96bd11b930ed3b86 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:04.129694 1364 raft_consensus.cc:515] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.131981 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ee285802f47b98c152daad8cfd9d7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:04.132499 986 leader_election.cc:343] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.132725 1364 leader_election.cc:290] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.129027 1172 ts_tablet_manager.cc:1434] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:04.132931 1299 raft_consensus.cc:493] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.133147 1172 tablet_bootstrap.cc:492] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:04.133106 1299 raft_consensus.cc:515] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.133709 1299 leader_election.cc:290] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:04.134624 851 leader_election.cc:343] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 086e43b610f9430c872daeef35c5586a
I20260617 07:53:04.135006 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a31fba373a214b5a96bd11b930ed3b86 (table default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23]) successfully deleted
I20260617 07:53:04.135717 757 tablet_service.cc:1511] Processing CreateTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 (DEFAULT_TABLE table=default.Table_f176abc5534f4cfca902243f1fa75f63 [id=e0b7c87ef9274d74b6895e85ecc22012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.135820 898 tablet_service.cc:1511] Processing CreateTablet for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (DEFAULT_TABLE table=default.Table_cf2b90b9a25a471aa34d0532b35cbff9 [id=3824f4c443804be49d851e39e23ce3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.136166 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.136189 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 301bd4d6faec429ba71ce354c23d0f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.139156 1172 tablet_bootstrap.cc:654] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.141486 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ee285802f47b98c152daad8cfd9d7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:04.141665 917 raft_consensus.cc:2468] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:04.142100 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086e43b610f9430c872daeef35c5586a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:04.142652 988 leader_election.cc:304] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.145859 1030 tablet_service.cc:1511] Processing CreateTablet for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (DEFAULT_TABLE table=default.Table_cf2b90b9a25a471aa34d0532b35cbff9 [id=3824f4c443804be49d851e39e23ce3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.146253 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.146785 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet f345910256784d2085cb81473534dcaf
I20260617 07:53:04.147346 531 catalog_manager.cc:6784] ReplaceTablet: tablet f345910256784d2085cb81473534dcaf deleted and replaced by tablet 570ae1e189a64da6bad10156b401ec46
I20260617 07:53:04.148869 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_996d5685c9904502b299700425b29a1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.149034 1171 tablet_bootstrap.cc:492] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.149161 1171 ts_tablet_manager.cc:1403] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.000s
W20260617 07:53:04.149458 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_996d5685c9904502b299700425b29a1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.150028 1171 raft_consensus.cc:359] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.150122 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_aaf94418df824d9fa1fdc018d26cf9e7" } new_table_name: "default.Table_ceefeb6f7eba48a1ab2f7df4193d879f" modify_external_catalogs: true
I20260617 07:53:04.150202 1171 raft_consensus.cc:385] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.150283 1171 raft_consensus.cc:740] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.150550 1171 consensus_queue.cc:260] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.152665 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 with delete_type TABLET_DATA_DELETED (replaced by tablet 82cf9c672f3b4567b63e878a6ab11334) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.152936 1175 tablet_replica.cc:333] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:04.153120 1175 raft_consensus.cc:2243] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.153541 1175 raft_consensus.cc:2272] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.154351 1175 ts_tablet_manager.cc:1916] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:04.155234 852 leader_election.cc:343] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.155313 892 tablet_service.cc:1511] Processing CreateTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 (DEFAULT_TABLE table=default.Table_f176abc5534f4cfca902243f1fa75f63 [id=e0b7c87ef9274d74b6895e85ecc22012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.155407 852 leader_election.cc:304] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:04.155700 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 301bd4d6faec429ba71ce354c23d0f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.155901 753 tablet_service.cc:1511] Processing CreateTablet for tablet 56c70f5c41e04ad0b913c15aa315353f (DEFAULT_TABLE table=default.Table_e324a127d3c9425a9d28163d7f13d6bc [id=27c9cf5e8d154b13a0de73ee2c60c357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.156196 1364 raft_consensus.cc:2804] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.156318 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c70f5c41e04ad0b913c15aa315353f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.156312 1364 raft_consensus.cc:493] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.156417 1364 raft_consensus.cc:3060] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.159119 1364 raft_consensus.cc:515] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.160383 893 tablet_service.cc:1511] Processing CreateTablet for tablet 56c70f5c41e04ad0b913c15aa315353f (DEFAULT_TABLE table=default.Table_e324a127d3c9425a9d28163d7f13d6bc [id=27c9cf5e8d154b13a0de73ee2c60c357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.160637 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 (DEFAULT_TABLE table=default.Table_f176abc5534f4cfca902243f1fa75f63 [id=e0b7c87ef9274d74b6895e85ecc22012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.160743 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c70f5c41e04ad0b913c15aa315353f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.160981 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 301bd4d6faec429ba71ce354c23d0f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.165477 1178 tablet_bootstrap.cc:492] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:04.165634 1178 ts_tablet_manager.cc:1403] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.001s
I20260617 07:53:04.166239 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 56c70f5c41e04ad0b913c15aa315353f (DEFAULT_TABLE table=default.Table_e324a127d3c9425a9d28163d7f13d6bc [id=27c9cf5e8d154b13a0de73ee2c60c357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.166602 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c70f5c41e04ad0b913c15aa315353f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.170007 1175 ts_tablet_manager.cc:1929] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.170171 1175 log.cc:1199] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/076c6f6f406842ceb3db75e886e3ce50
I20260617 07:53:04.170565 1175 ts_tablet_manager.cc:1950] T 076c6f6f406842ceb3db75e886e3ce50 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:04.171443 1366 raft_consensus.cc:2749] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:04.171749 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ee285802f47b98c152daad8cfd9d7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:04.171923 917 raft_consensus.cc:3060] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.171954 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 076c6f6f406842ceb3db75e886e3ce50 (table default.Table_109a002e502a44d99c0e775b394e5c38 [id=6f5f5cfa42c54ca3964df6f9e25f18ae]) successfully deleted
I20260617 07:53:04.172439 1178 raft_consensus.cc:359] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.172612 1178 raft_consensus.cc:385] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.172689 1178 raft_consensus.cc:740] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.172915 1178 consensus_queue.cc:260] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.174176 1178 ts_tablet_manager.cc:1434] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260617 07:53:04.174625 917 raft_consensus.cc:2468] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:04.175415 1178 tablet_bootstrap.cc:492] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:04.177048 1178 tablet_bootstrap.cc:654] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.177591 1172 tablet_bootstrap.cc:492] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:04.177794 1172 ts_tablet_manager.cc:1403] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.000s
I20260617 07:53:04.180979 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet d7309d2b22c849ce980fd263a29ac77f
I20260617 07:53:04.181811 528 master_service.cc:960] ReplaceTablet: received request to replace tablet c7e43e1a3df54efe992a86dd0bd0c149 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:04.183547 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet d7309d2b22c849ce980fd263a29ac77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.184556 988 leader_election.cc:304] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:04.184857 1272 raft_consensus.cc:2804] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.184971 1272 raft_consensus.cc:697] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:04.185261 753 tablet_service.cc:1558] Processing DeleteTablet for tablet d7309d2b22c849ce980fd263a29ac77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.185220 1272 consensus_queue.cc:237] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.185535 1171 ts_tablet_manager.cc:1434] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
W20260617 07:53:04.185907 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d7309d2b22c849ce980fd263a29ac77f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7309d2b22c849ce980fd263a29ac77f already in progress: creating tablet
I20260617 07:53:04.186728 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d7309d2b22c849ce980fd263a29ac77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.187772 1171 tablet_bootstrap.cc:492] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.189584 1172 raft_consensus.cc:359] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.189874 1172 raft_consensus.cc:385] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.189955 1172 raft_consensus.cc:740] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.190237 1172 consensus_queue.cc:260] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.192231 1171 tablet_bootstrap.cc:654] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:04.192451 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d7309d2b22c849ce980fd263a29ac77f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7309d2b22c849ce980fd263a29ac77f already in progress: creating tablet
I20260617 07:53:04.194110 1172 ts_tablet_manager.cc:1434] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260617 07:53:04.195156 1172 tablet_bootstrap.cc:492] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:04.197198 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e324a127d3c9425a9d28163d7f13d6bc" } new_table_name: "default.Table_ae520dc945884caea49e68d2586a9da4" modify_external_catalogs: true
I20260617 07:53:04.198319 757 tablet_service.cc:1558] Processing DeleteTablet for tablet f345910256784d2085cb81473534dcaf with delete_type TABLET_DATA_DELETED (replaced by tablet 570ae1e189a64da6bad10156b401ec46) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:04.199115 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f345910256784d2085cb81473534dcaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f345910256784d2085cb81473534dcaf already in progress: creating tablet
I20260617 07:53:04.199882 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_412e4d145f3247efb53b3b107b70903a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.200580 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_412e4d145f3247efb53b3b107b70903a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.206405 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 8fa23bb0929440b1820afdce4b9e8d8c
I20260617 07:53:04.207163 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_c3ea195c67814080b1221735affcde43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.207751 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3ea195c67814080b1221735affcde43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.207886 1171 tablet_bootstrap.cc:492] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.208060 1171 ts_tablet_manager.cc:1403] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260617 07:53:04.209270 1171 raft_consensus.cc:359] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.209478 1171 raft_consensus.cc:385] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.209544 1171 raft_consensus.cc:740] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.209784 1171 consensus_queue.cc:260] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:04.210561 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9968c8179c14d1b9bc9a2c2779fb86e consensus state has no leader
I20260617 07:53:04.210959 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_7b166c294fd44b04a047b96334a1e349"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.211290 1178 tablet_bootstrap.cc:492] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:04.211455 1178 ts_tablet_manager.cc:1403] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.017s
W20260617 07:53:04.211483 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b166c294fd44b04a047b96334a1e349 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.212474 1171 ts_tablet_manager.cc:1434] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260617 07:53:04.212404 1178 raft_consensus.cc:359] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.212800 1171 tablet_bootstrap.cc:492] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:04.212809 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5203534569bd4da18bc06751f094735f consensus state has no leader
I20260617 07:53:04.212888 1178 raft_consensus.cc:385] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.212973 1178 raft_consensus.cc:740] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.213181 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_eb6188f81ced4416b480a7dbd86da65b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.213229 1178 consensus_queue.cc:260] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:04.213610 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb6188f81ced4416b480a7dbd86da65b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.213975 1178 ts_tablet_manager.cc:1434] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:04.214267 1178 tablet_bootstrap.cc:492] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:04.214754 1171 tablet_bootstrap.cc:654] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:04.216295 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a882ae04eeb94276bb78ded81fbea708 consensus state has no leader
I20260617 07:53:04.216578 1178 tablet_bootstrap.cc:654] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.216655 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_55cf1cae5fa44c55bef179cc6aa48834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.216917 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a562036b19dd4c99a8981180a617b865"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.217156 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55cf1cae5fa44c55bef179cc6aa48834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:04.217439 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a562036b19dd4c99a8981180a617b865 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.221612 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e4f5053ee058492a96b46167bade387b" } new_table_name: "default.Table_833d659ea3034141bb454daaea8a3d8a" modify_external_catalogs: true
I20260617 07:53:04.225777 1178 tablet_bootstrap.cc:492] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:04.225939 1178 ts_tablet_manager.cc:1403] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
W20260617 07:53:04.226471 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56c70f5c41e04ad0b913c15aa315353f consensus state has no leader
I20260617 07:53:04.226703 1178 raft_consensus.cc:359] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.226879 1178 raft_consensus.cc:385] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.226965 1178 raft_consensus.cc:740] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.227244 1178 consensus_queue.cc:260] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.227380 1343 consensus_queue.cc:1048] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:04.228119 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_724c24f5d49244fa91caa9fc9603eead"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.228781 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_724c24f5d49244fa91caa9fc9603eead in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.230763 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3b1f601ac04fe996e63725f2d12e56 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fa23bb0929440b1820afdce4b9e8d8c) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.231122 1175 tablet_replica.cc:333] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:04.231288 1175 raft_consensus.cc:2243] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.231448 1175 raft_consensus.cc:2272] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.231827 1171 tablet_bootstrap.cc:492] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.231994 1171 ts_tablet_manager.cc:1403] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.002s
I20260617 07:53:04.232161 1175 ts_tablet_manager.cc:1916] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.232790 1171 raft_consensus.cc:359] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:04.232957 1171 raft_consensus.cc:385] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.233047 1171 raft_consensus.cc:740] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.233048 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9439306243c4451db8d00e183b7dbeda" } modify_external_catalogs: true
I20260617 07:53:04.233215 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9439306243c4451db8d00e183b7dbeda" } modify_external_catalogs: true
I20260617 07:53:04.233297 1171 consensus_queue.cc:260] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:04.233779 1401 raft_consensus.cc:493] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.233930 1171 ts_tablet_manager.cc:1434] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260617 07:53:04.233914 1401 raft_consensus.cc:515] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.234226 1171 tablet_bootstrap.cc:492] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.234609 1401 leader_election.cc:290] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.235278 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf7f07441954d35916890efbfa4d836" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:04.235801 986 leader_election.cc:343] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.236282 1401 raft_consensus.cc:493] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.236433 1401 raft_consensus.cc:515] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.236953 1401 leader_election.cc:290] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.237573 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452f7d2bceb5447290370f72ec788608" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:04.238103 986 leader_election.cc:343] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.238458 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adee4d54cd94c4b9c45991762d91622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.238672 1175 ts_tablet_manager.cc:1929] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.238770 1175 log.cc:1199] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/1f3b1f601ac04fe996e63725f2d12e56
I20260617 07:53:04.238864 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d0b4bcb35c42fd8cd2844cd018b634 with delete_type TABLET_DATA_DELETED (replaced by tablet c7e43e1a3df54efe992a86dd0bd0c149) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.239169 1175 ts_tablet_manager.cc:1950] T 1f3b1f601ac04fe996e63725f2d12e56 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:04.239199 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3b1f601ac04fe996e63725f2d12e56 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fa23bb0929440b1820afdce4b9e8d8c) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.240454 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 1f3b1f601ac04fe996e63725f2d12e56 (table default.Table_456aace94223474f82d1801ec38d7b43 [id=cbd872cee78b4535b90941504bafc133]) successfully deleted
I20260617 07:53:04.240792 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.241350 1171 tablet_bootstrap.cc:654] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.242816 1178 ts_tablet_manager.cc:1434] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.017s user 0.004s sys 0.001s
I20260617 07:53:04.243921 1178 tablet_bootstrap.cc:492] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:04.245674 1178 tablet_bootstrap.cc:654] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.246469 1299 raft_consensus.cc:493] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.246677 1299 raft_consensus.cc:515] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.246891 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452f7d2bceb5447290370f72ec788608" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:04.247049 918 raft_consensus.cc:2468] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:04.247315 1299 leader_election.cc:290] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.248261 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262a34e120f34689ba0b598d7a2999fd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:04.248458 1050 raft_consensus.cc:2468] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:04.249399 851 leader_election.cc:304] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:04.250080 1299 raft_consensus.cc:2804] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.250212 1299 raft_consensus.cc:493] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.250305 1299 raft_consensus.cc:3060] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.250682 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 with delete_type TABLET_DATA_DELETED (replaced by tablet 82cf9c672f3b4567b63e878a6ab11334) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:04.250962 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8fa23bb0929440b1820afdce4b9e8d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fa23bb0929440b1820afdce4b9e8d8c already in progress: creating tablet
W20260617 07:53:04.251499 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 076c6f6f406842ceb3db75e886e3ce50 because the tablet was not found. No further retry: Not found: Tablet not found: 076c6f6f406842ceb3db75e886e3ce50
I20260617 07:53:04.251865 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf7f07441954d35916890efbfa4d836" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:04.253966 1178 tablet_bootstrap.cc:492] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:04.253568 1299 raft_consensus.cc:515] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.254158 1178 ts_tablet_manager.cc:1403] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260617 07:53:04.254886 1178 raft_consensus.cc:359] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.255095 1178 raft_consensus.cc:385] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.255050 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262a34e120f34689ba0b598d7a2999fd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:04.255169 1178 raft_consensus.cc:740] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.255249 1050 raft_consensus.cc:3060] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.255429 1178 consensus_queue.cc:260] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.256848 1178 ts_tablet_manager.cc:1434] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:04.257874 1178 tablet_bootstrap.cc:492] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:04.258919 1299 leader_election.cc:290] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.259527 1050 raft_consensus.cc:2468] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:04.259670 1178 tablet_bootstrap.cc:654] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.259977 851 leader_election.cc:304] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:04.260522 1299 raft_consensus.cc:2804] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.262164 1299 raft_consensus.cc:697] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:04.263391 1299 consensus_queue.cc:237] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.267896 1178 tablet_bootstrap.cc:492] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:04.268057 1178 ts_tablet_manager.cc:1403] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260617 07:53:04.270325 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 294a8bfd35d04105b6bc03946d25c17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.270473 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.270628 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adee4d54cd94c4b9c45991762d91622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.270706 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2063248863ed46c196c93013230529fe with delete_type TABLET_DATA_DELETED (replaced by tablet ddb71e5f65cd4b9e8dbe5ddf44e70340) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.270952 1169 tablet_replica.cc:333] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:04.271142 1169 raft_consensus.cc:2243] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.271323 1169 raft_consensus.cc:2272] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.271912 1169 ts_tablet_manager.cc:1916] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.282218 898 tablet_service.cc:1558] Processing DeleteTablet for tablet f345910256784d2085cb81473534dcaf with delete_type TABLET_DATA_DELETED (replaced by tablet 570ae1e189a64da6bad10156b401ec46) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.283424 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2ee285802f47b98c152daad8cfd9d7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:04.283676 779 raft_consensus.cc:3060] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.283955 988 leader_election.cc:304] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.284987 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.286326 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262a34e120f34689ba0b598d7a2999fd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:04.289304 988 leader_election.cc:343] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.289906 988 leader_election.cc:304] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:04.290335 1272 raft_consensus.cc:2804] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.290499 1272 raft_consensus.cc:493] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.290581 1272 raft_consensus.cc:3060] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.291402 779 raft_consensus.cc:2468] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:04.293191 1272 raft_consensus.cc:515] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.294793 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262a34e120f34689ba0b598d7a2999fd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:04.295678 1272 leader_election.cc:290] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.300264 1400 raft_consensus.cc:2749] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:04.300771 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452f7d2bceb5447290370f72ec788608" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:04.301276 986 leader_election.cc:343] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.283167 894 tablet_service.cc:1558] Processing DeleteTablet for tablet a31fba373a214b5a96bd11b930ed3b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.290154 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.306293 1364 leader_election.cc:290] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.308168 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 7934f5fa0287427cb45fe568f0de8758 (DEFAULT_TABLE table=default.Table_09a7839ef9df4c6cb77cf0a55a133446 [id=e2e28ecbf16446ae9e53e20ff4537b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.308450 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3b1f601ac04fe996e63725f2d12e56 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fa23bb0929440b1820afdce4b9e8d8c) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:04.297473 852 consensus_peers.cc:597] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:04.309927 852 leader_election.cc:343] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:04.310273 852 leader_election.cc:343] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.310200 1178 raft_consensus.cc:359] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:04.311365 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7934f5fa0287427cb45fe568f0de8758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.311580 1178 raft_consensus.cc:385] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.311854 1178 raft_consensus.cc:740] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.312935 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452f7d2bceb5447290370f72ec788608" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:04.310777 1170 ts_tablet_manager.cc:1929] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:04.313134 917 raft_consensus.cc:3060] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.296727 897 tablet_service.cc:1558] Processing DeleteTablet for tablet e364eed959174ef2a8fbbe7bb2215fa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.313514 1170 log.cc:1199] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a31fba373a214b5a96bd11b930ed3b86
I20260617 07:53:04.314436 1170 ts_tablet_manager.cc:1950] T a31fba373a214b5a96bd11b930ed3b86 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:04.314636 1178 consensus_queue.cc:260] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:04.316154 917 raft_consensus.cc:2468] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:04.309446 1169 ts_tablet_manager.cc:1929] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.317042 1169 log.cc:1199] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/294a8bfd35d04105b6bc03946d25c17a
I20260617 07:53:04.317042 988 leader_election.cc:304] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.317404 1169 ts_tablet_manager.cc:1950] T 294a8bfd35d04105b6bc03946d25c17a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:04.317669 1364 raft_consensus.cc:2804] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.318372 1364 raft_consensus.cc:697] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:04.318719 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 294a8bfd35d04105b6bc03946d25c17a (table default.Table_8f023a35300e46fe80ba1d63915dd524 [id=f229ae0273bf41348803c6ffaa3c098d]) successfully deleted
I20260617 07:53:04.318811 1169 tablet_replica.cc:333] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:04.318831 1364 consensus_queue.cc:237] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.318996 1169 raft_consensus.cc:2243] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
W20260617 07:53:04.319020 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 8fa23bb0929440b1820afdce4b9e8d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fa23bb0929440b1820afdce4b9e8d8c already in progress: creating tablet
I20260617 07:53:04.319238 1169 pending_rounds.cc:70] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:04.319303 1169 pending_rounds.cc:77] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772682353606656 op_type: NO_OP noop_request { }
I20260617 07:53:04.319461 1169 raft_consensus.cc:2889] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:04.319587 1169 raft_consensus.cc:2272] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.320963 1169 ts_tablet_manager.cc:1916] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.321163 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet f345910256784d2085cb81473534dcaf with delete_type TABLET_DATA_DELETED (replaced by tablet 570ae1e189a64da6bad10156b401ec46) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.322804 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a31fba373a214b5a96bd11b930ed3b86 (table default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23]) successfully deleted
I20260617 07:53:04.316671 1178 ts_tablet_manager.cc:1434] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.048s user 0.002s sys 0.000s
I20260617 07:53:04.327577 1178 tablet_bootstrap.cc:492] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:04.328769 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d7309d2b22c849ce980fd263a29ac77f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7309d2b22c849ce980fd263a29ac77f already in progress: creating tablet
I20260617 07:53:04.329489 1343 raft_consensus.cc:493] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.329620 1343 raft_consensus.cc:515] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:04.330246 1169 ts_tablet_manager.cc:1929] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:04.330328 1343 leader_election.cc:290] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:04.330387 1169 log.cc:1199] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5adee4d54cd94c4b9c45991762d91622
I20260617 07:53:04.330823 1169 ts_tablet_manager.cc:1950] T 5adee4d54cd94c4b9c45991762d91622 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:04.331455 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5adee4d54cd94c4b9c45991762d91622 (table default.Table_4e5b772c907d45be9a233d194ecf89fd [id=30af12af77d74211bfb66830c1787615]) successfully deleted
I20260617 07:53:04.331449 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d0b4bcb35c42fd8cd2844cd018b634" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:04.331696 1051 raft_consensus.cc:2468] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
W20260617 07:53:04.332223 716 leader_election.cc:343] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 89d0b4bcb35c42fd8cd2844cd018b634
I20260617 07:53:04.332419 716 leader_election.cc:304] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:04.332787 1343 raft_consensus.cc:2804] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.332923 1343 raft_consensus.cc:493] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.333005 1343 raft_consensus.cc:3060] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:04.333199 516 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5adee4d54cd94c4b9c45991762d91622 because the tablet was not found. No further retry: Not found: Tablet not found: 5adee4d54cd94c4b9c45991762d91622
I20260617 07:53:04.335726 1178 tablet_bootstrap.cc:654] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.336179 1343 raft_consensus.cc:515] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:04.336338 1169 tablet_replica.cc:333] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:04.336524 1169 raft_consensus.cc:2243] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.336755 1169 raft_consensus.cc:2272] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.336953 1170 tablet_replica.cc:333] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:04.337133 1170 raft_consensus.cc:2243] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:04.337597 716 leader_election.cc:343] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 89d0b4bcb35c42fd8cd2844cd018b634
I20260617 07:53:04.337846 1170 raft_consensus.cc:2272] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.338378 1169 ts_tablet_manager.cc:1916] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.338651 1343 leader_election.cc:290] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:04.338765 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d0b4bcb35c42fd8cd2844cd018b634" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
W20260617 07:53:04.339418 713 leader_election.cc:343] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.340020 713 leader_election.cc:304] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:04.340472 1343 raft_consensus.cc:2749] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 07:53:04.341629 1170 ts_tablet_manager.cc:1916] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.341670 1366 raft_consensus.cc:493] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.341936 1366 raft_consensus.cc:515] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.342686 1366 leader_election.cc:290] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.343761 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc0439f992048358f1de4381516e543" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:04.344468 852 leader_election.cc:343] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.344841 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc0439f992048358f1de4381516e543" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:04.345084 1051 raft_consensus.cc:2468] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:04.345534 851 leader_election.cc:304] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.346517 1366 raft_consensus.cc:2804] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.346634 1366 raft_consensus.cc:493] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.346763 1366 raft_consensus.cc:3060] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.350455 1366 raft_consensus.cc:515] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.351500 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc0439f992048358f1de4381516e543" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:04.351794 1050 raft_consensus.cc:3060] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.354152 1343 consensus_queue.cc:1048] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:04.355644 1050 raft_consensus.cc:2468] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:04.356232 851 leader_election.cc:304] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:04.356541 1172 tablet_bootstrap.cc:654] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.356560 1341 raft_consensus.cc:2804] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.359645 1366 leader_election.cc:290] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.362511 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet c7e43e1a3df54efe992a86dd0bd0c149
I20260617 07:53:04.363104 528 catalog_manager.cc:6784] ReplaceTablet: tablet c7e43e1a3df54efe992a86dd0bd0c149 deleted and replaced by tablet 36ce60b466f7420992ef194d72b5718d
I20260617 07:53:04.363638 1178 tablet_bootstrap.cc:492] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:04.363791 1178 ts_tablet_manager.cc:1403] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.001s
I20260617 07:53:04.364646 532 master_service.cc:960] ReplaceTablet: received request to replace tablet ab8388648475499db50cc16a7c36775a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:04.364573 1178 raft_consensus.cc:359] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.364777 1178 raft_consensus.cc:385] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.364840 1178 raft_consensus.cc:740] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.365106 1178 consensus_queue.cc:260] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.366971 897 tablet_service.cc:1558] Processing DeleteTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 with delete_type TABLET_DATA_DELETED (replaced by tablet 36ce60b466f7420992ef194d72b5718d) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.369946 760 tablet_service.cc:1558] Processing DeleteTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 with delete_type TABLET_DATA_DELETED (replaced by tablet 36ce60b466f7420992ef194d72b5718d) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.372779 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b106b0223948469da9ef0246aceeed0d" } modify_external_catalogs: true
I20260617 07:53:04.372982 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b106b0223948469da9ef0246aceeed0d" } modify_external_catalogs: true
W20260617 07:53:04.374042 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c7e43e1a3df54efe992a86dd0bd0c149 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7e43e1a3df54efe992a86dd0bd0c149 already in progress: creating tablet
I20260617 07:53:04.375268 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_868af3e5fa6c43ab8593b4e6a0073a62" } modify_external_catalogs: true
I20260617 07:53:04.375489 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_868af3e5fa6c43ab8593b4e6a0073a62" } modify_external_catalogs: true
I20260617 07:53:04.377864 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.378160 1175 tablet_replica.cc:333] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:04.378364 1175 raft_consensus.cc:2243] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.378515 1175 raft_consensus.cc:2272] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.378789 760 tablet_service.cc:1558] Processing DeleteTablet for tablet e364eed959174ef2a8fbbe7bb2215fa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.379307 1175 ts_tablet_manager.cc:1916] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.380972 1341 raft_consensus.cc:697] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:04.381335 1341 consensus_queue.cc:237] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.385499 1175 ts_tablet_manager.cc:1929] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.385691 1175 log.cc:1199] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/2a2ee285802f47b98c152daad8cfd9d7
I20260617 07:53:04.386273 1175 ts_tablet_manager.cc:1950] T 2a2ee285802f47b98c152daad8cfd9d7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:04.387367 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 2a2ee285802f47b98c152daad8cfd9d7 (table default.Table_41b3fa5c301945ff93a84c7b89309508 [id=29666c7cf6b54264910c2352e985ea96]) successfully deleted
I20260617 07:53:04.387724 1175 tablet_replica.cc:333] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:04.387962 1175 raft_consensus.cc:2243] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.388306 1175 raft_consensus.cc:2272] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.389164 1175 ts_tablet_manager.cc:1916] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.393343 1299 raft_consensus.cc:493] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.393590 1299 raft_consensus.cc:515] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:04.394389 851 consensus_peers.cc:597] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e364eed959174ef2a8fbbe7bb2215fa1. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:04.394830 1299 leader_election.cc:290] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.394990 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ecf80e090494539ae3d20448f8d1126" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:04.395469 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ecf80e090494539ae3d20448f8d1126" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:04.395462 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc0439f992048358f1de4381516e543" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:04.396098 852 leader_election.cc:343] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:04.396642 852 leader_election.cc:343] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.397979 1051 raft_consensus.cc:2468] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:04.398576 851 leader_election.cc:304] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.398943 1440 raft_consensus.cc:2804] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.398993 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 with delete_type TABLET_DATA_DELETED (replaced by tablet 36ce60b466f7420992ef194d72b5718d) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.393604 1171 tablet_bootstrap.cc:492] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.399101 1440 raft_consensus.cc:493] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.399227 1171 ts_tablet_manager.cc:1403] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.165s user 0.005s sys 0.028s
I20260617 07:53:04.399269 1172 tablet_bootstrap.cc:492] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:04.399363 1440 raft_consensus.cc:3060] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.399421 1172 ts_tablet_manager.cc:1403] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.204s user 0.002s sys 0.003s
I20260617 07:53:04.400082 1171 raft_consensus.cc:359] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.400280 1171 raft_consensus.cc:385] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.400358 1171 raft_consensus.cc:740] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.365671 1178 ts_tablet_manager.cc:1434] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:04.407050 1178 tablet_bootstrap.cc:492] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:04.406009 1171 consensus_queue.cc:260] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.408324 1341 raft_consensus.cc:493] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.408473 1440 raft_consensus.cc:515] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.408543 1341 raft_consensus.cc:515] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.400161 1172 raft_consensus.cc:359] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:04.408749 1172 raft_consensus.cc:385] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.408869 1172 raft_consensus.cc:740] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.409168 1440 leader_election.cc:290] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.409117 1172 consensus_queue.cc:260] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:04.410943 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf7f07441954d35916890efbfa4d836" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:04.411120 1050 raft_consensus.cc:2468] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:04.411974 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ecf80e090494539ae3d20448f8d1126" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:04.412428 1051 raft_consensus.cc:3060] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.415102 1178 tablet_bootstrap.cc:654] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.415411 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ecf80e090494539ae3d20448f8d1126" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:04.416131 1051 raft_consensus.cc:2468] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:04.416730 1175 ts_tablet_manager.cc:1929] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.416914 1175 log.cc:1199] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/e364eed959174ef2a8fbbe7bb2215fa1
I20260617 07:53:04.417414 1175 ts_tablet_manager.cc:1950] T e364eed959174ef2a8fbbe7bb2215fa1 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:04.417659 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a4842e83c9b04eb0ba7f546b71836f8f" } modify_external_catalogs: true
I20260617 07:53:04.418002 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b8c2cdf0232f43a2abece8a769ac6cb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.419045 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8c2cdf0232f43a2abece8a769ac6cb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.420555 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_11f15932db66445d80bde9f89d93a895"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.420940 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet e364eed959174ef2a8fbbe7bb2215fa1 (table default.Table_1aea035e85d3436abb2bfaea4f748368 [id=b30bf68f0a1649398cd7c8a8c0ca116e]) successfully deleted
W20260617 07:53:04.421120 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11f15932db66445d80bde9f89d93a895 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.421680 1172 ts_tablet_manager.cc:1434] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260617 07:53:04.422004 1172 tablet_bootstrap.cc:492] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:04.418084 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a4842e83c9b04eb0ba7f546b71836f8f" } modify_external_catalogs: true
I20260617 07:53:04.423719 1172 tablet_bootstrap.cc:654] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.426211 524 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 36cbea7b0f024422bc281ea97f6d76d5 (table default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]). Expected version 1 got 0
I20260617 07:53:04.427464 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 5b99b80966c94937baf7172b0c36af2a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:04.428028 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d0b4bcb35c42fd8cd2844cd018b634 with delete_type TABLET_DATA_DELETED (replaced by tablet c7e43e1a3df54efe992a86dd0bd0c149) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.428033 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_11a8e4d802dd415ca735ae9375de8ce7" } new_table_name: "default.Table_e26b9c6a7aad44cabb23cf5ab9200a5c" modify_external_catalogs: true
I20260617 07:53:04.428305 1175 tablet_replica.cc:333] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:04.428501 1175 raft_consensus.cc:2243] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.428663 1175 raft_consensus.cc:2272] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.428929 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.429324 1175 ts_tablet_manager.cc:1916] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.430907 1170 ts_tablet_manager.cc:1929] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.431025 1170 log.cc:1199] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/89d0b4bcb35c42fd8cd2844cd018b634
I20260617 07:53:04.434134 1364 raft_consensus.cc:493] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.434477 525 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 36cbea7b0f024422bc281ea97f6d76d5 (table default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]). Expected version 1 got 0
I20260617 07:53:04.434700 525 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 262a34e120f34689ba0b598d7a2999fd (table default.Table_6f686d428f8c4d9bacafed83c2a72029 [id=bc72e8ae07954b5d9f55178f136a72bc]). Expected version 1 got 0
I20260617 07:53:04.434978 525 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 452f7d2bceb5447290370f72ec788608 (table default.Table_4d28d190e4ca42dc96c1b61c33672c61 [id=26e1a39e290446dd976682e916b6bd0d]). Expected version 1 got 0
I20260617 07:53:04.435170 525 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ccf7f07441954d35916890efbfa4d836 (table default.Table_d7a2cf493ddd427c9087f6b6b1971450 [id=8b962c8429894c52a1ba7296a6f02205]). Expected version 2 got 0
I20260617 07:53:04.435389 525 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 4ecf80e090494539ae3d20448f8d1126 (table default.Table_ac940c0f5a9d49babeff827981e9d7d3 [id=829b5684836747b2aa4265ac17eccd80]). Expected version 1 got 0
I20260617 07:53:04.437474 1175 ts_tablet_manager.cc:1929] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.437752 1175 log.cc:1199] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/89d0b4bcb35c42fd8cd2844cd018b634
I20260617 07:53:04.438223 1175 ts_tablet_manager.cc:1950] T 89d0b4bcb35c42fd8cd2844cd018b634 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:04.438808 1178 tablet_bootstrap.cc:492] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:04.438977 1364 raft_consensus.cc:515] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.440315 1364 leader_election.cc:290] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.440640 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 89d0b4bcb35c42fd8cd2844cd018b634 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
I20260617 07:53:04.440644 528 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 262a34e120f34689ba0b598d7a2999fd (table default.Table_6f686d428f8c4d9bacafed83c2a72029 [id=bc72e8ae07954b5d9f55178f136a72bc]). Expected version 1 got 0
W20260617 07:53:04.440976 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2a2ee285802f47b98c152daad8cfd9d7 because the tablet was not found. No further retry: Not found: Tablet not found: 2a2ee285802f47b98c152daad8cfd9d7
I20260617 07:53:04.441143 528 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 36cbea7b0f024422bc281ea97f6d76d5 (table default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]). Expected version 1 got 0
I20260617 07:53:04.441217 1170 ts_tablet_manager.cc:1950] T 89d0b4bcb35c42fd8cd2844cd018b634 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:04.441524 528 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 452f7d2bceb5447290370f72ec788608 (table default.Table_4d28d190e4ca42dc96c1b61c33672c61 [id=26e1a39e290446dd976682e916b6bd0d]). Expected version 1 got 0
I20260617 07:53:04.441905 528 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 4ecf80e090494539ae3d20448f8d1126 (table default.Table_ac940c0f5a9d49babeff827981e9d7d3 [id=829b5684836747b2aa4265ac17eccd80]). Expected version 1 got 0
I20260617 07:53:04.440469 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a29aeb0a224cabb642f4100c44b8f3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:04.444563 986 leader_election.cc:343] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.444839 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adee4d54cd94c4b9c45991762d91622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.445140 1438 raft_consensus.cc:493] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.445262 1175 tablet_replica.cc:333] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:04.445461 1175 raft_consensus.cc:2243] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.445367 1438 raft_consensus.cc:515] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.445734 1175 raft_consensus.cc:2272] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.446264 1438 leader_election.cc:290] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.446369 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 with delete_type TABLET_DATA_DELETED (replaced by tablet 82cf9c672f3b4567b63e878a6ab11334) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.446612 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet c3a29aeb0a224cabb642f4100c44b8f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.446831 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet a31fba373a214b5a96bd11b930ed3b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.447022 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 2063248863ed46c196c93013230529fe with delete_type TABLET_DATA_DELETED (replaced by tablet ddb71e5f65cd4b9e8dbe5ddf44e70340) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.446915 528 catalog_manager.cc:5696] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:04.447032 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 294a8bfd35d04105b6bc03946d25c17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.447228 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a2ee285802f47b98c152daad8cfd9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.447458 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbea7b0f024422bc281ea97f6d76d5" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:04.447602 1175 ts_tablet_manager.cc:1916] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.448329 528 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 452f7d2bceb5447290370f72ec788608 (table default.Table_4d28d190e4ca42dc96c1b61c33672c61 [id=26e1a39e290446dd976682e916b6bd0d]). Expected version 1 got 0
I20260617 07:53:04.448652 528 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 2 got 0
I20260617 07:53:04.448740 760 tablet_service.cc:1511] Processing CreateTablet for tablet 59acdc64fe9247d28c4c277161b42f4f (DEFAULT_TABLE table=default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.445935 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 89d0b4bcb35c42fd8cd2844cd018b634 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
I20260617 07:53:04.449543 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59acdc64fe9247d28c4c277161b42f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.450162 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 59acdc64fe9247d28c4c277161b42f4f (DEFAULT_TABLE table=default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.450502 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59acdc64fe9247d28c4c277161b42f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.457288 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_428923b4ea044270a5649d6060de0539" } new_table_name: "default.Table_3e98977b52da4e3d825559a506774b17" modify_external_catalogs: true
I20260617 07:53:04.457639 1178 ts_tablet_manager.cc:1403] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.057s user 0.004s sys 0.000s
I20260617 07:53:04.458720 1178 raft_consensus.cc:359] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.460574 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2684f3200e604bb6bf37a2f97a193eff (DEFAULT_TABLE table=default.Table_9439306243c4451db8d00e183b7dbeda [id=3d4b592286ce4a06bcc5f3477fdbf25f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.459851 760 tablet_service.cc:1511] Processing CreateTablet for tablet 2684f3200e604bb6bf37a2f97a193eff (DEFAULT_TABLE table=default.Table_9439306243c4451db8d00e183b7dbeda [id=3d4b592286ce4a06bcc5f3477fdbf25f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.352721 1169 ts_tablet_manager.cc:1929] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.462620 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2684f3200e604bb6bf37a2f97a193eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.466159 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2684f3200e604bb6bf37a2f97a193eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.471180 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf7f07441954d35916890efbfa4d836" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:04.461578 1178 raft_consensus.cc:385] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.475736 1178 raft_consensus.cc:740] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.476421 1178 consensus_queue.cc:260] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.479029 757 tablet_service.cc:1511] Processing CreateTablet for tablet df37ed81b17d4178adeb6057491b4cc9 (DEFAULT_TABLE table=default.Table_57d8a7f4af774adeb25c6a592b0c0800 [id=b1b850d52163487fa43a3699bf969f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.479440 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df37ed81b17d4178adeb6057491b4cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.481920 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 2684f3200e604bb6bf37a2f97a193eff
I20260617 07:53:04.483060 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_7b166c294fd44b04a047b96334a1e349" } modify_external_catalogs: true
I20260617 07:53:04.483285 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_7b166c294fd44b04a047b96334a1e349" } modify_external_catalogs: true
I20260617 07:53:04.483964 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.484313 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet ab8388648475499db50cc16a7c36775a
I20260617 07:53:04.484761 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet be14a95f458d440e86133ef65c484571
I20260617 07:53:04.484827 532 catalog_manager.cc:6784] ReplaceTablet: tablet ab8388648475499db50cc16a7c36775a deleted and replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86
I20260617 07:53:04.485177 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_ceefeb6f7eba48a1ab2f7df4193d879f" } new_table_name: "default.Table_1ff79467c5924c02bd95106f502854eb" modify_external_catalogs: true
I20260617 07:53:04.485538 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_93a6fb533319471aa6c304e5fe867477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.486196 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93a6fb533319471aa6c304e5fe867477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.486739 758 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.486760 753 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8388648475499db50cc16a7c36775a with delete_type TABLET_DATA_DELETED (replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.486986 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 82d682ae37d74b4b967da0f8e2de6301
I20260617 07:53:04.487672 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9ab80d1558c249ce97356577215e7ab1" } new_table_name: "default.Table_c381382f3b774340a814a8e4d9d75c76" modify_external_catalogs: true
I20260617 07:53:04.488471 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_34fb38a5ef96468bbf08872ea10e8a5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.489006 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34fb38a5ef96468bbf08872ea10e8a5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.489980 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet c7343400555f447b8a1721ba36d7766d
I20260617 07:53:04.489920 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.490377 1178 ts_tablet_manager.cc:1434] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260617 07:53:04.491137 530 master_service.cc:960] ReplaceTablet: received request to replace tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:04.483292 527 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 2 got 0
I20260617 07:53:04.491954 1178 tablet_bootstrap.cc:492] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:04.497687 1023 tablet_service.cc:1511] Processing CreateTablet for tablet df37ed81b17d4178adeb6057491b4cc9 (DEFAULT_TABLE table=default.Table_57d8a7f4af774adeb25c6a592b0c0800 [id=b1b850d52163487fa43a3699bf969f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.498028 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.498162 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df37ed81b17d4178adeb6057491b4cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.498258 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8388648475499db50cc16a7c36775a with delete_type TABLET_DATA_DELETED (replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.498456 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.498675 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.499047 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:04.499550 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28e1fd7f91f94221884be2166f0cc793 consensus state has no leader
I20260617 07:53:04.501822 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 52ae3c99bec7426caac18a6e3880bf51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.504890 1341 leader_election.cc:290] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:04.505751 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 has no consensus state
I20260617 07:53:04.506238 851 leader_election.cc:304] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:04.506641 851 leader_election.cc:304] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:04.508340 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36cbea7b0f024422bc281ea97f6d76d5" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:04.509066 1341 raft_consensus.cc:2804] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.509243 1341 raft_consensus.cc:697] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:04.509559 1341 consensus_queue.cc:237] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.509912 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f (DEFAULT_TABLE table=default.Table_72eda13c56884241ab3153e5cb1a72d1 [id=78af228b204f4bb5a4e5867d1a9f9124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.510322 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebafc920ed34216be5fb115f9bc6f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.510634 1170 tablet_replica.cc:333] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:04.510743 1299 raft_consensus.cc:2804] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.510854 1299 raft_consensus.cc:493] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.510861 1170 raft_consensus.cc:2243] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:04.510970 1299 raft_consensus.cc:3060] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.511090 1170 pending_rounds.cc:70] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:04.511179 1170 pending_rounds.cc:77] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772683477708800 op_type: NO_OP noop_request { }
I20260617 07:53:04.511281 1170 raft_consensus.cc:2889] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:04.511418 1170 raft_consensus.cc:2272] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.514724 1465 tablet.cc:1724] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:04.517045 1171 ts_tablet_manager.cc:1434] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.106s user 0.001s sys 0.001s
I20260617 07:53:04.518159 1169 log.cc:1199] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/2063248863ed46c196c93013230529fe
I20260617 07:53:04.518945 1171 tablet_bootstrap.cc:492] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.521785 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ffce17fe5c8405a94a93ad7dd67806e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.521967 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 086e43b610f9430c872daeef35c5586a with delete_type TABLET_DATA_DELETED (replaced by tablet 7934f5fa0287427cb45fe568f0de8758) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.523347 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 52ae3c99bec7426caac18a6e3880bf51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.523847 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8388648475499db50cc16a7c36775a with delete_type TABLET_DATA_DELETED (replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.523952 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.523970 895 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.524799 893 tablet_service.cc:1511] Processing CreateTablet for tablet 245cff69d83b43e98b1c72b8d3011347 (DEFAULT_TABLE table=default.Table_1735b3a964d948ea9c83c11e8adf8c68 [id=7a799def323b4e8d958c34f9ace044a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.524924 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a29aeb0a224cabb642f4100c44b8f3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:04.525003 890 tablet_service.cc:1511] Processing CreateTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f (DEFAULT_TABLE table=default.Table_72eda13c56884241ab3153e5cb1a72d1 [id=78af228b204f4bb5a4e5867d1a9f9124]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:04.525262 852 leader_election.cc:343] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.526604 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adee4d54cd94c4b9c45991762d91622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.526895 892 tablet_service.cc:1511] Processing CreateTablet for tablet 59acdc64fe9247d28c4c277161b42f4f (DEFAULT_TABLE table=default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.527365 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.527706 894 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.527917 896 tablet_service.cc:1558] Processing DeleteTablet for tablet c3a29aeb0a224cabb642f4100c44b8f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.528121 895 tablet_service.cc:1511] Processing CreateTablet for tablet df37ed81b17d4178adeb6057491b4cc9 (DEFAULT_TABLE table=default.Table_57d8a7f4af774adeb25c6a592b0c0800 [id=b1b850d52163487fa43a3699bf969f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.528602 918 raft_consensus.cc:2468] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:04.528908 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245cff69d83b43e98b1c72b8d3011347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.528856 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 245cff69d83b43e98b1c72b8d3011347 (DEFAULT_TABLE table=default.Table_1735b3a964d948ea9c83c11e8adf8c68 [id=7a799def323b4e8d958c34f9ace044a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.529116 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebafc920ed34216be5fb115f9bc6f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.529412 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59acdc64fe9247d28c4c277161b42f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.529551 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245cff69d83b43e98b1c72b8d3011347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.532721 757 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.534056 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df37ed81b17d4178adeb6057491b4cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.535224 1170 ts_tablet_manager.cc:1916] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.541328 528 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 628fe028288c422a933078dd4ccecb34
W20260617 07:53:04.541625 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a882ae04eeb94276bb78ded81fbea708 consensus state has no leader
W20260617 07:53:04.542095 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc84665c7849469aa27e6505dbed1516 consensus state has no leader
I20260617 07:53:04.544130 716 leader_election.cc:304] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:04.545306 753 tablet_service.cc:1511] Processing CreateTablet for tablet be14a95f458d440e86133ef65c484571 (DEFAULT_TABLE table=default.Table_868af3e5fa6c43ab8593b4e6a0073a62 [id=16ff2f9be38e41fc81466c55286f0b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.545760 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be14a95f458d440e86133ef65c484571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.522221 1299 raft_consensus.cc:515] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.547019 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab (DEFAULT_TABLE table=default.Table_a479873a764443988e25350cedbbcc16 [id=de6d213812d4427fa28250763779565e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.547581 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 570ae1e189a64da6bad10156b401ec46 (DEFAULT_TABLE table=default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.547652 1299 leader_election.cc:290] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.547813 1439 raft_consensus.cc:2749] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:04.547878 852 leader_election.cc:343] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.547957 898 tablet_service.cc:1511] Processing CreateTablet for tablet 2684f3200e604bb6bf37a2f97a193eff (DEFAULT_TABLE table=default.Table_9439306243c4451db8d00e183b7dbeda [id=3d4b592286ce4a06bcc5f3477fdbf25f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.548244 758 tablet_service.cc:1511] Processing CreateTablet for tablet 570ae1e189a64da6bad10156b401ec46 (DEFAULT_TABLE table=default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.548328 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2684f3200e604bb6bf37a2f97a193eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.550625 890 tablet_service.cc:1511] Processing CreateTablet for tablet 570ae1e189a64da6bad10156b401ec46 (DEFAULT_TABLE table=default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.551045 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 570ae1e189a64da6bad10156b401ec46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.551090 894 tablet_service.cc:1511] Processing CreateTablet for tablet 69f5b567da0e4baab53c00c55923e920 (DEFAULT_TABLE table=default.Table_2bbb8fb1462c4af1bd93e616c9ba20c5 [id=121e9982362a4d0b9e37fd44dabc695b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.551412 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f5b567da0e4baab53c00c55923e920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.554129 891 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (DEFAULT_TABLE table=default.Table_93f67ad8807f4b61a8afe07babb7f45f [id=75e0087891a14cac9688f76ee43c157d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.554504 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.554958 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 0f9db8a986b344548e435b77edc14cb6 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:04.555233 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 570ae1e189a64da6bad10156b401ec46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.555912 757 tablet_service.cc:1511] Processing CreateTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f (DEFAULT_TABLE table=default.Table_72eda13c56884241ab3153e5cb1a72d1 [id=78af228b204f4bb5a4e5867d1a9f9124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.556572 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebafc920ed34216be5fb115f9bc6f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.557531 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (DEFAULT_TABLE table=default.Table_93f67ad8807f4b61a8afe07babb7f45f [id=75e0087891a14cac9688f76ee43c157d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.550649 896 tablet_service.cc:1511] Processing CreateTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab (DEFAULT_TABLE table=default.Table_a479873a764443988e25350cedbbcc16 [id=de6d213812d4427fa28250763779565e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.557857 755 tablet_service.cc:1511] Processing CreateTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab (DEFAULT_TABLE table=default.Table_a479873a764443988e25350cedbbcc16 [id=de6d213812d4427fa28250763779565e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.557955 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.557937 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 69f5b567da0e4baab53c00c55923e920 (DEFAULT_TABLE table=default.Table_2bbb8fb1462c4af1bd93e616c9ba20c5 [id=121e9982362a4d0b9e37fd44dabc695b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.558211 779 raft_consensus.cc:3060] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.558492 988 leader_election.cc:304] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.559602 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf7f07441954d35916890efbfa4d836" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:04.559818 1364 raft_consensus.cc:2804] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.559901 1364 raft_consensus.cc:493] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.559983 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.560468 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf7f07441954d35916890efbfa4d836" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:04.560720 1364 raft_consensus.cc:3060] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.562201 756 tablet_service.cc:1511] Processing CreateTablet for tablet 69f5b567da0e4baab53c00c55923e920 (DEFAULT_TABLE table=default.Table_2bbb8fb1462c4af1bd93e616c9ba20c5 [id=121e9982362a4d0b9e37fd44dabc695b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.562547 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f5b567da0e4baab53c00c55923e920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.563398 1364 raft_consensus.cc:515] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.565097 1364 leader_election.cc:290] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.565393 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.566660 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a29aeb0a224cabb642f4100c44b8f3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:04.567058 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a0dbb3e035514253b4f61f11d26da473"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.567142 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_de275810487f4911a911f2d6e00a8963"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.567652 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de275810487f4911a911f2d6e00a8963 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.567839 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_43006192468f4543a9781c8787493737"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.568240 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43006192468f4543a9781c8787493737 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:04.568820 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0dbb3e035514253b4f61f11d26da473 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.570452 1051 raft_consensus.cc:3060] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:04.570958 986 leader_election.cc:343] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.571123 1030 tablet_service.cc:1511] Processing CreateTablet for tablet be14a95f458d440e86133ef65c484571 (DEFAULT_TABLE table=default.Table_868af3e5fa6c43ab8593b4e6a0073a62 [id=16ff2f9be38e41fc81466c55286f0b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.571504 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be14a95f458d440e86133ef65c484571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.573176 1051 raft_consensus.cc:2468] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:04.573879 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.577828 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f5b567da0e4baab53c00c55923e920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.578583 1171 tablet_bootstrap.cc:654] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.578935 1169 ts_tablet_manager.cc:1950] T 2063248863ed46c196c93013230529fe P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:04.579439 852 leader_election.cc:343] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.580627 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3a29aeb0a224cabb642f4100c44b8f3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:04.580826 918 raft_consensus.cc:3060] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.584422 918 raft_consensus.cc:2468] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:04.584681 851 leader_election.cc:304] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.584867 988 leader_election.cc:304] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.585083 1440 raft_consensus.cc:493] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.585219 1400 raft_consensus.cc:493] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.585253 1440 raft_consensus.cc:515] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.585366 1400 raft_consensus.cc:515] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.585924 1440 leader_election.cc:290] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.586021 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 2063248863ed46c196c93013230529fe (table default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]) successfully deleted
I20260617 07:53:04.586120 1440 raft_consensus.cc:2804] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.586205 1400 leader_election.cc:290] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.586269 1440 raft_consensus.cc:697] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:04.586373 1400 raft_consensus.cc:2804] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.586488 1400 raft_consensus.cc:697] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:04.586545 1440 consensus_queue.cc:237] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:04.586663 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a31fba373a214b5a96bd11b930ed3b86 because the tablet was not found. No further retry: Not found: Tablet not found: a31fba373a214b5a96bd11b930ed3b86
I20260617 07:53:04.586721 1169 tablet_replica.cc:333] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:04.586758 1400 consensus_queue.cc:237] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.586956 1169 raft_consensus.cc:2243] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.587895 893 tablet_service.cc:1511] Processing CreateTablet for tablet be14a95f458d440e86133ef65c484571 (DEFAULT_TABLE table=default.Table_868af3e5fa6c43ab8593b4e6a0073a62 [id=16ff2f9be38e41fc81466c55286f0b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.588344 1272 raft_consensus.cc:493] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.588483 1272 raft_consensus.cc:515] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.588583 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be14a95f458d440e86133ef65c484571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.589068 1272 leader_election.cc:290] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.589351 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 570ae1e189a64da6bad10156b401ec46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.590013 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e253dca6904dfb914ed4be554da4b5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:04.590664 986 leader_election.cc:343] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.591720 1171 tablet_bootstrap.cc:492] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.591876 1171 ts_tablet_manager.cc:1403] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.075s user 0.001s sys 0.009s
I20260617 07:53:04.592705 1171 raft_consensus.cc:359] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.592883 1171 raft_consensus.cc:385] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.592989 1171 raft_consensus.cc:740] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.593199 1171 consensus_queue.cc:260] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.593778 1169 raft_consensus.cc:2272] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.593924 1171 ts_tablet_manager.cc:1434] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260617 07:53:04.594475 1171 tablet_bootstrap.cc:492] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.594631 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e253dca6904dfb914ed4be554da4b5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:04.594895 916 raft_consensus.cc:2468] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:04.595163 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffce17fe5c8405a94a93ad7dd67806e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:04.595680 851 leader_election.cc:343] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.596316 1171 tablet_bootstrap.cc:654] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.599093 988 leader_election.cc:304] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
W20260617 07:53:04.599519 988 leader_election.cc:343] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 294a8bfd35d04105b6bc03946d25c17a
I20260617 07:53:04.602587 760 tablet_service.cc:1511] Processing CreateTablet for tablet 245cff69d83b43e98b1c72b8d3011347 (DEFAULT_TABLE table=default.Table_1735b3a964d948ea9c83c11e8adf8c68 [id=7a799def323b4e8d958c34f9ace044a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.607589 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_47a904a2ae6045519235b5988330eeff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.608263 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294a8bfd35d04105b6bc03946d25c17a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:04.609042 986 leader_election.cc:343] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.609233 986 leader_election.cc:304] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:04.596364 1169 ts_tablet_manager.cc:1916] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.612828 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffce17fe5c8405a94a93ad7dd67806e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:04.613360 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47a904a2ae6045519235b5988330eeff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.614383 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245cff69d83b43e98b1c72b8d3011347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.617687 1464 tablet.cc:1724] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:04.621296 1178 tablet_bootstrap.cc:654] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.622447 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e26b9c6a7aad44cabb23cf5ab9200a5c" } new_table_name: "default.Table_804e7505dc3b49c9b60065387b8b5810" modify_external_catalogs: true
I20260617 07:53:04.622586 1400 raft_consensus.cc:2804] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.622573 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e29065138d484e19b64a88c7bbc05d79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.622742 1400 raft_consensus.cc:493] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.622826 1400 raft_consensus.cc:3060] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.623426 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_ee7079d18a5b466aacf7a9c709ae6dc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.622387 752 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (DEFAULT_TABLE table=default.Table_93f67ad8807f4b61a8afe07babb7f45f [id=75e0087891a14cac9688f76ee43c157d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:04.626442 852 leader_election.cc:343] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.626600 852 leader_election.cc:304] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:04.627012 1440 raft_consensus.cc:2749] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:04.627419 1175 ts_tablet_manager.cc:1929] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.627562 1175 log.cc:1199] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/5adee4d54cd94c4b9c45991762d91622
W20260617 07:53:04.628240 852 consensus_peers.cc:597] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e364eed959174ef2a8fbbe7bb2215fa1. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:04.628753 1175 ts_tablet_manager.cc:1950] T 5adee4d54cd94c4b9c45991762d91622 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:04.628989 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28e1fd7f91f94221884be2166f0cc793 consensus state has no leader
I20260617 07:53:04.629592 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.631737 1440 consensus_queue.cc:1048] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:04.631995 1364 raft_consensus.cc:2749] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:04.638069 1172 tablet_bootstrap.cc:492] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:04.638288 1172 ts_tablet_manager.cc:1403] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.216s user 0.004s sys 0.002s
I20260617 07:53:04.639155 1172 raft_consensus.cc:359] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.639376 1172 raft_consensus.cc:385] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.639469 1172 raft_consensus.cc:740] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:04.644461 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e29065138d484e19b64a88c7bbc05d79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:04.646456 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee7079d18a5b466aacf7a9c709ae6dc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.647480 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 5adee4d54cd94c4b9c45991762d91622 (table default.Table_4e5b772c907d45be9a233d194ecf89fd [id=30af12af77d74211bfb66830c1787615]) successfully deleted
I20260617 07:53:04.650458 1475 tablet.cc:1724] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 07:53:04.653764 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2684f3200e604bb6bf37a2f97a193eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2684f3200e604bb6bf37a2f97a193eff already in progress: creating tablet
I20260617 07:53:04.654474 1172 consensus_queue.cc:260] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.667935 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 074a3e08cc9a4be891016ce197a993be from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:04.670045 1172 ts_tablet_manager.cc:1434] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.032s user 0.003s sys 0.000s
I20260617 07:53:04.673799 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ffce17fe5c8405a94a93ad7dd67806e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.674548 1172 tablet_bootstrap.cc:492] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:04.682060 1440 consensus_queue.cc:1048] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:04.625537 1400 raft_consensus.cc:515] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.685597 1400 leader_election.cc:290] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.685863 1400 raft_consensus.cc:493] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.687425 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e253dca6904dfb914ed4be554da4b5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:04.688030 526 catalog_manager.cc:5696] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:04.688530 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 262a34e120f34689ba0b598d7a2999fd (table default.Table_6f686d428f8c4d9bacafed83c2a72029 [id=bc72e8ae07954b5d9f55178f136a72bc]). Expected version 1 got 0
I20260617 07:53:04.688833 526 catalog_manager.cc:5696] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:04.689337 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 36cbea7b0f024422bc281ea97f6d76d5 (table default.Table_91270a2fce904166a732f7bb47392c7e [id=6f0e007c645a43e6a9611001e0de1864]). Expected version 1 got 0
I20260617 07:53:04.691066 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_754536afb14d459c82f275ef52707a7f" } modify_external_catalogs: true
I20260617 07:53:04.691267 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_754536afb14d459c82f275ef52707a7f" } modify_external_catalogs: true
I20260617 07:53:04.691246 756 tablet_service.cc:1511] Processing CreateTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 (DEFAULT_TABLE table=default.Table_b8c2cdf0232f43a2abece8a769ac6cb3 [id=ec77f754c1974d4bbf057719b39c0059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.692343 526 catalog_manager.cc:5696] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
W20260617 07:53:04.692797 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet be14a95f458d440e86133ef65c484571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be14a95f458d440e86133ef65c484571 already in progress: creating tablet
I20260617 07:53:04.693298 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ccf7f07441954d35916890efbfa4d836 (table default.Table_d7a2cf493ddd427c9087f6b6b1971450 [id=8b962c8429894c52a1ba7296a6f02205]). Expected version 2 got 0
W20260617 07:53:04.693464 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ab8388648475499db50cc16a7c36775a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab8388648475499db50cc16a7c36775a already in progress: creating tablet
I20260617 07:53:04.693848 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 2 got 0
I20260617 07:53:04.693948 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 0f9db8a986b344548e435b77edc14cb6
I20260617 07:53:04.696048 532 catalog_manager.cc:6784] ReplaceTablet: tablet 0f9db8a986b344548e435b77edc14cb6 deleted and replaced by tablet 63bf519b83c445798bddda3120b542ce
I20260617 07:53:04.694144 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bbc95ce139d8435387c7952fa8812d3b" } modify_external_catalogs: true
I20260617 07:53:04.697383 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bbc95ce139d8435387c7952fa8812d3b" } modify_external_catalogs: true
W20260617 07:53:04.695406 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 82d682ae37d74b4b967da0f8e2de6301 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d682ae37d74b4b967da0f8e2de6301 already in progress: creating tablet
W20260617 07:53:04.701115 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c7343400555f447b8a1721ba36d7766d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7343400555f447b8a1721ba36d7766d already in progress: creating tablet
I20260617 07:53:04.701309 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 0c21efcad98348ebabcee4821dc4682e
I20260617 07:53:04.702912 895 tablet_service.cc:1511] Processing CreateTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 (DEFAULT_TABLE table=default.Table_b8c2cdf0232f43a2abece8a769ac6cb3 [id=ec77f754c1974d4bbf057719b39c0059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.703336 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ddfb822b5af4bb6b664936c769d9625 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:04.703397 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82e4d6c09bb4414ad7f3b760f7ae681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.703522 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b8c2cdf0232f43a2abece8a769ac6cb3" } modify_external_catalogs: true
I20260617 07:53:04.703732 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b8c2cdf0232f43a2abece8a769ac6cb3" } modify_external_catalogs: true
I20260617 07:53:04.704326 892 tablet_service.cc:1511] Processing CreateTablet for tablet e3275c99834f404f84b96fcc7944cd00 (DEFAULT_TABLE table=default.Table_eb6188f81ced4416b480a7dbd86da65b [id=6a3de6cd076144ecabdfe3c5fe5498bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.704677 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3275c99834f404f84b96fcc7944cd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.705439 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f9db8a986b344548e435b77edc14cb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 63bf519b83c445798bddda3120b542ce) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.705670 894 tablet_service.cc:1511] Processing CreateTablet for tablet de030009192748118b388eec555d90da (DEFAULT_TABLE table=default.Table_a562036b19dd4c99a8981180a617b865 [id=22c75406c0674d11b3f9fd39af55cca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.706159 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_63ca0f0334524b60a193ce1677ca2ee1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.706310 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de030009192748118b388eec555d90da. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:04.706754 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63ca0f0334524b60a193ce1677ca2ee1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.710747 529 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 2 got 0
I20260617 07:53:04.711417 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f9db8a986b344548e435b77edc14cb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 63bf519b83c445798bddda3120b542ce) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.713816 753 tablet_service.cc:1511] Processing CreateTablet for tablet e3275c99834f404f84b96fcc7944cd00 (DEFAULT_TABLE table=default.Table_eb6188f81ced4416b480a7dbd86da65b [id=6a3de6cd076144ecabdfe3c5fe5498bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.714092 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.714499 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a82e4d6c09bb4414ad7f3b760f7ae681
I20260617 07:53:04.715493 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet f2ce51c155c04897a4cf8f7b4ac9a5c6
I20260617 07:53:04.715823 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82e4d6c09bb4414ad7f3b760f7ae681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.717505 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3275c99834f404f84b96fcc7944cd00. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:04.688257 986 leader_election.cc:343] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.691826 1024 tablet_service.cc:1511] Processing CreateTablet for tablet de030009192748118b388eec555d90da (DEFAULT_TABLE table=default.Table_a562036b19dd4c99a8981180a617b865 [id=22c75406c0674d11b3f9fd39af55cca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.719852 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de030009192748118b388eec555d90da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.720290 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e (DEFAULT_TABLE table=default.Table_c3ea195c67814080b1221735affcde43 [id=b5b61c6c229d40ac9e489d535a5b38f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.696393 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f9db8a986b344548e435b77edc14cb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 63bf519b83c445798bddda3120b542ce) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.720633 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53108a2d6c8b4398a568c14df8e0a23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.697343 1026 tablet_service.cc:1511] Processing CreateTablet for tablet e3275c99834f404f84b96fcc7944cd00 (DEFAULT_TABLE table=default.Table_eb6188f81ced4416b480a7dbd86da65b [id=6a3de6cd076144ecabdfe3c5fe5498bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.721377 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3275c99834f404f84b96fcc7944cd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.722364 896 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.722411 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.723500 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 706373f1f5d44edf81ed04183a8bdf89 (DEFAULT_TABLE table=default.Table_412e4d145f3247efb53b3b107b70903a [id=c79a8c153d8b440ba0d42ba644fef938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.723884 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706373f1f5d44edf81ed04183a8bdf89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.705978 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.716117 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.717321 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.720551 1170 ts_tablet_manager.cc:1929] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:04.728703 1170 log.cc:1199] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/1f3b1f601ac04fe996e63725f2d12e56
I20260617 07:53:04.729848 1400 raft_consensus.cc:515] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.731132 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 6ddfb822b5af4bb6b664936c769d9625
I20260617 07:53:04.731484 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e253dca6904dfb914ed4be554da4b5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:04.731876 917 raft_consensus.cc:3060] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.734525 891 tablet_service.cc:1511] Processing CreateTablet for tablet 706373f1f5d44edf81ed04183a8bdf89 (DEFAULT_TABLE table=default.Table_412e4d145f3247efb53b3b107b70903a [id=c79a8c153d8b440ba0d42ba644fef938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.735387 896 tablet_service.cc:1511] Processing CreateTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 (DEFAULT_TABLE table=default.Table_3e98977b52da4e3d825559a506774b17 [id=b7cea59369de444397139db78c303ea5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.741168 1400 leader_election.cc:290] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.742347 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 (DEFAULT_TABLE table=default.Table_cd29e626941b41bfbd49bec00d3a7315 [id=cd79fc14ef8c46309788c945c6267661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.742750 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfb98aecc4546c88371436fcfbf8e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.730420 1170 ts_tablet_manager.cc:1950] T 1f3b1f601ac04fe996e63725f2d12e56 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:04.729920 1172 tablet_bootstrap.cc:654] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.732766 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 (DEFAULT_TABLE table=default.Table_3e98977b52da4e3d825559a506774b17 [id=b7cea59369de444397139db78c303ea5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.745353 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.745425 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae (DEFAULT_TABLE table=default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.745977 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.747550 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffce17fe5c8405a94a93ad7dd67806e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:04.747833 918 raft_consensus.cc:2468] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:04.748709 890 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (DEFAULT_TABLE table=default.Table_11f15932db66445d80bde9f89d93a895 [id=e71a10fd4f804bde81b23cf9d9eb611c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.748728 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_70aa9f32556b4036ae770c6cb7a2c9e6" } new_table_name: "default.Table_c66818ef6cba45cca125f04e646db3cc" modify_external_catalogs: true
I20260617 07:53:04.748832 988 leader_election.cc:304] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:04.748963 898 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 (DEFAULT_TABLE table=default.Table_cd29e626941b41bfbd49bec00d3a7315 [id=cd79fc14ef8c46309788c945c6267661]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.749325 1400 raft_consensus.cc:2804] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:04.749548 1400 raft_consensus.cc:493] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:04.749759 1400 raft_consensus.cc:3060] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.750499 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9bae350dffe04a48933fbb60e3f26699" } modify_external_catalogs: true
I20260617 07:53:04.750662 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9bae350dffe04a48933fbb60e3f26699" } modify_external_catalogs: true
I20260617 07:53:04.750979 528 catalog_manager.cc:6784] ReplaceTablet: tablet 6ddfb822b5af4bb6b664936c769d9625 deleted and replaced by tablet 58ba8963530d49a89fe4eb626225377d
I20260617 07:53:04.751453 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 with delete_type TABLET_DATA_DELETED (replaced by tablet 58ba8963530d49a89fe4eb626225377d) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.752893 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 with delete_type TABLET_DATA_DELETED (replaced by tablet 58ba8963530d49a89fe4eb626225377d) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.754544 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706373f1f5d44edf81ed04183a8bdf89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.754899 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfb98aecc4546c88371436fcfbf8e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.755146 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.758405 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2af44d9ab34e4bbea24d6c7d95748b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.760394 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffce17fe5c8405a94a93ad7dd67806e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:04.760372 1464 tablet.cc:1724] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260617 07:53:04.761956 986 leader_election.cc:343] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.763998 1465 tablet.cc:1724] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:04.736634 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (DEFAULT_TABLE table=default.Table_11f15932db66445d80bde9f89d93a895 [id=e71a10fd4f804bde81b23cf9d9eb611c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.765372 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_2bbb8fb1462c4af1bd93e616c9ba20c5" } new_table_name: "default.Table_508fdaaadb52464f8c6c145656801fc3" modify_external_catalogs: true
I20260617 07:53:04.765805 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2af44d9ab34e4bbea24d6c7d95748b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.765643 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_85519a333a1f4899b5a22d43b69fe3cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.766280 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85519a333a1f4899b5a22d43b69fe3cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.769745 755 tablet_service.cc:1511] Processing CreateTablet for tablet de030009192748118b388eec555d90da (DEFAULT_TABLE table=default.Table_a562036b19dd4c99a8981180a617b865 [id=22c75406c0674d11b3f9fd39af55cca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.770780 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de030009192748118b388eec555d90da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.772294 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e43779214db14ba4b44ebf4eb478fae9" } new_table_name: "default.Table_1e6b5c822e34499dac5e7bda83d587b2" modify_external_catalogs: true
I20260617 07:53:04.773938 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.774169 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet f9e253dca6904dfb914ed4be554da4b5
I20260617 07:53:04.775400 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_94ed63316c4c4d0ba63b1088757d1711" } new_table_name: "default.Table_5de31344614842848efc0a8133386994" modify_external_catalogs: true
I20260617 07:53:04.736238 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 2 got 1
I20260617 07:53:04.739902 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e63db29973b24c64be400ecb2982e867" } modify_external_catalogs: true
I20260617 07:53:04.775841 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e63db29973b24c64be400ecb2982e867" } modify_external_catalogs: true
W20260617 07:53:04.776733 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 763581e2baeb46149bfb38d81301b9c5 consensus state has no leader
I20260617 07:53:04.740514 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_64f2074c78e740dba1d24d6d81809152"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.777209 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64f2074c78e740dba1d24d6d81809152 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.778468 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 875962c2e27a4ee1b9889769d53022cc (table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a]). Expected version 1 got 0
I20260617 07:53:04.781970 760 tablet_service.cc:1558] Processing DeleteTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.782742 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ccf7f07441954d35916890efbfa4d836 (table default.Table_d7a2cf493ddd427c9087f6b6b1971450 [id=8b962c8429894c52a1ba7296a6f02205]). Expected version 2 got 0
I20260617 07:53:04.784976 760 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.784590 895 tablet_service.cc:1511] Processing CreateTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e (DEFAULT_TABLE table=default.Table_c3ea195c67814080b1221735affcde43 [id=b5b61c6c229d40ac9e489d535a5b38f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:04.780038 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69f5b567da0e4baab53c00c55923e920 consensus state has no leader
I20260617 07:53:04.787079 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53108a2d6c8b4398a568c14df8e0a23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.790050 890 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e253dca6904dfb914ed4be554da4b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.790844 752 tablet_service.cc:1511] Processing CreateTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e (DEFAULT_TABLE table=default.Table_c3ea195c67814080b1221735affcde43 [id=b5b61c6c229d40ac9e489d535a5b38f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.792112 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 5a547dabaeb742ba941690f4895955bd
W20260617 07:53:04.793079 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb95639e16ed423fbe60b15a1bcdf5a6 consensus state has no leader
W20260617 07:53:04.793365 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 62b7746239c54ab6828299968d18628d consensus state has no leader
I20260617 07:53:04.794663 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a547dabaeb742ba941690f4895955bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.786237 526 catalog_manager.cc:5696] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:04.795157 1169 ts_tablet_manager.cc:1929] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.795447 1169 log.cc:1199] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/2a2ee285802f47b98c152daad8cfd9d7
I20260617 07:53:04.796221 1169 ts_tablet_manager.cc:1950] T 2a2ee285802f47b98c152daad8cfd9d7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:04.797046 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53108a2d6c8b4398a568c14df8e0a23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.798242 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 4ecf80e090494539ae3d20448f8d1126 (table default.Table_ac940c0f5a9d49babeff827981e9d7d3 [id=829b5684836747b2aa4265ac17eccd80]). Expected version 1 got 0
I20260617 07:53:04.800305 751 tablet_service.cc:1511] Processing CreateTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae (DEFAULT_TABLE table=default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.800737 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.796586 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 (DEFAULT_TABLE table=default.Table_3e98977b52da4e3d825559a506774b17 [id=b7cea59369de444397139db78c303ea5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.802600 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.794584 760 tablet_service.cc:1511] Processing CreateTablet for tablet 706373f1f5d44edf81ed04183a8bdf89 (DEFAULT_TABLE table=default.Table_412e4d145f3247efb53b3b107b70903a [id=c79a8c153d8b440ba0d42ba644fef938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.797849 757 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (DEFAULT_TABLE table=default.Table_11f15932db66445d80bde9f89d93a895 [id=e71a10fd4f804bde81b23cf9d9eb611c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.795495 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_bda16d6b118048ceb24acecf1a6864ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.811867 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bda16d6b118048ceb24acecf1a6864ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.800168 753 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 (DEFAULT_TABLE table=default.Table_cd29e626941b41bfbd49bec00d3a7315 [id=cd79fc14ef8c46309788c945c6267661]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:04.814965 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0f9db8a986b344548e435b77edc14cb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f9db8a986b344548e435b77edc14cb6 already in progress: creating tablet
I20260617 07:53:04.818789 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4a3aea221f46d3a7265bd757616bfe (DEFAULT_TABLE table=default.Table_55cf1cae5fa44c55bef179cc6aa48834 [id=f96c8d7d0be24aa4958290874ff844b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.819228 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4a3aea221f46d3a7265bd757616bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.800981 1171 tablet_bootstrap.cc:492] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.825867 1171 ts_tablet_manager.cc:1403] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.231s user 0.034s sys 0.028s
I20260617 07:53:04.826385 1169 tablet_replica.cc:333] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:04.826951 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 2a2ee285802f47b98c152daad8cfd9d7 (table default.Table_41b3fa5c301945ff93a84c7b89309508 [id=29666c7cf6b54264910c2352e985ea96]) successfully deleted
W20260617 07:53:04.827178 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet f345910256784d2085cb81473534dcaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f345910256784d2085cb81473534dcaf already in progress: creating tablet
W20260617 07:53:04.827531 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0c21efcad98348ebabcee4821dc4682e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c21efcad98348ebabcee4821dc4682e already in progress: creating tablet
W20260617 07:53:04.827932 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a82e4d6c09bb4414ad7f3b760f7ae681 because the tablet was not found. No further retry: Not found: Tablet not found: a82e4d6c09bb4414ad7f3b760f7ae681
W20260617 07:53:04.828141 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 already in progress: creating tablet
I20260617 07:53:04.810940 896 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4a3aea221f46d3a7265bd757616bfe (DEFAULT_TABLE table=default.Table_55cf1cae5fa44c55bef179cc6aa48834 [id=f96c8d7d0be24aa4958290874ff844b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.717558 1023 tablet_service.cc:1511] Processing CreateTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 (DEFAULT_TABLE table=default.Table_b8c2cdf0232f43a2abece8a769ac6cb3 [id=ec77f754c1974d4bbf057719b39c0059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.829239 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4a3aea221f46d3a7265bd757616bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.812716 898 tablet_service.cc:1511] Processing CreateTablet for tablet 36ce60b466f7420992ef194d72b5718d (DEFAULT_TABLE table=default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.811699 1475 tablet.cc:1724] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:04.834740 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 006b71a3287240a5b15bfd489f514f4c (table default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]). Expected version 2 got 1
I20260617 07:53:04.815164 917 raft_consensus.cc:2468] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:04.820813 897 tablet_service.cc:1511] Processing CreateTablet for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (DEFAULT_TABLE table=default.Table_b365fa4f3a0147ef9b28a320dab6f49f [id=5cbacc3e094b4c6184605bc50566e275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.821195 892 tablet_service.cc:1511] Processing CreateTablet for tablet df4f9101deaa4e6ebddacbce14f32810 (DEFAULT_TABLE table=default.Table_996d5685c9904502b299700425b29a1d [id=534b1a750b5a4b5db2ae4aaa7b47f379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.826681 1171 raft_consensus.cc:359] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.836670 1171 raft_consensus.cc:385] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.836755 1171 raft_consensus.cc:740] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.837108 1169 raft_consensus.cc:2243] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.837023 1171 consensus_queue.cc:260] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.837265 1169 raft_consensus.cc:2272] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.837522 1171 ts_tablet_manager.cc:1434] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260617 07:53:04.810940 890 tablet_service.cc:1511] Processing CreateTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae (DEFAULT_TABLE table=default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.837826 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706373f1f5d44edf81ed04183a8bdf89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.834000 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ce60b466f7420992ef194d72b5718d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.839210 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a547dabaeb742ba941690f4895955bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.839243 751 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e253dca6904dfb914ed4be554da4b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.841858 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5ddac997834e97a2d6c9b1855ee4e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.843277 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.843605 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfb98aecc4546c88371436fcfbf8e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.845322 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2af44d9ab34e4bbea24d6c7d95748b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.845917 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 1f3b1f601ac04fe996e63725f2d12e56 (table default.Table_456aace94223474f82d1801ec38d7b43 [id=cbd872cee78b4535b90941504bafc133]) successfully deleted
I20260617 07:53:04.846256 1171 tablet_bootstrap.cc:492] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.847986 1171 tablet_bootstrap.cc:654] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.849762 1169 ts_tablet_manager.cc:1916] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:04.850872 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 8fa23bb0929440b1820afdce4b9e8d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fa23bb0929440b1820afdce4b9e8d8c already in progress: creating tablet
W20260617 07:53:04.851621 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet f345910256784d2085cb81473534dcaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f345910256784d2085cb81473534dcaf already in progress: creating tablet
I20260617 07:53:04.851794 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a547dabaeb742ba941690f4895955bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.856668 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_f906af88bdcd40169dad534822931936"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.857313 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f906af88bdcd40169dad534822931936 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.846630 1400 raft_consensus.cc:515] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.867765 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4f9101deaa4e6ebddacbce14f32810. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:04.867967 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c7e43e1a3df54efe992a86dd0bd0c149 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7e43e1a3df54efe992a86dd0bd0c149 already in progress: creating tablet
I20260617 07:53:04.870448 1017 tablet_service.cc:1511] Processing CreateTablet for tablet df4f9101deaa4e6ebddacbce14f32810 (DEFAULT_TABLE table=default.Table_996d5685c9904502b299700425b29a1d [id=534b1a750b5a4b5db2ae4aaa7b47f379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.870836 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4f9101deaa4e6ebddacbce14f32810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.872983 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_ffd2c46b97334436a592c497f3a8fa2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.873504 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffd2c46b97334436a592c497f3a8fa2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.873804 1169 ts_tablet_manager.cc:1929] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.873940 1169 log.cc:1199] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/1f3b1f601ac04fe996e63725f2d12e56
I20260617 07:53:04.875303 1170 tablet_replica.cc:333] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:04.876147 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5fdacd3c9f8f443bac56aa55916c3575"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:04.876624 1170 raft_consensus.cc:2243] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:04.876852 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 36ce60b466f7420992ef194d72b5718d (DEFAULT_TABLE table=default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.877018 1169 ts_tablet_manager.cc:1950] T 1f3b1f601ac04fe996e63725f2d12e56 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:04.878597 1400 leader_election.cc:290] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:04.878891 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 1f3b1f601ac04fe996e63725f2d12e56 (table default.Table_456aace94223474f82d1801ec38d7b43 [id=cbd872cee78b4535b90941504bafc133]) successfully deleted
I20260617 07:53:04.879781 1169 tablet_replica.cc:333] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:04.880003 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fdacd3c9f8f443bac56aa55916c3575 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.880270 1169 raft_consensus.cc:2243] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:04.880802 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffce17fe5c8405a94a93ad7dd67806e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:04.880920 1169 pending_rounds.cc:70] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:04.881409 1169 pending_rounds.cc:77] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772681583407104 op_type: NO_OP noop_request { }
I20260617 07:53:04.881778 1169 raft_consensus.cc:2889] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:04.881765 751 tablet_service.cc:1511] Processing CreateTablet for tablet 36ce60b466f7420992ef194d72b5718d (DEFAULT_TABLE table=default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.882201 1169 raft_consensus.cc:2272] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:04.882349 986 leader_election.cc:343] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.883039 1169 ts_tablet_manager.cc:1916] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.883155 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ce60b466f7420992ef194d72b5718d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.885025 895 tablet_service.cc:1558] Processing DeleteTablet for tablet a5b7b95327604ef8b43944c4821d4ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.886364 1171 tablet_bootstrap.cc:492] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.886508 1171 ts_tablet_manager.cc:1403] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.002s
I20260617 07:53:04.887498 1171 raft_consensus.cc:359] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.887672 1171 raft_consensus.cc:385] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.887776 1171 raft_consensus.cc:740] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.888015 1171 consensus_queue.cc:260] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.889819 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 with delete_type TABLET_DATA_DELETED (replaced by tablet 58ba8963530d49a89fe4eb626225377d) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:04.891649 1171 ts_tablet_manager.cc:1434] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:04.891993 1171 tablet_bootstrap.cc:492] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.893345 751 tablet_service.cc:1511] Processing CreateTablet for tablet df4f9101deaa4e6ebddacbce14f32810 (DEFAULT_TABLE table=default.Table_996d5685c9904502b299700425b29a1d [id=534b1a750b5a4b5db2ae4aaa7b47f379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.893908 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4f9101deaa4e6ebddacbce14f32810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.897958 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ce60b466f7420992ef194d72b5718d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.899168 1171 tablet_bootstrap.cc:654] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.901098 1019 tablet_service.cc:1511] Processing CreateTablet for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (DEFAULT_TABLE table=default.Table_b365fa4f3a0147ef9b28a320dab6f49f [id=5cbacc3e094b4c6184605bc50566e275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.901489 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5ddac997834e97a2d6c9b1855ee4e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:04.901952 986 consensus_peers.cc:597] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:04.905786 988 consensus_peers.cc:597] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 076c6f6f406842ceb3db75e886e3ce50. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:04.905896 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 81809.1us
I20260617 07:53:04.906343 988 leader_election.cc:304] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.909091 1364 raft_consensus.cc:2804] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.909250 1364 raft_consensus.cc:697] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:04.909497 1364 consensus_queue.cc:237] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.913225 1170 pending_rounds.cc:70] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:04.915756 1170 pending_rounds.cc:77] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772683548704768 op_type: NO_OP noop_request { }
I20260617 07:53:04.916100 1170 raft_consensus.cc:2889] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:04.916388 1170 raft_consensus.cc:2272] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.917147 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffce17fe5c8405a94a93ad7dd67806e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:04.917393 917 raft_consensus.cc:3060] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:04.918704 1171 tablet_bootstrap.cc:492] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:04.919106 1171 ts_tablet_manager.cc:1403] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260617 07:53:04.919981 1171 raft_consensus.cc:359] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.920244 1171 raft_consensus.cc:385] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.920343 1171 raft_consensus.cc:740] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.920572 1169 ts_tablet_manager.cc:1929] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:04.922164 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e253dca6904dfb914ed4be554da4b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:04.920725 1171 consensus_queue.cc:260] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.922827 1171 ts_tablet_manager.cc:1434] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:04.923122 1171 tablet_bootstrap.cc:492] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:04.925066 1171 tablet_bootstrap.cc:654] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.922326 917 raft_consensus.cc:2468] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:04.926465 523 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e] alter complete (version 2)
I20260617 07:53:04.926506 988 leader_election.cc:304] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:04.928125 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_fc5f3ba5ab8a45c7bab81747fe42b662"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.928771 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc5f3ba5ab8a45c7bab81747fe42b662 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.931636 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82e4d6c09bb4414ad7f3b760f7ae681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.933704 523 master_service.cc:960] ReplaceTablet: received request to replace tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:04.934170 1169 log.cc:1199] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/e364eed959174ef2a8fbbe7bb2215fa1
I20260617 07:53:04.934721 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_91270a2fce904166a732f7bb47392c7e" } new_table_name: "default.Table_6e54085dfd0041d2bdb49961526e7594" modify_external_catalogs: true
I20260617 07:53:04.935111 1169 ts_tablet_manager.cc:1950] T e364eed959174ef2a8fbbe7bb2215fa1 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:04.935428 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b99b80966c94937baf7172b0c36af2a with delete_type TABLET_DATA_DELETED (replaced by tablet 82d682ae37d74b4b967da0f8e2de6301) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.935531 895 tablet_service.cc:1511] Processing CreateTablet for tablet ee0e12aa4c60457182201a94caecda45 (DEFAULT_TABLE table=default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.935669 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 787467c65f68442aad071df16d4492f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:04.935964 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0e12aa4c60457182201a94caecda45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.936053 897 tablet_service.cc:1511] Processing CreateTablet for tablet 75f32eb8ec894e029a428bbd62caa0f5 (DEFAULT_TABLE table=default.Table_a0dbb3e035514253b4f61f11d26da473 [id=07f503d6e3f34dbc9eacdead783c4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.936358 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f32eb8ec894e029a428bbd62caa0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.936596 1400 raft_consensus.cc:2804] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:04.936781 1400 raft_consensus.cc:697] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:04.937093 1400 consensus_queue.cc:237] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.939327 1178 tablet_bootstrap.cc:492] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:04.939245 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_f1b008ef7b254737ab725b7bb9ffd48d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.939829 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1b008ef7b254737ab725b7bb9ffd48d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.940467 892 tablet_service.cc:1511] Processing CreateTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 (DEFAULT_TABLE table=default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.940873 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38bb8a140ef4bcab65aaa03bdb79040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.941375 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_94b6f54366a140ccad0120180ad1ed11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:04.941977 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94b6f54366a140ccad0120180ad1ed11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:04.944356 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 59acdc64fe9247d28c4c277161b42f4f from {username='slave'} at 127.0.0.1:42828
W20260617 07:53:04.949333 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5a547dabaeb742ba941690f4895955bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a547dabaeb742ba941690f4895955bd already in progress: creating tablet
I20260617 07:53:04.953469 1169 tablet_replica.cc:333] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:04.954510 1169 raft_consensus.cc:2243] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.955158 1169 raft_consensus.cc:2272] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.956465 1169 ts_tablet_manager.cc:1916] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.957453 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4a3aea221f46d3a7265bd757616bfe (DEFAULT_TABLE table=default.Table_55cf1cae5fa44c55bef179cc6aa48834 [id=f96c8d7d0be24aa4958290874ff844b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.961925 1024 tablet_service.cc:1511] Processing CreateTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 (DEFAULT_TABLE table=default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.962602 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38bb8a140ef4bcab65aaa03bdb79040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.965674 755 tablet_service.cc:1511] Processing CreateTablet for tablet 75f32eb8ec894e029a428bbd62caa0f5 (DEFAULT_TABLE table=default.Table_a0dbb3e035514253b4f61f11d26da473 [id=07f503d6e3f34dbc9eacdead783c4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.966732 1019 tablet_service.cc:1511] Processing CreateTablet for tablet ee0e12aa4c60457182201a94caecda45 (DEFAULT_TABLE table=default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.971189 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0e12aa4c60457182201a94caecda45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.970598 1172 tablet_bootstrap.cc:492] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:04.972419 1172 ts_tablet_manager.cc:1403] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.299s user 0.008s sys 0.006s
I20260617 07:53:04.973311 1172 raft_consensus.cc:359] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.973488 1172 raft_consensus.cc:385] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:04.974025 1172 raft_consensus.cc:740] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:04.974308 1172 consensus_queue.cc:260] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:04.975251 1172 ts_tablet_manager.cc:1434] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:04.975672 1172 tablet_bootstrap.cc:492] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:04.976675 758 tablet_service.cc:1511] Processing CreateTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 (DEFAULT_TABLE table=default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.977428 1169 ts_tablet_manager.cc:1929] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:04.977607 1172 tablet_bootstrap.cc:654] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:04.980582 1169 log.cc:1199] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/1ffce17fe5c8405a94a93ad7dd67806e
I20260617 07:53:04.981395 1169 ts_tablet_manager.cc:1950] T 1ffce17fe5c8405a94a93ad7dd67806e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:04.983635 1169 tablet_replica.cc:333] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:04.983822 751 tablet_service.cc:1511] Processing CreateTablet for tablet ee0e12aa4c60457182201a94caecda45 (DEFAULT_TABLE table=default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.984292 756 tablet_service.cc:1511] Processing CreateTablet for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (DEFAULT_TABLE table=default.Table_b365fa4f3a0147ef9b28a320dab6f49f [id=5cbacc3e094b4c6184605bc50566e275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.985092 754 tablet_service.cc:1511] Processing CreateTablet for tablet a2f21861cb6f481eae968edc733e6e6f (DEFAULT_TABLE table=default.Table_43006192468f4543a9781c8787493737 [id=12d27e43b2da42f7b55dbf5c9f4b103f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.985339 1169 raft_consensus.cc:2243] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:04.985869 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4a3aea221f46d3a7265bd757616bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.985971 1169 raft_consensus.cc:2272] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:04.986441 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f21861cb6f481eae968edc733e6e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.986989 1169 ts_tablet_manager.cc:1916] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.988214 1170 ts_tablet_manager.cc:1916] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:04.988535 1341 raft_consensus.cc:493] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:04.988695 1341 raft_consensus.cc:515] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:04.989320 1341 leader_election.cc:290] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:04.991051 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787467c65f68442aad071df16d4492f3" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:04.994030 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787467c65f68442aad071df16d4492f3" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:04.994817 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5ddac997834e97a2d6c9b1855ee4e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:04.994992 851 leader_election.cc:343] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:04.995195 852 leader_election.cc:343] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:04.995317 852 leader_election.cc:304] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:04.995566 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 75f32eb8ec894e029a428bbd62caa0f5 (DEFAULT_TABLE table=default.Table_a0dbb3e035514253b4f61f11d26da473 [id=07f503d6e3f34dbc9eacdead783c4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:04.995844 1341 raft_consensus.cc:2749] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:04.996024 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f32eb8ec894e029a428bbd62caa0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:04.999234 1169 ts_tablet_manager.cc:1929] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 07:53:05.002234 986 consensus_peers.cc:597] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a2ee285802f47b98c152daad8cfd9d7. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.003469 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38bb8a140ef4bcab65aaa03bdb79040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.008173 1169 log.cc:1199] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/086e43b610f9430c872daeef35c5586a
I20260617 07:53:05.009092 1169 ts_tablet_manager.cc:1950] T 086e43b610f9430c872daeef35c5586a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:05.009896 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f32eb8ec894e029a428bbd62caa0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.010385 1172 tablet_bootstrap.cc:492] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.010847 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 58ba8963530d49a89fe4eb626225377d (DEFAULT_TABLE table=default.Table_d9199c2565854964a10bba9e6474732f [id=4e86a2cea5304843b61370201d4d13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.011255 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ba8963530d49a89fe4eb626225377d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.012976 1169 tablet_replica.cc:333] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:05.013177 1169 raft_consensus.cc:2243] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.013325 1169 raft_consensus.cc:2272] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.013847 1169 ts_tablet_manager.cc:1916] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.014021 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 (DEFAULT_TABLE table=default.Table_34fb38a5ef96468bbf08872ea10e8a5f [id=01a22a92af6f4e8ba076834cad8ba182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.014396 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dcfb101cf51487692ef9a6a17f40804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.017184 1024 tablet_service.cc:1511] Processing CreateTablet for tablet d657fbccb4af40558033a971aab7f3e4 (DEFAULT_TABLE table=default.Table_de275810487f4911a911f2d6e00a8963 [id=1f208e21034e47a8a25e0e9988e5b156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.017246 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 464cf1effff241608f4a7255f2646b04 (DEFAULT_TABLE table=default.Table_85519a333a1f4899b5a22d43b69fe3cb [id=a141eeb977ca4329ac1404fefb355281]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.017627 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d657fbccb4af40558033a971aab7f3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.017768 1178 ts_tablet_manager.cc:1403] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.456s user 0.001s sys 0.029s
I20260617 07:53:05.018564 1178 raft_consensus.cc:359] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.018807 1178 raft_consensus.cc:385] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.018904 1178 raft_consensus.cc:740] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.019212 1178 consensus_queue.cc:260] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.019635 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464cf1effff241608f4a7255f2646b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.025640 1170 ts_tablet_manager.cc:1929] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:04.951206 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet e364eed959174ef2a8fbbe7bb2215fa1 (table default.Table_1aea035e85d3436abb2bfaea4f748368 [id=b30bf68f0a1649398cd7c8a8c0ca116e]) successfully deleted
W20260617 07:53:05.025902 519 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 74680.4us
W20260617 07:53:05.026787 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c7e43e1a3df54efe992a86dd0bd0c149 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7e43e1a3df54efe992a86dd0bd0c149 already in progress: creating tablet
I20260617 07:53:05.027275 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 1ffce17fe5c8405a94a93ad7dd67806e (table default.Table_bac89c3b70e94d8f84681a0043fa2ea8 [id=6b5d086b3d7c428b824a39387d817f14]) successfully deleted
I20260617 07:53:05.027457 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 086e43b610f9430c872daeef35c5586a (table default.Table_09a7839ef9df4c6cb77cf0a55a133446 [id=e2e28ecbf16446ae9e53e20ff4537b7d]) successfully deleted
I20260617 07:53:04.979822 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 59acdc64fe9247d28c4c277161b42f4f
I20260617 07:53:05.028062 527 catalog_manager.cc:6784] ReplaceTablet: tablet 59acdc64fe9247d28c4c277161b42f4f deleted and replaced by tablet a632b42300d64471b516008ebca3312f
W20260617 07:53:05.028872 517 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 79530.8us
W20260617 07:53:05.029086 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f9e253dca6904dfb914ed4be554da4b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9e253dca6904dfb914ed4be554da4b5 already in progress: creating tablet
W20260617 07:53:05.029425 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6ddfb822b5af4bb6b664936c769d9625 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ddfb822b5af4bb6b664936c769d9625 already in progress: creating tablet
I20260617 07:53:05.032085 754 tablet_service.cc:1511] Processing CreateTablet for tablet d657fbccb4af40558033a971aab7f3e4 (DEFAULT_TABLE table=default.Table_de275810487f4911a911f2d6e00a8963 [id=1f208e21034e47a8a25e0e9988e5b156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.032546 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d657fbccb4af40558033a971aab7f3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.032629 898 tablet_service.cc:1511] Processing CreateTablet for tablet 92e55be5f28740fba65c1199a571d97a (DEFAULT_TABLE table=default.Table_93a6fb533319471aa6c304e5fe867477 [id=061cdaef8556415dad01eccb24949518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.033644 892 tablet_service.cc:1511] Processing CreateTablet for tablet a2f21861cb6f481eae968edc733e6e6f (DEFAULT_TABLE table=default.Table_43006192468f4543a9781c8787493737 [id=12d27e43b2da42f7b55dbf5c9f4b103f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.034206 893 tablet_service.cc:1511] Processing CreateTablet for tablet 464cf1effff241608f4a7255f2646b04 (DEFAULT_TABLE table=default.Table_85519a333a1f4899b5a22d43b69fe3cb [id=a141eeb977ca4329ac1404fefb355281]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.034701 894 tablet_service.cc:1511] Processing CreateTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 (DEFAULT_TABLE table=default.Table_47a904a2ae6045519235b5988330eeff [id=a2296f2b299d464f8e70d9dce376b4a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.035035 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.026153 1023 tablet_service.cc:1511] Processing CreateTablet for tablet a2f21861cb6f481eae968edc733e6e6f (DEFAULT_TABLE table=default.Table_43006192468f4543a9781c8787493737 [id=12d27e43b2da42f7b55dbf5c9f4b103f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.028821 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.036803 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e55be5f28740fba65c1199a571d97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.029399 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 (DEFAULT_TABLE table=default.Table_47a904a2ae6045519235b5988330eeff [id=a2296f2b299d464f8e70d9dce376b4a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.037179 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.038444 896 tablet_service.cc:1511] Processing CreateTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 (DEFAULT_TABLE table=default.Table_34fb38a5ef96468bbf08872ea10e8a5f [id=01a22a92af6f4e8ba076834cad8ba182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.039279 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dcfb101cf51487692ef9a6a17f40804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.039650 1475 tablet.cc:1724] T 36cbea7b0f024422bc281ea97f6d76d5 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:05.043134 895 tablet_service.cc:1511] Processing CreateTablet for tablet cbc79cfa11e342bd87da1aa03847c3cb (DEFAULT_TABLE table=default.Table_ee7079d18a5b466aacf7a9c709ae6dc8 [id=ad4030fa284949019fea2539566b66aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.043411 890 tablet_service.cc:1511] Processing CreateTablet for tablet 58ba8963530d49a89fe4eb626225377d (DEFAULT_TABLE table=default.Table_d9199c2565854964a10bba9e6474732f [id=4e86a2cea5304843b61370201d4d13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.033571 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 92e55be5f28740fba65c1199a571d97a (DEFAULT_TABLE table=default.Table_93a6fb533319471aa6c304e5fe867477 [id=061cdaef8556415dad01eccb24949518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.034492 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 63bf519b83c445798bddda3120b542ce (DEFAULT_TABLE table=default.Table_a97317a462514e6384cb34f5fa00851f [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.035416 1172 ts_tablet_manager.cc:1403] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260617 07:53:05.044258 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.044360 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bf519b83c445798bddda3120b542ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.045009 1172 raft_consensus.cc:359] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.045228 1172 raft_consensus.cc:385] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.045297 1172 raft_consensus.cc:740] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.045599 1172 consensus_queue.cc:260] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.045867 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464cf1effff241608f4a7255f2646b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.046525 1465 tablet.cc:1724] T 36cbea7b0f024422bc281ea97f6d76d5 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:05.046854 1172 ts_tablet_manager.cc:1434] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:05.047201 1172 tablet_bootstrap.cc:492] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.036562 1019 tablet_service.cc:1511] Processing CreateTablet for tablet cbc79cfa11e342bd87da1aa03847c3cb (DEFAULT_TABLE table=default.Table_ee7079d18a5b466aacf7a9c709ae6dc8 [id=ad4030fa284949019fea2539566b66aa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:05.051802 852 consensus_peers.cc:597] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.055591 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f21861cb6f481eae968edc733e6e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.057003 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ba8963530d49a89fe4eb626225377d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.049907 889 tablet_service.cc:1511] Processing CreateTablet for tablet 63bf519b83c445798bddda3120b542ce (DEFAULT_TABLE table=default.Table_a97317a462514e6384cb34f5fa00851f [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.057699 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc79cfa11e342bd87da1aa03847c3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.058068 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e55be5f28740fba65c1199a571d97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.058293 897 tablet_service.cc:1511] Processing CreateTablet for tablet d657fbccb4af40558033a971aab7f3e4 (DEFAULT_TABLE table=default.Table_de275810487f4911a911f2d6e00a8963 [id=1f208e21034e47a8a25e0e9988e5b156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.058889 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f21861cb6f481eae968edc733e6e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.059082 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d657fbccb4af40558033a971aab7f3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.059614 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bf519b83c445798bddda3120b542ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.060524 1170 log.cc:1199] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/076c6f6f406842ceb3db75e886e3ce50
I20260617 07:53:05.062393 1172 tablet_bootstrap.cc:654] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.063827 1170 ts_tablet_manager.cc:1950] T 076c6f6f406842ceb3db75e886e3ce50 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:05.064395 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 076c6f6f406842ceb3db75e886e3ce50 (table default.Table_109a002e502a44d99c0e775b394e5c38 [id=6f5f5cfa42c54ca3964df6f9e25f18ae]) successfully deleted
I20260617 07:53:05.066905 1169 ts_tablet_manager.cc:1929] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.067118 1169 log.cc:1199] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/52ae3c99bec7426caac18a6e3880bf51
I20260617 07:53:05.067534 1169 ts_tablet_manager.cc:1950] T 52ae3c99bec7426caac18a6e3880bf51 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:05.068610 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 52ae3c99bec7426caac18a6e3880bf51 (table default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]) successfully deleted
I20260617 07:53:05.068774 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc79cfa11e342bd87da1aa03847c3cb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:05.069425 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ab8388648475499db50cc16a7c36775a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab8388648475499db50cc16a7c36775a already in progress: creating tablet
W20260617 07:53:05.070103 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2684f3200e604bb6bf37a2f97a193eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2684f3200e604bb6bf37a2f97a193eff already in progress: creating tablet
W20260617 07:53:05.070740 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet be14a95f458d440e86133ef65c484571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be14a95f458d440e86133ef65c484571 already in progress: creating tablet
W20260617 07:53:05.071384 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5adee4d54cd94c4b9c45991762d91622 because the tablet was not found. No further retry: Not found: Tablet not found: 5adee4d54cd94c4b9c45991762d91622
W20260617 07:53:05.072033 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 82d682ae37d74b4b967da0f8e2de6301 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d682ae37d74b4b967da0f8e2de6301 already in progress: creating tablet
W20260617 07:53:05.073108 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c7343400555f447b8a1721ba36d7766d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7343400555f447b8a1721ba36d7766d already in progress: creating tablet
I20260617 07:53:05.073479 1169 tablet_replica.cc:333] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:05.079037 527 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: default.Table_6e54085dfd0041d2bdb49961526e7594 [id=6f0e007c645a43e6a9611001e0de1864] alter complete (version 2)
I20260617 07:53:05.083421 1170 tablet_replica.cc:333] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:05.083667 1170 raft_consensus.cc:2243] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:05.084112 1364 raft_consensus.cc:493] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.084275 1364 raft_consensus.cc:515] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.084698 1170 pending_rounds.cc:70] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:05.084797 1170 pending_rounds.cc:77] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772685669433344 op_type: NO_OP noop_request { }
I20260617 07:53:05.084914 1170 raft_consensus.cc:2889] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:05.084978 1364 leader_election.cc:290] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.085036 1170 raft_consensus.cc:2272] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.085821 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b7b95327604ef8b43944c4821d4ed7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.086320 986 leader_election.cc:343] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.086987 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd (DEFAULT_TABLE table=default.Table_64f2074c78e740dba1d24d6d81809152 [id=daa30b155c944cb098436474cfd8321c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.087162 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b7b95327604ef8b43944c4821d4ed7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:05.087376 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.087385 917 raft_consensus.cc:2468] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:05.088526 988 leader_election.cc:304] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:05.088920 1364 raft_consensus.cc:2804] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:05.089004 1364 raft_consensus.cc:493] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:05.089316 1364 raft_consensus.cc:3060] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.091261 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0e12aa4c60457182201a94caecda45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.091495 1170 ts_tablet_manager.cc:1916] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:05.097288 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet cb95639e16ed423fbe60b15a1bcdf5a6 (table default.Table_1e6b5c822e34499dac5e7bda83d587b2 [id=f2f2591e0ed7444d87b0149a964ba958], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cb95639e16ed423fbe60b15a1bcdf5a6 consensus state has no leader
I20260617 07:53:05.098421 1171 tablet_bootstrap.cc:492] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:05.098661 1171 ts_tablet_manager.cc:1403] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.176s user 0.008s sys 0.028s
I20260617 07:53:05.098873 894 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd (DEFAULT_TABLE table=default.Table_64f2074c78e740dba1d24d6d81809152 [id=daa30b155c944cb098436474cfd8321c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.099352 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.099555 1171 raft_consensus.cc:359] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.092689 1364 raft_consensus.cc:515] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.099746 1171 raft_consensus.cc:385] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.099861 1171 raft_consensus.cc:740] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.100136 1171 consensus_queue.cc:260] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.100642 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b7b95327604ef8b43944c4821d4ed7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:05.101250 986 leader_election.cc:343] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.101636 1364 leader_election.cc:290] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.098282 1172 tablet_bootstrap.cc:492] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.102240 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b7b95327604ef8b43944c4821d4ed7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:05.102366 1172 ts_tablet_manager.cc:1403] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.004s
I20260617 07:53:05.102443 917 raft_consensus.cc:3060] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.103163 1172 raft_consensus.cc:359] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.103335 1172 raft_consensus.cc:385] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.103425 1172 raft_consensus.cc:740] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.103627 1172 consensus_queue.cc:260] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.105010 1172 ts_tablet_manager.cc:1434] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:05.105057 917 raft_consensus.cc:2468] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:05.105516 988 leader_election.cc:304] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:05.105767 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9d9ed003c64b1abed6bd3bb14456cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:05.105973 988 consensus_peers.cc:597] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2063248863ed46c196c93013230529fe. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.106063 1172 tablet_bootstrap.cc:492] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.106415 1364 raft_consensus.cc:2804] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:05.107332 1178 ts_tablet_manager.cc:1434] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.089s user 0.001s sys 0.001s
I20260617 07:53:05.107909 1169 raft_consensus.cc:2243] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.108210 1169 raft_consensus.cc:2272] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.109035 1169 ts_tablet_manager.cc:1916] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.109649 1178 tablet_bootstrap.cc:492] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.111606 1178 tablet_bootstrap.cc:654] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.112792 1171 ts_tablet_manager.cc:1434] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260617 07:53:05.113174 1171 tablet_bootstrap.cc:492] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:05.114002 1364 raft_consensus.cc:697] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:05.114302 1364 consensus_queue.cc:237] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.118304 1341 consensus_queue.cc:1048] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:05.120981 527 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 452f7d2bceb5447290370f72ec788608 (table default.Table_4d28d190e4ca42dc96c1b61c33672c61 [id=26e1a39e290446dd976682e916b6bd0d]). Expected version 1 got 0
I20260617 07:53:05.122938 1169 ts_tablet_manager.cc:1929] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.127094 1169 log.cc:1199] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/c3a29aeb0a224cabb642f4100c44b8f3
I20260617 07:53:05.127604 1169 ts_tablet_manager.cc:1950] T c3a29aeb0a224cabb642f4100c44b8f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:05.128222 988 consensus_peers.cc:597] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a2ee285802f47b98c152daad8cfd9d7. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.129166 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet c3a29aeb0a224cabb642f4100c44b8f3 (table default.Table_8fa833038123494b9119b22687fe004a [id=c94c06472dc34885962dd964aa186105]) successfully deleted
W20260617 07:53:05.129937 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0f9db8a986b344548e435b77edc14cb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f9db8a986b344548e435b77edc14cb6 already in progress: creating tablet
I20260617 07:53:05.130414 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_93a6fb533319471aa6c304e5fe867477" } modify_external_catalogs: true
I20260617 07:53:05.130597 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_93a6fb533319471aa6c304e5fe867477" } modify_external_catalogs: true
W20260617 07:53:05.130688 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0c21efcad98348ebabcee4821dc4682e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c21efcad98348ebabcee4821dc4682e already in progress: creating tablet
I20260617 07:53:05.130900 749 tablet_service.cc:1511] Processing CreateTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 (DEFAULT_TABLE table=default.Table_47a904a2ae6045519235b5988330eeff [id=a2296f2b299d464f8e70d9dce376b4a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.131338 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:05.131247 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 already in progress: creating tablet
I20260617 07:53:05.131462 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b8214873449f45f6be18047115a40c52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.131964 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a82e4d6c09bb4414ad7f3b760f7ae681 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a82e4d6c09bb4414ad7f3b760f7ae681 already in progress: creating tablet
W20260617 07:53:05.132014 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8214873449f45f6be18047115a40c52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:05.132601 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6ddfb822b5af4bb6b664936c769d9625 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ddfb822b5af4bb6b664936c769d9625 already in progress: creating tablet
I20260617 07:53:05.132870 1169 tablet_replica.cc:333] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:05.133056 1169 raft_consensus.cc:2243] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.133215 1169 raft_consensus.cc:2272] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.133545 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_06fa0ccce8ce4cfcaccd930305faeec5" } new_table_name: "default.Table_0dbea7a9d97244c68fe21e0b62ed8870" modify_external_catalogs: true
I20260617 07:53:05.133737 1169 ts_tablet_manager.cc:1916] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.133885 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.134294 759 tablet_service.cc:1511] Processing CreateTablet for tablet 63bf519b83c445798bddda3120b542ce (DEFAULT_TABLE table=default.Table_a97317a462514e6384cb34f5fa00851f [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.134666 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bf519b83c445798bddda3120b542ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.135114 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_64f2074c78e740dba1d24d6d81809152" } new_table_name: "default.Table_378c24318c924a5e8dcfb5295dc43493" modify_external_catalogs: true
I20260617 07:53:05.136718 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1e6b5c822e34499dac5e7bda83d587b2" } modify_external_catalogs: true
I20260617 07:53:05.136853 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1e6b5c822e34499dac5e7bda83d587b2" } modify_external_catalogs: true
I20260617 07:53:05.137984 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f906af88bdcd40169dad534822931936" } modify_external_catalogs: true
I20260617 07:53:05.138146 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f906af88bdcd40169dad534822931936" } modify_external_catalogs: true
I20260617 07:53:05.138621 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bda16d6b118048ceb24acecf1a6864ce" } modify_external_catalogs: true
I20260617 07:53:05.138763 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bda16d6b118048ceb24acecf1a6864ce" } modify_external_catalogs: true
I20260617 07:53:05.138777 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 076c6f6f406842ceb3db75e886e3ce50 with delete_type TABLET_DATA_DELETED (replaced by tablet 82cf9c672f3b4567b63e878a6ab11334) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.139938 1172 tablet_bootstrap.cc:654] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.140496 1171 tablet_bootstrap.cc:654] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.140533 1169 ts_tablet_manager.cc:1929] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.140669 1169 log.cc:1199] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/f9e253dca6904dfb914ed4be554da4b5
I20260617 07:53:05.141111 1169 ts_tablet_manager.cc:1950] T f9e253dca6904dfb914ed4be554da4b5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:05.142431 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet f9e253dca6904dfb914ed4be554da4b5 (table default.Table_9bae350dffe04a48933fbb60e3f26699 [id=d455eadd7e304b7bbb55ccff97befb5c]) successfully deleted
I20260617 07:53:05.142737 1341 raft_consensus.cc:493] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.142874 1341 raft_consensus.cc:515] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:05.143114 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5a547dabaeb742ba941690f4895955bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a547dabaeb742ba941690f4895955bd already in progress: creating tablet
I20260617 07:53:05.143507 1341 leader_election.cc:290] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:05.143482 1169 tablet_replica.cc:333] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:05.143817 1169 raft_consensus.cc:2243] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.144001 1169 raft_consensus.cc:2272] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.143992 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875962c2e27a4ee1b9889769d53022cc" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.144495 852 leader_election.cc:343] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.144783 1169 ts_tablet_manager.cc:1916] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:05.151371 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f2d9e473fd444efa6ab63cc51dbb2bd consensus state has no leader
W20260617 07:53:05.151820 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7d9354c81df42fb9756045e659be26d consensus state has no leader
I20260617 07:53:05.152786 1169 ts_tablet_manager.cc:1929] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.153524 1172 tablet_bootstrap.cc:492] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.153692 1169 log.cc:1199] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a5b7b95327604ef8b43944c4821d4ed7
I20260617 07:53:05.154171 1169 ts_tablet_manager.cc:1950] T a5b7b95327604ef8b43944c4821d4ed7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:05.154016 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875962c2e27a4ee1b9889769d53022cc" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:05.154420 1050 raft_consensus.cc:2468] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:05.155025 1172 ts_tablet_manager.cc:1403] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.001s
I20260617 07:53:05.156222 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a5b7b95327604ef8b43944c4821d4ed7 (table default.Table_5fcf50bba845478aa1765c2ac162b1c1 [id=0d961292ee114171bd682606f6df393d]) successfully deleted
I20260617 07:53:05.157246 1172 raft_consensus.cc:359] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.157519 1169 tablet_replica.cc:333] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:05.157653 1172 raft_consensus.cc:385] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.157684 851 leader_election.cc:304] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:05.157954 1169 raft_consensus.cc:2243] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.158097 1169 raft_consensus.cc:2272] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.158245 1172 raft_consensus.cc:740] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.158604 1172 consensus_queue.cc:260] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.159217 1172 ts_tablet_manager.cc:1434] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 07:53:05.160724 1169 ts_tablet_manager.cc:1916] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.161834 1341 raft_consensus.cc:2804] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:05.161957 1341 raft_consensus.cc:493] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:05.162061 1341 raft_consensus.cc:3060] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.162513 1170 ts_tablet_manager.cc:1929] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:05.162631 1170 log.cc:1199] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/c3a29aeb0a224cabb642f4100c44b8f3
I20260617 07:53:05.163136 1170 ts_tablet_manager.cc:1950] T c3a29aeb0a224cabb642f4100c44b8f3 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:05.164371 529 master_service.cc:960] ReplaceTablet: received request to replace tablet be14a95f458d440e86133ef65c484571 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:05.164641 1172 tablet_bootstrap.cc:492] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.164594 1341 raft_consensus.cc:515] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.165221 1341 leader_election.cc:290] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:05.166343 1172 tablet_bootstrap.cc:654] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:05.166440 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 59acdc64fe9247d28c4c277161b42f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59acdc64fe9247d28c4c277161b42f4f already in progress: creating tablet
I20260617 07:53:05.168092 1178 tablet_bootstrap.cc:492] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.168478 1178 ts_tablet_manager.cc:1403] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.002s
I20260617 07:53:05.169334 1178 raft_consensus.cc:359] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.170378 1170 tablet_replica.cc:333] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:05.170756 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet c3a29aeb0a224cabb642f4100c44b8f3 (table default.Table_8fa833038123494b9119b22687fe004a [id=c94c06472dc34885962dd964aa186105]) successfully deleted
I20260617 07:53:05.170902 1178 raft_consensus.cc:385] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 07:53:05.170993 516 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a31fba373a214b5a96bd11b930ed3b86 because the tablet was not found. No further retry: Not found: Tablet not found: a31fba373a214b5a96bd11b930ed3b86
I20260617 07:53:05.170061 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875962c2e27a4ee1b9889769d53022cc" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:05.170996 1178 raft_consensus.cc:740] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.171639 1169 ts_tablet_manager.cc:1929] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.171778 1169 log.cc:1199] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5b99b80966c94937baf7172b0c36af2a
I20260617 07:53:05.171723 1178 consensus_queue.cc:260] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:05.172061 852 leader_election.cc:343] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.172173 1169 ts_tablet_manager.cc:1950] T 5b99b80966c94937baf7172b0c36af2a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:05.172261 1178 ts_tablet_manager.cc:1434] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:05.173846 1170 raft_consensus.cc:2243] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:05.174022 1169 tablet_replica.cc:333] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:05.174202 1169 raft_consensus.cc:2243] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.174381 1169 raft_consensus.cc:2272] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:05.175251 852 consensus_peers.cc:597] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.175201 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5b99b80966c94937baf7172b0c36af2a (table default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]) successfully deleted
I20260617 07:53:05.174933 1170 pending_rounds.cc:70] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:05.175957 1178 tablet_bootstrap.cc:492] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.176879 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875962c2e27a4ee1b9889769d53022cc" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:05.177112 1050 raft_consensus.cc:3060] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.177258 1052 raft_consensus.cc:1275] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:05.177981 1440 consensus_queue.cc:1048] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:05.179705 1169 ts_tablet_manager.cc:1916] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.185915 1178 tablet_bootstrap.cc:654] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.188226 1475 tablet.cc:1724] T ccf7f07441954d35916890efbfa4d836 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:05.187819 1170 pending_rounds.cc:77] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772682663337984 op_type: NO_OP noop_request { }
I20260617 07:53:05.189919 1170 raft_consensus.cc:2889] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:05.190214 1170 raft_consensus.cc:2272] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.191323 760 tablet_service.cc:1511] Processing CreateTablet for tablet 58ba8963530d49a89fe4eb626225377d (DEFAULT_TABLE table=default.Table_d9199c2565854964a10bba9e6474732f [id=4e86a2cea5304843b61370201d4d13b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.191725 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ba8963530d49a89fe4eb626225377d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.192117 1170 ts_tablet_manager.cc:1916] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.193987 1247 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.188:33087
I20260617 07:53:05.194083 1512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.188:33087 every 8 connection(s)
I20260617 07:53:05.196054 752 tablet_service.cc:1511] Processing CreateTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 (DEFAULT_TABLE table=default.Table_34fb38a5ef96468bbf08872ea10e8a5f [id=01a22a92af6f4e8ba076834cad8ba182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.196539 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dcfb101cf51487692ef9a6a17f40804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.199409 1465 tablet.cc:1724] T ccf7f07441954d35916890efbfa4d836 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:05.201161 753 tablet_service.cc:1511] Processing CreateTablet for tablet 464cf1effff241608f4a7255f2646b04 (DEFAULT_TABLE table=default.Table_85519a333a1f4899b5a22d43b69fe3cb [id=a141eeb977ca4329ac1404fefb355281]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.201574 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464cf1effff241608f4a7255f2646b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.203686 758 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd (DEFAULT_TABLE table=default.Table_64f2074c78e740dba1d24d6d81809152 [id=daa30b155c944cb098436474cfd8321c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.204523 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.197610 1247 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-2/data/info.pb
I20260617 07:53:05.207033 1169 ts_tablet_manager.cc:1929] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.207561 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu as pid 1247
I20260617 07:53:05.208916 751 tablet_service.cc:1511] Processing CreateTablet for tablet cbc79cfa11e342bd87da1aa03847c3cb (DEFAULT_TABLE table=default.Table_ee7079d18a5b466aacf7a9c709ae6dc8 [id=ad4030fa284949019fea2539566b66aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.209878 1169 log.cc:1199] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/787467c65f68442aad071df16d4492f3
I20260617 07:53:05.210314 1169 ts_tablet_manager.cc:1950] T 787467c65f68442aad071df16d4492f3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:05.211452 1169 tablet_replica.cc:333] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:05.211463 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 787467c65f68442aad071df16d4492f3 (table default.Table_860af7cb625c496bb781b7c1b478d606 [id=61342c668451423aafa602607f19a1db]) successfully deleted
W20260617 07:53:05.211810 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 59acdc64fe9247d28c4c277161b42f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59acdc64fe9247d28c4c277161b42f4f already in progress: creating tablet
I20260617 07:53:05.213599 1169 raft_consensus.cc:2243] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.214112 1169 raft_consensus.cc:2272] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.215293 1169 ts_tablet_manager.cc:1916] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.221805 1050 raft_consensus.cc:2468] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:05.226073 851 leader_election.cc:304] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:05.226810 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc79cfa11e342bd87da1aa03847c3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.226999 1299 raft_consensus.cc:2804] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:05.227175 1299 raft_consensus.cc:697] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:05.227474 1299 consensus_queue.cc:237] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.230472 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_756b170c14cc49d98931f11bde48bfc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.231089 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_756b170c14cc49d98931f11bde48bfc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.232899 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_72eda13c56884241ab3153e5cb1a72d1" } modify_external_catalogs: true
I20260617 07:53:05.233093 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_72eda13c56884241ab3153e5cb1a72d1" } modify_external_catalogs: true
I20260617 07:53:05.233331 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_93f67ad8807f4b61a8afe07babb7f45f" } new_table_name: "default.Table_f7c1596383794dd7859b1f08d873678a" modify_external_catalogs: true
I20260617 07:53:05.234243 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_363a5452c7af426995b20c5f3786760e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:05.235280 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_cd29e626941b41bfbd49bec00d3a7315" } new_table_name: "default.Table_49b1276fd8f846b19cac293aa9f64723" modify_external_catalogs: true
W20260617 07:53:05.237406 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_363a5452c7af426995b20c5f3786760e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:05.239840 852 consensus_peers.cc:597] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:05.246443 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ec425bb523a449d9fe16d3ea3a0d7ae consensus state has no leader
W20260617 07:53:05.251710 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0cfb98aecc4546c88371436fcfbf8e86 consensus state has no leader
I20260617 07:53:05.255725 1171 tablet_bootstrap.cc:492] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:05.255982 1171 ts_tablet_manager.cc:1403] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.143s user 0.002s sys 0.006s
I20260617 07:53:05.256887 1171 raft_consensus.cc:359] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.257251 1171 raft_consensus.cc:385] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.257393 1171 raft_consensus.cc:740] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.257689 531 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 262a34e120f34689ba0b598d7a2999fd (table default.Table_6f686d428f8c4d9bacafed83c2a72029 [id=bc72e8ae07954b5d9f55178f136a72bc]). Expected version 1 got 0
I20260617 07:53:05.257694 1171 consensus_queue.cc:260] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.257922 531 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 875962c2e27a4ee1b9889769d53022cc (table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a]). Expected version 1 got 0
I20260617 07:53:05.259774 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet a5b7b95327604ef8b43944c4821d4ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.260443 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e59c908749124f0abd3e5aabc1029149"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:05.260859 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_768b8c0a1c2b4100aa62ae9ce4250864"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.261044 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e59c908749124f0abd3e5aabc1029149 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:05.261319 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_768b8c0a1c2b4100aa62ae9ce4250864 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.262758 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_4b89f3bc484f44458e623c0e47f28f5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.263242 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b89f3bc484f44458e623c0e47f28f5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.265772 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b99b80966c94937baf7172b0c36af2a with delete_type TABLET_DATA_DELETED (replaced by tablet 82d682ae37d74b4b967da0f8e2de6301) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.266332 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 99ec78c123d448329b8442a0de0140d3 (DEFAULT_TABLE table=default.Table_fc5f3ba5ab8a45c7bab81747fe42b662 [id=e65c9a5f1a1f479ea1804dfe806a2926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.266530 1517 sys_catalog.cc:263] Verifying existing consensus state
I20260617 07:53:05.267324 894 tablet_service.cc:1511] Processing CreateTablet for tablet 99ec78c123d448329b8442a0de0140d3 (DEFAULT_TABLE table=default.Table_fc5f3ba5ab8a45c7bab81747fe42b662 [id=e65c9a5f1a1f479ea1804dfe806a2926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.267872 897 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd8cedb539748dc917128511325bbcc (DEFAULT_TABLE table=default.Table_94b6f54366a140ccad0120180ad1ed11 [id=9edba52661f941a387f42fad199f9860]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.267928 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd8cedb539748dc917128511325bbcc (DEFAULT_TABLE table=default.Table_94b6f54366a140ccad0120180ad1ed11 [id=9edba52661f941a387f42fad199f9860]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.269595 754 tablet_service.cc:1511] Processing CreateTablet for tablet 92e55be5f28740fba65c1199a571d97a (DEFAULT_TABLE table=default.Table_93a6fb533319471aa6c304e5fe867477 [id=061cdaef8556415dad01eccb24949518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.269752 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 (DEFAULT_TABLE table=default.Table_5fdacd3c9f8f443bac56aa55916c3575 [id=3c8502b6e5ae4248a661ea0050889c53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.270056 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e55be5f28740fba65c1199a571d97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.271147 1019 tablet_service.cc:1511] Processing CreateTablet for tablet d03d6dc473fc4be1a436fd71a06f403e (DEFAULT_TABLE table=default.Table_ffd2c46b97334436a592c497f3a8fa2a [id=af6a6625d89c41feac726918675fcbf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.272485 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 (DEFAULT_TABLE table=default.Table_f906af88bdcd40169dad534822931936 [id=cd20d0490cb74168b4ff032d0f943992]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.272598 889 tablet_service.cc:1511] Processing CreateTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 (DEFAULT_TABLE table=default.Table_5fdacd3c9f8f443bac56aa55916c3575 [id=3c8502b6e5ae4248a661ea0050889c53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.272818 898 tablet_service.cc:1511] Processing CreateTablet for tablet d03d6dc473fc4be1a436fd71a06f403e (DEFAULT_TABLE table=default.Table_ffd2c46b97334436a592c497f3a8fa2a [id=af6a6625d89c41feac726918675fcbf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.272871 890 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 (DEFAULT_TABLE table=default.Table_f906af88bdcd40169dad534822931936 [id=cd20d0490cb74168b4ff032d0f943992]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.274057 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae9261c0ac94defaecfc7d14ba1ae61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.274784 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 66140c5d364f453a8089f143cc96ede8 (DEFAULT_TABLE table=default.Table_bda16d6b118048ceb24acecf1a6864ce [id=2adce07b80e24a6eaf19d88d3444701d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.275286 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd8cedb539748dc917128511325bbcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.275871 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aa1c1fdede041d28570b85e63c401b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.276403 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ec78c123d448329b8442a0de0140d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.277053 1030 tablet_service.cc:1511] Processing CreateTablet for tablet f15dcc10552d4747bad436538662bb66 (DEFAULT_TABLE table=default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.277490 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03d6dc473fc4be1a436fd71a06f403e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.278045 1024 tablet_service.cc:1511] Processing CreateTablet for tablet a632b42300d64471b516008ebca3312f (DEFAULT_TABLE table=default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.278232 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aa1c1fdede041d28570b85e63c401b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.278419 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a632b42300d64471b516008ebca3312f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.280580 1517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: Bootstrap starting.
I20260617 07:53:05.282244 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd8cedb539748dc917128511325bbcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.282989 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03d6dc473fc4be1a436fd71a06f403e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.283507 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ec78c123d448329b8442a0de0140d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.283773 750 tablet_service.cc:1511] Processing CreateTablet for tablet a632b42300d64471b516008ebca3312f (DEFAULT_TABLE table=default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.283773 748 tablet_service.cc:1511] Processing CreateTablet for tablet f15dcc10552d4747bad436538662bb66 (DEFAULT_TABLE table=default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.284188 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a632b42300d64471b516008ebca3312f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.284399 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15dcc10552d4747bad436538662bb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.297021 756 tablet_service.cc:1511] Processing CreateTablet for tablet 66140c5d364f453a8089f143cc96ede8 (DEFAULT_TABLE table=default.Table_bda16d6b118048ceb24acecf1a6864ce [id=2adce07b80e24a6eaf19d88d3444701d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.297438 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66140c5d364f453a8089f143cc96ede8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.297887 1400 raft_consensus.cc:493] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.298084 1400 raft_consensus.cc:515] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.299623 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ae3c99bec7426caac18a6e3880bf51" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.300194 986 leader_election.cc:343] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.300650 1400 leader_election.cc:290] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.303819 1341 consensus_queue.cc:1048] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260617 07:53:05.304237 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae9261c0ac94defaecfc7d14ba1ae61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.305488 755 tablet_service.cc:1511] Processing CreateTablet for tablet d03d6dc473fc4be1a436fd71a06f403e (DEFAULT_TABLE table=default.Table_ffd2c46b97334436a592c497f3a8fa2a [id=af6a6625d89c41feac726918675fcbf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.306092 749 tablet_service.cc:1511] Processing CreateTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 (DEFAULT_TABLE table=default.Table_5fdacd3c9f8f443bac56aa55916c3575 [id=3c8502b6e5ae4248a661ea0050889c53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.307452 757 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 (DEFAULT_TABLE table=default.Table_f906af88bdcd40169dad534822931936 [id=cd20d0490cb74168b4ff032d0f943992]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.307739 895 tablet_service.cc:1511] Processing CreateTablet for tablet a632b42300d64471b516008ebca3312f (DEFAULT_TABLE table=default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.308360 889 tablet_service.cc:1511] Processing CreateTablet for tablet 66140c5d364f453a8089f143cc96ede8 (DEFAULT_TABLE table=default.Table_bda16d6b118048ceb24acecf1a6864ce [id=2adce07b80e24a6eaf19d88d3444701d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.311880 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 3ae9261c0ac94defaecfc7d14ba1ae61
I20260617 07:53:05.312837 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66140c5d364f453a8089f143cc96ede8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.312824 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd8cedb539748dc917128511325bbcc (DEFAULT_TABLE table=default.Table_94b6f54366a140ccad0120180ad1ed11 [id=9edba52661f941a387f42fad199f9860]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.313280 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aa1c1fdede041d28570b85e63c401b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.313458 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15dcc10552d4747bad436538662bb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.313989 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae9261c0ac94defaecfc7d14ba1ae61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.313908 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a9de59c0e19946de8df23f1869eab317"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.314443 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9de59c0e19946de8df23f1869eab317 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.316823 525 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 262a34e120f34689ba0b598d7a2999fd (table default.Table_6f686d428f8c4d9bacafed83c2a72029 [id=bc72e8ae07954b5d9f55178f136a72bc]). Expected version 1 got 0
I20260617 07:53:05.318142 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 66140c5d364f453a8089f143cc96ede8
I20260617 07:53:05.318686 526 master_service.cc:960] ReplaceTablet: received request to replace tablet a38bb8a140ef4bcab65aaa03bdb79040 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:05.320758 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 92e55be5f28740fba65c1199a571d97a
I20260617 07:53:05.321267 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 89783bab2e584fe9a8eda963f78bf3ec from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:05.325383 1517 log.cc:826] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: Log is configured to *not* fsync() on all Append() calls
I20260617 07:53:05.329258 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd8cedb539748dc917128511325bbcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.330349 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03d6dc473fc4be1a436fd71a06f403e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.333139 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:05.338122 988 leader_election.cc:343] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 52ae3c99bec7426caac18a6e3880bf51
I20260617 07:53:05.338301 988 leader_election.cc:304] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.338299 1097 heartbeater.cc:344] Connected to a master server at 127.0.105.188:33087
I20260617 07:53:05.345187 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a632b42300d64471b516008ebca3312f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.345906 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66140c5d364f453a8089f143cc96ede8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.348214 892 tablet_service.cc:1511] Processing CreateTablet for tablet f15dcc10552d4747bad436538662bb66 (DEFAULT_TABLE table=default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:05.351610 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 76667.6us
I20260617 07:53:05.357968 1425 raft_consensus.cc:493] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.358117 1425 raft_consensus.cc:515] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.358790 1425 leader_election.cc:290] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.359620 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.359839 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.359830 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294a8bfd35d04105b6bc03946d25c17a" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:05.360044 1050 raft_consensus.cc:2468] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:05.360237 760 tablet_service.cc:1511] Processing CreateTablet for tablet 99ec78c123d448329b8442a0de0140d3 (DEFAULT_TABLE table=default.Table_fc5f3ba5ab8a45c7bab81747fe42b662 [id=e65c9a5f1a1f479ea1804dfe806a2926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.360620 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ec78c123d448329b8442a0de0140d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.361080 713 leader_election.cc:304] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:05.361399 1425 raft_consensus.cc:2804] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:05.361506 1425 raft_consensus.cc:493] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:05.361584 1425 raft_consensus.cc:3060] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.364292 1425 raft_consensus.cc:515] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.365283 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "294a8bfd35d04105b6bc03946d25c17a" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:05.365470 1050 raft_consensus.cc:3060] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.367028 1400 raft_consensus.cc:2749] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.369753 1425 leader_election.cc:290] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.357539 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.370759 1172 tablet_bootstrap.cc:492] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.370905 1172 ts_tablet_manager.cc:1403] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.211s user 0.016s sys 0.023s
I20260617 07:53:05.371670 1172 raft_consensus.cc:359] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.371860 1172 raft_consensus.cc:385] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.371984 1172 raft_consensus.cc:740] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.372195 1172 consensus_queue.cc:260] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.372720 1172 ts_tablet_manager.cc:1434] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:05.373034 1172 tablet_bootstrap.cc:492] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.373111 1178 tablet_bootstrap.cc:492] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.373332 1178 ts_tablet_manager.cc:1403] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.201s user 0.003s sys 0.000s
I20260617 07:53:05.374876 1178 raft_consensus.cc:359] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.375131 1178 raft_consensus.cc:385] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.375257 1178 raft_consensus.cc:740] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.375312 1172 tablet_bootstrap.cc:654] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.375628 1178 consensus_queue.cc:260] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.376502 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.376812 1178 ts_tablet_manager.cc:1434] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 07:53:05.377468 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.377525 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 0ebafc920ed34216be5fb115f9bc6f7f
I20260617 07:53:05.379715 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet cb95639e16ed423fbe60b15a1bcdf5a6
I20260617 07:53:05.380652 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_4dd323be87d94043a38bea68d8437107"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:05.380715 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_c0812374f6f14a11b89262bb96ce58c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.381260 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4dd323be87d94043a38bea68d8437107 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:05.381479 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0812374f6f14a11b89262bb96ce58c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.381892 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: default.Table_d7a2cf493ddd427c9087f6b6b1971450 [id=8b962c8429894c52a1ba7296a6f02205] alter complete (version 2)
I20260617 07:53:05.382795 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_eb6188f81ced4416b480a7dbd86da65b" } new_table_name: "default.Table_29925f966d344ba89f83ad512a5bf335" modify_external_catalogs: true
I20260617 07:53:05.384469 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_26c85eb5e09949859f6e4039e66bd282"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.385047 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26c85eb5e09949859f6e4039e66bd282 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.386008 1178 tablet_bootstrap.cc:492] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.386168 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 28e1fd7f91f94221884be2166f0cc793 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:05.387677 1178 tablet_bootstrap.cc:654] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.390218 1517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=13 ignored=0} inserts{seen=21 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260617 07:53:05.391000 1517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: Bootstrap complete.
I20260617 07:53:05.391232 1172 tablet_bootstrap.cc:492] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.391402 1172 ts_tablet_manager.cc:1403] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.010s
I20260617 07:53:05.392230 1172 raft_consensus.cc:359] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.393007 1172 raft_consensus.cc:385] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.393153 1172 raft_consensus.cc:740] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.393592 1172 consensus_queue.cc:260] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.393837 1364 raft_consensus.cc:493] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.393980 1364 raft_consensus.cc:515] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.395048 1364 leader_election.cc:290] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.395153 1172 ts_tablet_manager.cc:1434] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
W20260617 07:53:05.395653 986 consensus_peers.cc:597] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.395744 1172 tablet_bootstrap.cc:492] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.396189 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb71e5f65cd4b9e8dbe5ddf44e70340" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.396872 986 leader_election.cc:343] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.398474 1172 tablet_bootstrap.cc:654] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.400825 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.401053 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.401297 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet f345910256784d2085cb81473534dcaf with delete_type TABLET_DATA_DELETED (replaced by tablet 570ae1e189a64da6bad10156b401ec46) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.401859 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.403077 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 294a8bfd35d04105b6bc03946d25c17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.403339 1175 tablet_replica.cc:333] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:05.403527 1175 raft_consensus.cc:2243] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.403709 1175 raft_consensus.cc:2272] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.403018 1517 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:05.404265 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.404695 1175 ts_tablet_manager.cc:1916] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.409005 753 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.409543 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15dcc10552d4747bad436538662bb66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.412384 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_cf2b90b9a25a471aa34d0532b35cbff9" } new_table_name: "default.Table_16fbac0e677342729f3fe3f6555cde4b" modify_external_catalogs: true
I20260617 07:53:05.412487 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b61c03f6c3284d4aa58a66884bf74d10" } new_table_name: "default.Table_2d4fd391c62440b0baa36dd1c67778c6" modify_external_catalogs: true
I20260617 07:53:05.413609 1517 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b274c37ad4445ba8b41d6784b3cd336, State: Initialized, Role: FOLLOWER
W20260617 07:53:05.414063 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66140c5d364f453a8089f143cc96ede8 already in progress: creating tablet
W20260617 07:53:05.414330 517 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because the tablet was not found. No further retry: Not found: Tablet not found: 92e55be5f28740fba65c1199a571d97a
W20260617 07:53:05.414673 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae9261c0ac94defaecfc7d14ba1ae61 already in progress: creating tablet
W20260617 07:53:05.415042 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0ebafc920ed34216be5fb115f9bc6f7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ebafc920ed34216be5fb115f9bc6f7f already in progress: creating tablet
I20260617 07:53:05.415230 1517 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 1.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:05.415561 753 tablet_service.cc:1558] Processing DeleteTablet for tablet a31fba373a214b5a96bd11b930ed3b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.422744 1527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:05.424897 1178 tablet_bootstrap.cc:492] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.424988 1527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:53:05.425092 1178 ts_tablet_manager.cc:1403] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.002s
I20260617 07:53:05.424856 1517 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: configured and running, proceeding with master startup.
I20260617 07:53:05.425957 1178 raft_consensus.cc:359] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.426203 1178 raft_consensus.cc:385] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.426345 1178 raft_consensus.cc:740] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.426635 1178 consensus_queue.cc:260] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.428174 1178 ts_tablet_manager.cc:1434] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:05.428679 1178 tablet_bootstrap.cc:492] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.430836 825 heartbeater.cc:344] Connected to a master server at 127.0.105.188:33087
I20260617 07:53:05.433034 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.434715 1172 tablet_bootstrap.cc:492] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.435258 1178 tablet_bootstrap.cc:654] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.435710 1172 ts_tablet_manager.cc:1403] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.040s user 0.007s sys 0.011s
I20260617 07:53:05.437333 1172 raft_consensus.cc:359] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.437557 1172 raft_consensus.cc:385] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.437692 1172 raft_consensus.cc:740] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.438292 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb71e5f65cd4b9e8dbe5ddf44e70340" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:05.438519 918 raft_consensus.cc:2468] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:05.438287 1172 consensus_queue.cc:260] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.439296 1172 ts_tablet_manager.cc:1434] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:05.439371 891 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.439725 988 leader_election.cc:304] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:05.440057 1172 tablet_bootstrap.cc:492] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.440191 1364 raft_consensus.cc:2804] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:05.440297 1364 raft_consensus.cc:493] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:05.440387 1364 raft_consensus.cc:3060] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.440835 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.441018 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a38bb8a140ef4bcab65aaa03bdb79040
I20260617 07:53:05.441115 1272 raft_consensus.cc:493] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.441303 1272 raft_consensus.cc:515] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.441524 526 catalog_manager.cc:6784] ReplaceTablet: tablet a38bb8a140ef4bcab65aaa03bdb79040 deleted and replaced by tablet 7f7611958cf143438497c93f5f2bc098
I20260617 07:53:05.442085 1272 leader_election.cc:290] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:05.443100 1172 tablet_bootstrap.cc:654] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.443183 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_0ebdf4b1d9ba4845958bccb5883ec491"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.443890 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ebdf4b1d9ba4845958bccb5883ec491 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:05.445463 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 consensus state has no leader
I20260617 07:53:05.448963 1170 ts_tablet_manager.cc:1929] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:05.449062 1170 log.cc:1199] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/2063248863ed46c196c93013230529fe
I20260617 07:53:05.449450 1170 ts_tablet_manager.cc:1950] T 2063248863ed46c196c93013230529fe P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:05.454102 1050 raft_consensus.cc:2468] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:05.460278 713 leader_election.cc:304] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:05.460588 713 raft_consensus.cc:2686] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260617 07:53:05.461033 716 leader_election.cc:343] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 294a8bfd35d04105b6bc03946d25c17a
I20260617 07:53:05.461408 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f345910256784d2085cb81473534dcaf" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:05.462399 779 raft_consensus.cc:3060] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.463492 1172 tablet_bootstrap.cc:492] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.463655 1172 ts_tablet_manager.cc:1403] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.003s
I20260617 07:53:05.464758 1172 raft_consensus.cc:359] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.464965 1172 raft_consensus.cc:385] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.465042 1172 raft_consensus.cc:740] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.465299 1172 consensus_queue.cc:260] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.466038 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 89783bab2e584fe9a8eda963f78bf3ec
I20260617 07:53:05.466672 1178 tablet_bootstrap.cc:492] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.466713 523 catalog_manager.cc:6784] ReplaceTablet: tablet 89783bab2e584fe9a8eda963f78bf3ec deleted and replaced by tablet 233cae2480ed457bbab22ead8c0bde2c
I20260617 07:53:05.466856 1178 ts_tablet_manager.cc:1403] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.000s
I20260617 07:53:05.467736 1178 raft_consensus.cc:359] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.467918 1178 raft_consensus.cc:385] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.467995 1178 raft_consensus.cc:740] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.468290 1178 consensus_queue.cc:260] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.468909 1178 ts_tablet_manager.cc:1434] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:05.469197 1178 tablet_bootstrap.cc:492] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.469607 825 heartbeater.cc:344] Connected to a master server at 127.0.105.188:33087
W20260617 07:53:05.470764 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 233cae2480ed457bbab22ead8c0bde2c has no consensus state
I20260617 07:53:05.471509 1178 tablet_bootstrap.cc:654] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:05.471478 986 leader_election.cc:343] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:05.472810 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3275c99834f404f84b96fcc7944cd00 consensus state has no leader
I20260617 07:53:05.473785 1425 raft_consensus.cc:493] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.473834 1172 ts_tablet_manager.cc:1434] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260617 07:53:05.473918 1425 raft_consensus.cc:515] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.474150 1172 tablet_bootstrap.cc:492] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.474565 1425 leader_election.cc:290] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:05.475754 1172 tablet_bootstrap.cc:654] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:05.476794 713 leader_election.cc:343] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a31fba373a214b5a96bd11b930ed3b86
I20260617 07:53:05.479084 1178 tablet_bootstrap.cc:492] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.479262 1178 ts_tablet_manager.cc:1403] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260617 07:53:05.480013 1178 raft_consensus.cc:359] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.480449 1178 raft_consensus.cc:385] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.480569 1178 raft_consensus.cc:740] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.480823 1178 consensus_queue.cc:260] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.481325 1178 ts_tablet_manager.cc:1434] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:05.481604 1178 tablet_bootstrap.cc:492] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.484786 1178 tablet_bootstrap.cc:654] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.489786 760 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.492667 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.494802 1172 tablet_bootstrap.cc:492] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.495061 1172 ts_tablet_manager.cc:1403] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260617 07:53:05.495602 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5c59a8f8f2d44424bdc1f5b1d61d29a9" } new_table_name: "default.Table_97c26e097b994c36a82d2b9c95b8be1d" modify_external_catalogs: true
I20260617 07:53:05.496016 1172 raft_consensus.cc:359] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.496294 1172 raft_consensus.cc:385] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.496469 1172 raft_consensus.cc:740] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.496897 1172 consensus_queue.cc:260] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.497664 1172 ts_tablet_manager.cc:1434] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:05.498430 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 229) took 1051 ms. Trace:
I20260617 07:53:05.499929 1170 rpcz_store.cc:276] 0617 07:53:04.446649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.446954 (+ 305us) service_pool.cc:224] Handling call
0617 07:53:05.170321 (+723367us) ts_tablet_manager.cc:1151] Deleting tablet 2063248863ed46c196c93013230529fe
0617 07:53:05.170329 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:05.446020 (+275691us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:05.448886 (+ 2866us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:05.498382 (+ 49496us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":723194}
I20260617 07:53:05.500379 1170 tablet_replica.cc:333] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:05.500607 1170 raft_consensus.cc:2243] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.500780 1170 raft_consensus.cc:2272] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.500914 1178 tablet_bootstrap.cc:492] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.501080 1178 ts_tablet_manager.cc:1403] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.003s
I20260617 07:53:05.501371 1170 ts_tablet_manager.cc:1916] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.502496 1178 raft_consensus.cc:359] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.502710 1178 raft_consensus.cc:385] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.502780 1178 raft_consensus.cc:740] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.503037 1178 consensus_queue.cc:260] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.503599 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.503927 1178 ts_tablet_manager.cc:1434] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260617 07:53:05.504283 1178 tablet_bootstrap.cc:492] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.505040 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.505649 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_599c014ad57e446a951f4d7cfc3a09b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:05.506110 963 heartbeater.cc:344] Connected to a master server at 127.0.105.188:33087
I20260617 07:53:05.506163 1178 tablet_bootstrap.cc:654] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:05.506263 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_599c014ad57e446a951f4d7cfc3a09b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.508276 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 2063248863ed46c196c93013230529fe (table default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]) successfully deleted
I20260617 07:53:05.509028 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.509104 1172 tablet_bootstrap.cc:492] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.509776 1169 ts_tablet_manager.cc:1929] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.513660 1364 raft_consensus.cc:515] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:05.513842 716 leader_election.cc:343] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 294a8bfd35d04105b6bc03946d25c17a
I20260617 07:53:05.514549 1364 leader_election.cc:290] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.515183 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb71e5f65cd4b9e8dbe5ddf44e70340" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:05.515800 986 leader_election.cc:343] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.516213 1175 ts_tablet_manager.cc:1929] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.516353 1175 log.cc:1199] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/294a8bfd35d04105b6bc03946d25c17a
I20260617 07:53:05.516702 1175 ts_tablet_manager.cc:1950] T 294a8bfd35d04105b6bc03946d25c17a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:05.516773 1172 tablet_bootstrap.cc:654] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:05.516937 716 leader_election.cc:343] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a31fba373a214b5a96bd11b930ed3b86
I20260617 07:53:05.517076 716 leader_election.cc:304] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:05.517469 1425 raft_consensus.cc:2749] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.518826 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.520254 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f345910256784d2085cb81473534dcaf" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:05.521509 893 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.522078 1178 tablet_bootstrap.cc:492] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.522289 1178 ts_tablet_manager.cc:1403] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20260617 07:53:05.522320 1169 log.cc:1199] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/4d9d9ed003c64b1abed6bd3bb14456cd
I20260617 07:53:05.522881 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:05.523090 988 leader_election.cc:343] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.523222 988 leader_election.cc:304] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.523269 1178 raft_consensus.cc:359] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.523449 1178 raft_consensus.cc:385] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.523989 1178 raft_consensus.cc:740] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.524302 1178 consensus_queue.cc:260] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.524682 1400 raft_consensus.cc:2749] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.524948 1178 ts_tablet_manager.cc:1434] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:05.525383 1178 tablet_bootstrap.cc:492] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.527366 1178 tablet_bootstrap.cc:654] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.527601 1400 consensus_queue.cc:1048] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:05.531507 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0dbea7a9d97244c68fe21e0b62ed8870" } new_table_name: "default.Table_32c6bef7b0d546df853fe9d0529d6b03" modify_external_catalogs: true
I20260617 07:53:05.532245 1169 ts_tablet_manager.cc:1950] T 4d9d9ed003c64b1abed6bd3bb14456cd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:05.533196 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb71e5f65cd4b9e8dbe5ddf44e70340" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:05.537235 918 raft_consensus.cc:3060] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.537925 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 4d9d9ed003c64b1abed6bd3bb14456cd (table default.Table_b80fd4d4286241409493bc531eb7fef8 [id=778d846ba4124b08a28bb83a2777841e]) successfully deleted
W20260617 07:53:05.538236 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 because the tablet was not found. No further retry: Not found: Tablet not found: 3ae9261c0ac94defaecfc7d14ba1ae61
W20260617 07:53:05.538494 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet cb95639e16ed423fbe60b15a1bcdf5a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb95639e16ed423fbe60b15a1bcdf5a6 already in progress: creating tablet
I20260617 07:53:05.538894 1178 tablet_bootstrap.cc:492] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.539194 1178 ts_tablet_manager.cc:1403] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.001s
I20260617 07:53:05.539232 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 086e43b610f9430c872daeef35c5586a with delete_type TABLET_DATA_DELETED (replaced by tablet 7934f5fa0287427cb45fe568f0de8758) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.539906 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ffce17fe5c8405a94a93ad7dd67806e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.540093 1178 raft_consensus.cc:359] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.540359 1178 raft_consensus.cc:385] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.540447 1178 raft_consensus.cc:740] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.540724 1178 consensus_queue.cc:260] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.541441 1178 ts_tablet_manager.cc:1434] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:05.541644 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 2063248863ed46c196c93013230529fe with delete_type TABLET_DATA_DELETED (replaced by tablet ddb71e5f65cd4b9e8dbe5ddf44e70340) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.541864 1178 tablet_bootstrap.cc:492] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.542644 1172 tablet_bootstrap.cc:492] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.542878 1172 ts_tablet_manager.cc:1403] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.000s
W20260617 07:53:05.543010 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because the tablet was not found. No further retry: Not found: Tablet not found: 66140c5d364f453a8089f143cc96ede8
I20260617 07:53:05.543816 1172 raft_consensus.cc:359] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:05.543916 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92e55be5f28740fba65c1199a571d97a already in progress: creating tablet
I20260617 07:53:05.544030 1172 raft_consensus.cc:385] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.544111 1172 raft_consensus.cc:740] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:05.544147 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0ebafc920ed34216be5fb115f9bc6f7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ebafc920ed34216be5fb115f9bc6f7f already in progress: creating tablet
W20260617 07:53:05.544363 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a38bb8a140ef4bcab65aaa03bdb79040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a38bb8a140ef4bcab65aaa03bdb79040 already in progress: creating tablet
I20260617 07:53:05.544379 1172 consensus_queue.cc:260] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:05.544571 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 89783bab2e584fe9a8eda963f78bf3ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89783bab2e584fe9a8eda963f78bf3ec already in progress: creating tablet
I20260617 07:53:05.544934 1172 ts_tablet_manager.cc:1434] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:05.545295 1172 tablet_bootstrap.cc:492] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.547346 1172 tablet_bootstrap.cc:654] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.547386 1178 tablet_bootstrap.cc:654] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.557797 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_6546b71cbcb9438cb73da79622d9b0fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.558565 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6546b71cbcb9438cb73da79622d9b0fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.561224 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5d59656f1cf74e4dbea879fb08583021" } modify_external_catalogs: true
I20260617 07:53:05.561810 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5d59656f1cf74e4dbea879fb08583021" } modify_external_catalogs: true
I20260617 07:53:05.562882 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c0812374f6f14a11b89262bb96ce58c3" } modify_external_catalogs: true
I20260617 07:53:05.563047 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c0812374f6f14a11b89262bb96ce58c3" } modify_external_catalogs: true
I20260617 07:53:05.563290 1172 tablet_bootstrap.cc:492] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.563346 1178 tablet_bootstrap.cc:492] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.563467 1172 ts_tablet_manager.cc:1403] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.001s
I20260617 07:53:05.563515 1178 ts_tablet_manager.cc:1403] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.001s
I20260617 07:53:05.564303 1172 raft_consensus.cc:359] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.564330 1178 raft_consensus.cc:359] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.564522 1178 raft_consensus.cc:385] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.564612 1172 raft_consensus.cc:385] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.564668 1178 raft_consensus.cc:740] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.564761 1172 raft_consensus.cc:740] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.565004 1178 consensus_queue.cc:260] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.565057 1172 consensus_queue.cc:260] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.565642 1172 ts_tablet_manager.cc:1434] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:05.565827 1178 ts_tablet_manager.cc:1434] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260617 07:53:05.566056 1172 tablet_bootstrap.cc:492] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.566179 1178 tablet_bootstrap.cc:492] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.567888 1172 tablet_bootstrap.cc:654] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.568077 1178 tablet_bootstrap.cc:654] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.568730 1171 ts_tablet_manager.cc:1434] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.176s user 0.000s sys 0.002s
I20260617 07:53:05.569242 1171 tablet_bootstrap.cc:492] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:05.576135 1171 tablet_bootstrap.cc:654] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.580260 1178 tablet_bootstrap.cc:492] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.580514 1178 ts_tablet_manager.cc:1403] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260617 07:53:05.581401 1178 raft_consensus.cc:359] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.581737 1178 raft_consensus.cc:385] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.581868 1178 raft_consensus.cc:740] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.582260 1178 consensus_queue.cc:260] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:05.582502 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d21f61a35ca544568bcfca1a6230deca consensus state has no leader
I20260617 07:53:05.582968 1178 ts_tablet_manager.cc:1434] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:05.583010 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a562036b19dd4c99a8981180a617b865" } modify_external_catalogs: true
I20260617 07:53:05.583271 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a562036b19dd4c99a8981180a617b865" } modify_external_catalogs: true
I20260617 07:53:05.583379 1178 tablet_bootstrap.cc:492] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.586053 1178 tablet_bootstrap.cc:654] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.586110 1364 raft_consensus.cc:493] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.586341 1364 raft_consensus.cc:515] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.587702 1364 leader_election.cc:290] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:05.588140 988 leader_election.cc:343] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 787467c65f68442aad071df16d4492f3
I20260617 07:53:05.589129 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787467c65f68442aad071df16d4492f3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.589823 986 leader_election.cc:343] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.589983 986 leader_election.cc:304] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.592145 529 catalog_manager.cc:5696] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:05.592736 529 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 875962c2e27a4ee1b9889769d53022cc (table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a]). Expected version 1 got 0
I20260617 07:53:05.593207 529 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 262a34e120f34689ba0b598d7a2999fd (table default.Table_6f686d428f8c4d9bacafed83c2a72029 [id=bc72e8ae07954b5d9f55178f136a72bc]). Expected version 1 got 0
I20260617 07:53:05.596957 890 tablet_service.cc:1511] Processing CreateTablet for tablet 84f498f551ff4767bd16628b03f55ae2 (DEFAULT_TABLE table=default.Table_756b170c14cc49d98931f11bde48bfc6 [id=288a2e361ab149dca98dd515225f0ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.597385 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f498f551ff4767bd16628b03f55ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.597816 1172 tablet_bootstrap.cc:492] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.598134 1172 ts_tablet_manager.cc:1403] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.003s
I20260617 07:53:05.598421 1364 raft_consensus.cc:2749] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.599185 1172 raft_consensus.cc:359] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.599484 1172 raft_consensus.cc:385] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.599874 1172 raft_consensus.cc:740] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.600023 894 tablet_service.cc:1511] Processing CreateTablet for tablet 63de833f7aa740b0b5bf2494b78aca5c (DEFAULT_TABLE table=default.Table_b8214873449f45f6be18047115a40c52 [id=32680a1bed374ba18c213d1bf46ce772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.600253 1172 consensus_queue.cc:260] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.600432 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63de833f7aa740b0b5bf2494b78aca5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.601001 1400 raft_consensus.cc:493] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.601181 1400 raft_consensus.cc:515] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.601902 1400 leader_election.cc:290] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:05.603391 988 leader_election.cc:343] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 4d9d9ed003c64b1abed6bd3bb14456cd
I20260617 07:53:05.603847 1172 ts_tablet_manager.cc:1434] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 07:53:05.604296 1172 tablet_bootstrap.cc:492] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.604249 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d9ed003c64b1abed6bd3bb14456cd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.604821 986 leader_election.cc:343] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.604983 986 leader_election.cc:304] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.605463 1400 raft_consensus.cc:2749] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.602928 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 63de833f7aa740b0b5bf2494b78aca5c (DEFAULT_TABLE table=default.Table_b8214873449f45f6be18047115a40c52 [id=32680a1bed374ba18c213d1bf46ce772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.606078 918 raft_consensus.cc:2468] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:05.611290 1175 tablet_replica.cc:333] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:05.611582 1175 raft_consensus.cc:2243] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.611891 1175 raft_consensus.cc:2272] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.612502 1175 ts_tablet_manager.cc:1916] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.606283 1172 tablet_bootstrap.cc:654] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.606501 988 leader_election.cc:304] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:05.623775 1364 raft_consensus.cc:2804] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:05.623987 1364 raft_consensus.cc:697] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:05.624312 1364 consensus_queue.cc:237] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.624927 1178 tablet_bootstrap.cc:492] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.625114 1178 ts_tablet_manager.cc:1403] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.000s
I20260617 07:53:05.622162 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 84f498f551ff4767bd16628b03f55ae2 (DEFAULT_TABLE table=default.Table_756b170c14cc49d98931f11bde48bfc6 [id=288a2e361ab149dca98dd515225f0ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.625936 1178 raft_consensus.cc:359] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.626224 1178 raft_consensus.cc:385] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.626380 1178 raft_consensus.cc:740] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.626741 1178 consensus_queue.cc:260] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.627313 1178 ts_tablet_manager.cc:1434] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:05.627609 1178 tablet_bootstrap.cc:492] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.629158 1178 tablet_bootstrap.cc:654] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.634805 1178 tablet_bootstrap.cc:492] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.637025 1178 ts_tablet_manager.cc:1403] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260617 07:53:05.637876 1178 raft_consensus.cc:359] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:05.638114 852 consensus_peers.cc:597] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.638141 1178 raft_consensus.cc:385] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.638312 1178 raft_consensus.cc:740] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.638486 760 tablet_service.cc:1511] Processing CreateTablet for tablet 84f498f551ff4767bd16628b03f55ae2 (DEFAULT_TABLE table=default.Table_756b170c14cc49d98931f11bde48bfc6 [id=288a2e361ab149dca98dd515225f0ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.638616 1178 consensus_queue.cc:260] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.639297 1178 ts_tablet_manager.cc:1434] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:05.639847 754 tablet_service.cc:1511] Processing CreateTablet for tablet 63de833f7aa740b0b5bf2494b78aca5c (DEFAULT_TABLE table=default.Table_b8214873449f45f6be18047115a40c52 [id=32680a1bed374ba18c213d1bf46ce772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:05.639984 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 294a8bfd35d04105b6bc03946d25c17a (table default.Table_8f023a35300e46fe80ba1d63915dd524 [id=f229ae0273bf41348803c6ffaa3c098d]) successfully deleted
W20260617 07:53:05.640213 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cb95639e16ed423fbe60b15a1bcdf5a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb95639e16ed423fbe60b15a1bcdf5a6 already in progress: creating tablet
I20260617 07:53:05.640373 1178 tablet_bootstrap.cc:492] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.640880 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_996d5685c9904502b299700425b29a1d" } modify_external_catalogs: true
I20260617 07:53:05.641151 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_996d5685c9904502b299700425b29a1d" } modify_external_catalogs: true
I20260617 07:53:05.642241 1178 tablet_bootstrap.cc:654] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.644906 1170 ts_tablet_manager.cc:1929] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.645112 1170 log.cc:1199] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/294a8bfd35d04105b6bc03946d25c17a
I20260617 07:53:05.645589 1170 ts_tablet_manager.cc:1950] T 294a8bfd35d04105b6bc03946d25c17a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:05.645901 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63de833f7aa740b0b5bf2494b78aca5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.646795 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f498f551ff4767bd16628b03f55ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.652938 1171 tablet_bootstrap.cc:492] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:05.653154 1171 ts_tablet_manager.cc:1403] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.084s user 0.005s sys 0.001s
I20260617 07:53:05.654016 1171 raft_consensus.cc:359] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.654268 1171 raft_consensus.cc:385] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.654548 1171 raft_consensus.cc:740] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.654845 1171 consensus_queue.cc:260] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.655493 1171 ts_tablet_manager.cc:1434] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:05.662739 1364 raft_consensus.cc:493] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.663017 1364 raft_consensus.cc:515] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.665601 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2cb23911614f9dab0767b1f6af3d00" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.668139 986 leader_election.cc:343] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.668583 1364 leader_election.cc:290] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:05.672855 1425 raft_consensus.cc:493] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.673024 1425 raft_consensus.cc:515] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.673488 1551 tablet.cc:1724] T 36cbea7b0f024422bc281ea97f6d76d5 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:05.673792 1425 leader_election.cc:290] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.667843 1299 consensus_queue.cc:1048] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:05.675113 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e253dca6904dfb914ed4be554da4b5" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:05.676152 716 leader_election.cc:343] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: f9e253dca6904dfb914ed4be554da4b5
I20260617 07:53:05.676295 716 leader_election.cc:304] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:05.676828 1425 raft_consensus.cc:2749] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.668903 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2cb23911614f9dab0767b1f6af3d00" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:05.681205 988 leader_election.cc:343] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.681344 988 leader_election.cc:304] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.681835 1364 raft_consensus.cc:2749] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.690048 1172 tablet_bootstrap.cc:492] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.690258 1172 ts_tablet_manager.cc:1403] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.086s user 0.006s sys 0.008s
I20260617 07:53:05.691252 1172 raft_consensus.cc:359] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.692890 1172 raft_consensus.cc:385] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.693048 1172 raft_consensus.cc:740] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.693377 1172 consensus_queue.cc:260] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.693987 1172 ts_tablet_manager.cc:1434] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:05.694356 1172 tablet_bootstrap.cc:492] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.701078 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 230) took 1254 ms. Trace:
I20260617 07:53:05.701243 1170 rpcz_store.cc:276] 0617 07:53:04.446762 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.446977 (+ 215us) service_pool.cc:224] Handling call
0617 07:53:05.500303 (+1053326us) ts_tablet_manager.cc:1151] Deleting tablet 294a8bfd35d04105b6bc03946d25c17a
0617 07:53:05.500314 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:05.525023 (+ 24709us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:05.644264 (+119241us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:05.701024 (+ 56760us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1053042}
I20260617 07:53:05.701948 1425 raft_consensus.cc:493] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.702190 1425 raft_consensus.cc:515] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.703164 1425 leader_election.cc:290] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:05.705554 713 leader_election.cc:343] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: c3a29aeb0a224cabb642f4100c44b8f3
W20260617 07:53:05.707109 716 leader_election.cc:343] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: c3a29aeb0a224cabb642f4100c44b8f3
I20260617 07:53:05.707314 716 leader_election.cc:304] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:05.707872 1425 raft_consensus.cc:2749] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.709856 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f498f551ff4767bd16628b03f55ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.710343 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63de833f7aa740b0b5bf2494b78aca5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:05.705084 1272 raft_consensus.cc:493] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.722265 1272 raft_consensus.cc:515] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.722990 1272 leader_election.cc:290] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.724675 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 294a8bfd35d04105b6bc03946d25c17a (table default.Table_8f023a35300e46fe80ba1d63915dd524 [id=f229ae0273bf41348803c6ffaa3c098d]) successfully deleted
I20260617 07:53:05.725126 1170 tablet_replica.cc:333] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:05.725395 1170 raft_consensus.cc:2243] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:05.725818 1170 pending_rounds.cc:70] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:05.725965 1170 pending_rounds.cc:77] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772684024905728 op_type: NO_OP noop_request { }
I20260617 07:53:05.726166 1170 raft_consensus.cc:2889] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:05.726272 1172 tablet_bootstrap.cc:654] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:05.726619 988 leader_election.cc:343] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 5b99b80966c94937baf7172b0c36af2a
I20260617 07:53:05.726930 1170 raft_consensus.cc:2272] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.727622 1170 ts_tablet_manager.cc:1916] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.728669 1171 tablet_bootstrap.cc:492] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:05.730763 1171 tablet_bootstrap.cc:654] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.732388 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b99b80966c94937baf7172b0c36af2a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:05.732704 779 raft_consensus.cc:2468] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:05.733207 986 leader_election.cc:304] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.733594 1272 raft_consensus.cc:2804] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:05.733692 1272 raft_consensus.cc:493] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:05.733825 1272 raft_consensus.cc:3060] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.705178 1364 raft_consensus.cc:493] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.738683 1364 raft_consensus.cc:515] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.739521 1178 tablet_bootstrap.cc:492] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.739732 1178 ts_tablet_manager.cc:1403] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.099s user 0.038s sys 0.050s
I20260617 07:53:05.739850 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69996eb4ab6e40f9b2d97e00d766822a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:05.740350 988 leader_election.cc:343] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.740659 1178 raft_consensus.cc:359] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.740957 1178 raft_consensus.cc:385] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.741102 1178 raft_consensus.cc:740] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.741456 1178 consensus_queue.cc:260] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.741627 1364 leader_election.cc:290] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:05.741988 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69996eb4ab6e40f9b2d97e00d766822a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.742470 986 leader_election.cc:343] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.742610 986 leader_election.cc:304] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.743244 1364 raft_consensus.cc:2749] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.743377 1178 ts_tablet_manager.cc:1434] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:05.743772 1178 tablet_bootstrap.cc:492] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.746614 1178 tablet_bootstrap.cc:654] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:05.755424 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7d9354c81df42fb9756045e659be26d consensus state has no leader
I20260617 07:53:05.755774 1172 tablet_bootstrap.cc:492] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.755849 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6f686d428f8c4d9bacafed83c2a72029" } modify_external_catalogs: true
I20260617 07:53:05.755945 1172 ts_tablet_manager.cc:1403] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.001s
I20260617 07:53:05.756029 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6f686d428f8c4d9bacafed83c2a72029" } modify_external_catalogs: true
I20260617 07:53:05.756740 1172 raft_consensus.cc:359] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.756937 1172 raft_consensus.cc:385] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.757009 1172 raft_consensus.cc:740] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.756925 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e2dd4c72e519463587685ed8940d442e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:05.757198 1178 tablet_bootstrap.cc:492] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:05.757364 1178 ts_tablet_manager.cc:1403] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.006s
W20260617 07:53:05.757468 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2dd4c72e519463587685ed8940d442e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.758348 1178 raft_consensus.cc:359] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.758539 1178 raft_consensus.cc:385] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.758615 1178 raft_consensus.cc:740] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.758718 528 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet c5df657c45244441860c3caca5cdc780
I20260617 07:53:05.759033 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_0b705f18dfe34487821e76d515b4a2be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:05.759250 1178 consensus_queue.cc:260] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:05.759557 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b705f18dfe34487821e76d515b4a2be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.759953 1178 ts_tablet_manager.cc:1434] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 07:53:05.760318 1178 tablet_bootstrap.cc:492] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:05.760218 1172 consensus_queue.cc:260] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.760703 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 28e1fd7f91f94221884be2166f0cc793
I20260617 07:53:05.761323 531 catalog_manager.cc:6784] ReplaceTablet: tablet 28e1fd7f91f94221884be2166f0cc793 deleted and replaced by tablet 2735f7dd40e54aec9004b9b38702607c
I20260617 07:53:05.761657 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_135d8e6c7f9a41ef809b7e98a6e02c97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:05.761987 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:05.762225 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_135d8e6c7f9a41ef809b7e98a6e02c97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.763664 1425 raft_consensus.cc:493] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.763875 1172 ts_tablet_manager.cc:1434] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 07:53:05.763896 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet de030009192748118b388eec555d90da
I20260617 07:53:05.763831 1425 raft_consensus.cc:515] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.764159 1172 tablet_bootstrap.cc:492] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.764464 1425 leader_election.cc:290] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.764564 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_da5430a09e3e44e48bafd3678bf638a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.764988 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da5430a09e3e44e48bafd3678bf638a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.765329 754 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.766085 1178 tablet_bootstrap.cc:654] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.766271 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452f7d2bceb5447290370f72ec788608" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:05.767266 894 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.768229 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.768431 525 master_service.cc:960] ReplaceTablet: received request to replace tablet 452f7d2bceb5447290370f72ec788608 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:05.775048 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet df705c2300064db680bec1fefab08d2f
I20260617 07:53:05.775797 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 4996cde4d1514aa081257c802339abe6 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:05.775966 754 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.776450 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_412e4d145f3247efb53b3b107b70903a" } new_table_name: "default.Table_3e620975807b4d4a895271b6fadd9c5a" modify_external_catalogs: true
I20260617 07:53:05.777570 1364 raft_consensus.cc:493] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.777757 1364 raft_consensus.cc:515] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:05.778455 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet de030009192748118b388eec555d90da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de030009192748118b388eec555d90da already in progress: creating tablet
W20260617 07:53:05.778822 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 28e1fd7f91f94221884be2166f0cc793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28e1fd7f91f94221884be2166f0cc793 already in progress: creating tablet
I20260617 07:53:05.778836 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f8525046964950884b0f9aa515ec81" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:05.778985 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f8525046964950884b0f9aa515ec81" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.779389 988 leader_election.cc:343] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.779389 1364 leader_election.cc:290] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:05.779644 890 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.780902 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.781209 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:05.782282 986 leader_election.cc:343] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.782491 986 leader_election.cc:304] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.783545 1400 raft_consensus.cc:493] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.783701 1400 raft_consensus.cc:515] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.784286 1400 leader_election.cc:290] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.784435 1400 raft_consensus.cc:2749] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.785043 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452f7d2bceb5447290370f72ec788608" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:05.785931 713 leader_election.cc:304] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:05.786214 1425 raft_consensus.cc:2749] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:05.786275 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet df705c2300064db680bec1fefab08d2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df705c2300064db680bec1fefab08d2f already in progress: creating tablet
I20260617 07:53:05.786909 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f67a6c1dcf4a69842452c371a9c078" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:05.787503 988 leader_election.cc:343] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.787994 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f67a6c1dcf4a69842452c371a9c078" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:05.788488 986 leader_election.cc:343] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.788632 986 leader_election.cc:304] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.789072 1364 raft_consensus.cc:2749] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.790920 1172 tablet_bootstrap.cc:654] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.791181 1171 tablet_bootstrap.cc:492] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:05.791407 1171 ts_tablet_manager.cc:1403] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.004s
I20260617 07:53:05.792212 1171 raft_consensus.cc:359] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.792496 1171 raft_consensus.cc:385] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.792614 1171 raft_consensus.cc:740] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.792933 1171 consensus_queue.cc:260] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.800328 1171 ts_tablet_manager.cc:1434] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260617 07:53:05.805460 1364 raft_consensus.cc:493] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.805727 1364 raft_consensus.cc:515] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.806594 1364 leader_election.cc:290] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:05.806862 1171 tablet_bootstrap.cc:492] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:05.807585 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a460aee4eb514a87b272c4fc858335e7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:05.808014 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a460aee4eb514a87b272c4fc858335e7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:05.808651 988 leader_election.cc:343] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:05.809082 986 leader_election.cc:343] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.809218 986 leader_election.cc:304] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.809373 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.809731 1364 raft_consensus.cc:2749] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.813323 1175 ts_tablet_manager.cc:1929] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:05.813474 1175 log.cc:1199] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a31fba373a214b5a96bd11b930ed3b86
I20260617 07:53:05.813949 1175 ts_tablet_manager.cc:1950] T a31fba373a214b5a96bd11b930ed3b86 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:05.815796 1171 tablet_bootstrap.cc:654] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.812741 1272 raft_consensus.cc:515] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.820762 1272 leader_election.cc:290] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.822292 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b99b80966c94937baf7172b0c36af2a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:05.822582 779 raft_consensus.cc:3060] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:05.828459 988 leader_election.cc:343] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 5b99b80966c94937baf7172b0c36af2a
I20260617 07:53:05.835071 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet df4f9101deaa4e6ebddacbce14f32810
I20260617 07:53:05.838201 890 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.838687 760 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.839051 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0fe95c790e874e80b3d3e10ca23cc31e" } new_table_name: "default.Table_9e10117b19d649668289e1ad8374ff7d" modify_external_catalogs: true
W20260617 07:53:05.841459 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet df4f9101deaa4e6ebddacbce14f32810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df4f9101deaa4e6ebddacbce14f32810 already in progress: creating tablet
I20260617 07:53:05.842168 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f7c1596383794dd7859b1f08d873678a" } new_table_name: "default.Table_120df0ba6ac044f5b3528f6016062dab" modify_external_catalogs: true
I20260617 07:53:05.843887 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5346310486bb4b0ea18fdc5d30e84379"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.844367 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5346310486bb4b0ea18fdc5d30e84379 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.846071 1172 tablet_bootstrap.cc:492] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.846226 1172 ts_tablet_manager.cc:1403] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.006s
I20260617 07:53:05.846920 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_119ecdf0aa5343da9cee836dd150a21a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.847704 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_119ecdf0aa5343da9cee836dd150a21a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.847803 1172 raft_consensus.cc:359] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.848049 1172 raft_consensus.cc:385] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.848157 1172 raft_consensus.cc:740] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.848508 1172 consensus_queue.cc:260] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.849941 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 452f7d2bceb5447290370f72ec788608
I20260617 07:53:05.850446 780 raft_consensus.cc:3060] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.850562 525 catalog_manager.cc:6784] ReplaceTablet: tablet 452f7d2bceb5447290370f72ec788608 deleted and replaced by tablet 440e57c1cf07484ab1a4ba721aae1ed7
I20260617 07:53:05.850878 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_29487528287c44c0bdddf8d719e80f08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.851349 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29487528287c44c0bdddf8d719e80f08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.852874 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 452f7d2bceb5447290370f72ec788608 with delete_type TABLET_DATA_DELETED (replaced by tablet 440e57c1cf07484ab1a4ba721aae1ed7) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.854159 524 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 262a34e120f34689ba0b598d7a2999fd (table default.Table_6f686d428f8c4d9bacafed83c2a72029 [id=bc72e8ae07954b5d9f55178f136a72bc]). Expected version 1 got 0
I20260617 07:53:05.854331 524 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 36cbea7b0f024422bc281ea97f6d76d5 (table default.Table_6e54085dfd0041d2bdb49961526e7594 [id=6f0e007c645a43e6a9611001e0de1864]). Expected version 2 got 0
I20260617 07:53:05.854842 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 452f7d2bceb5447290370f72ec788608 with delete_type TABLET_DATA_DELETED (replaced by tablet 440e57c1cf07484ab1a4ba721aae1ed7) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.856736 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 452f7d2bceb5447290370f72ec788608 with delete_type TABLET_DATA_DELETED (replaced by tablet 440e57c1cf07484ab1a4ba721aae1ed7) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.857075 1169 tablet_replica.cc:333] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:05.857368 1169 raft_consensus.cc:2243] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.857374 526 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 4ecf80e090494539ae3d20448f8d1126 (table default.Table_ac940c0f5a9d49babeff827981e9d7d3 [id=829b5684836747b2aa4265ac17eccd80]). Expected version 1 got 0
I20260617 07:53:05.857621 1169 raft_consensus.cc:2272] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.858948 1169 ts_tablet_manager.cc:1916] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.859220 1171 tablet_bootstrap.cc:492] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:05.859365 1171 ts_tablet_manager.cc:1403] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.015s
I20260617 07:53:05.860211 1171 raft_consensus.cc:359] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.860419 1171 raft_consensus.cc:385] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.860463 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 36ce60b466f7420992ef194d72b5718d from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:05.860532 1171 raft_consensus.cc:740] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.862998 1172 ts_tablet_manager.cc:1434] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260617 07:53:05.863335 1172 tablet_bootstrap.cc:492] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:05.864763 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 706373f1f5d44edf81ed04183a8bdf89 consensus state has no leader
I20260617 07:53:05.864771 1171 consensus_queue.cc:260] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.865466 1171 ts_tablet_manager.cc:1434] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:05.865782 1171 tablet_bootstrap.cc:492] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:05.867985 1171 tablet_bootstrap.cc:654] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.865046 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 63bf519b83c445798bddda3120b542ce from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:05.873601 963 heartbeater.cc:344] Connected to a master server at 127.0.105.188:33087
I20260617 07:53:05.891404 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 787467c65f68442aad071df16d4492f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.891628 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9d9ed003c64b1abed6bd3bb14456cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.891737 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:05.892230 988 consensus_peers.cc:597] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9e253dca6904dfb914ed4be554da4b5. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.894151 1272 raft_consensus.cc:493] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.894615 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet a460aee4eb514a87b272c4fc858335e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:05.895807 988 consensus_peers.cc:597] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ffce17fe5c8405a94a93ad7dd67806e. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.896327 1272 raft_consensus.cc:515] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.897198 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.898144 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 19f8525046964950884b0f9aa515ec81 with delete_type TABLET_DATA_DELETED (replaced by tablet 9cddb9e82c354f26b3abe56ebdefd008) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:05.898931 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5203534569bd4da18bc06751f094735f consensus state has no leader
I20260617 07:53:05.899339 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0f2f9a75d4f9ba8702e4da75c042f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:05.899425 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c381382f3b774340a814a8e4d9d75c76" } new_table_name: "default.Table_64457de2b58244afa9932a32a979774d" modify_external_catalogs: true
I20260617 07:53:05.899561 917 raft_consensus.cc:2468] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:05.900416 988 leader_election.cc:304] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:05.900719 1364 raft_consensus.cc:2804] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:05.900831 1364 raft_consensus.cc:493] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:05.900909 1364 raft_consensus.cc:3060] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:05.901173 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ec425bb523a449d9fe16d3ea3a0d7ae consensus state has no leader
I20260617 07:53:05.901656 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_d199dae87e49454e8a74b84f1e0e28df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:05.902269 1272 leader_election.cc:290] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:05.905855 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.905917 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0f2f9a75d4f9ba8702e4da75c042f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:05.906102 1172 tablet_bootstrap.cc:654] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.906419 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 074a3e08cc9a4be891016ce197a993be with delete_type TABLET_DATA_DELETED (replaced by tablet cc4d21f9ad9543b0b90fc66f1a6e3b13) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.907061 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e0f2f9a75d4f9ba8702e4da75c042f with delete_type TABLET_DATA_DELETED (replaced by tablet 56c70f5c41e04ad0b913c15aa315353f) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:05.910418 986 leader_election.cc:343] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.910562 1172 tablet_bootstrap.cc:492] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.910715 1172 ts_tablet_manager.cc:1403] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.003s
I20260617 07:53:05.911563 1172 raft_consensus.cc:359] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.911767 1172 raft_consensus.cc:385] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.911846 1172 raft_consensus.cc:740] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.912148 1172 consensus_queue.cc:260] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.912635 1172 ts_tablet_manager.cc:1434] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 07:53:05.913040 1172 tablet_bootstrap.cc:492] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.914170 779 raft_consensus.cc:2468] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:05.914819 1172 tablet_bootstrap.cc:654] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.917606 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.919796 1175 tablet_replica.cc:333] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:05.920051 1175 raft_consensus.cc:2243] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:05.920281 1175 raft_consensus.cc:2272] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:05.915355 1170 ts_tablet_manager.cc:1929] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:05.921662 1170 log.cc:1199] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/2a2ee285802f47b98c152daad8cfd9d7
I20260617 07:53:05.922215 1170 ts_tablet_manager.cc:1950] T 2a2ee285802f47b98c152daad8cfd9d7 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:05.922441 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d199dae87e49454e8a74b84f1e0e28df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.924979 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a31fba373a214b5a96bd11b930ed3b86 (table default.Table_da86397a452b40d085e68d6df9132dbe [id=d3e06ba3c45f4836aee5420d99de4b23]) successfully deleted
W20260617 07:53:05.925323 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a38bb8a140ef4bcab65aaa03bdb79040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a38bb8a140ef4bcab65aaa03bdb79040 already in progress: creating tablet
W20260617 07:53:05.925576 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 89783bab2e584fe9a8eda963f78bf3ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89783bab2e584fe9a8eda963f78bf3ec already in progress: creating tablet
I20260617 07:53:05.926244 986 leader_election.cc:304] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:05.926576 779 raft_consensus.cc:3060] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.926911 1272 raft_consensus.cc:2804] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:05.927098 1272 raft_consensus.cc:697] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:05.927379 1175 ts_tablet_manager.cc:1916] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:05.927354 1272 consensus_queue.cc:237] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.930887 1172 tablet_bootstrap.cc:492] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.931043 1172 ts_tablet_manager.cc:1403] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.009s
I20260617 07:53:05.931794 1172 raft_consensus.cc:359] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.932004 1172 raft_consensus.cc:385] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.932106 1172 raft_consensus.cc:740] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.932322 1172 consensus_queue.cc:260] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.932840 1172 ts_tablet_manager.cc:1434] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:05.933149 1172 tablet_bootstrap.cc:492] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.933382 1364 raft_consensus.cc:515] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:05.934194 1364 leader_election.cc:290] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:05.935245 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0f2f9a75d4f9ba8702e4da75c042f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:05.935743 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0f2f9a75d4f9ba8702e4da75c042f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:05.935956 917 raft_consensus.cc:3060] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.936189 1172 tablet_bootstrap.cc:654] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:05.939939 986 leader_election.cc:343] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:05.944656 1172 tablet_bootstrap.cc:492] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.944842 1172 ts_tablet_manager.cc:1403] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260617 07:53:05.946548 1172 raft_consensus.cc:359] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.947009 1425 raft_consensus.cc:493] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.947177 1425 raft_consensus.cc:515] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.947882 1425 leader_election.cc:290] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.948494 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 262a34e120f34689ba0b598d7a2999fd
I20260617 07:53:05.948565 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf7f07441954d35916890efbfa4d836" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:05.949383 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 262a34e120f34689ba0b598d7a2999fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.950315 894 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.951126 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 262a34e120f34689ba0b598d7a2999fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:05.951661 760 tablet_service.cc:1558] Processing DeleteTablet for tablet c3a29aeb0a224cabb642f4100c44b8f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:05.946794 1172 raft_consensus.cc:385] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.952893 1172 raft_consensus.cc:740] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.953156 1172 consensus_queue.cc:260] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.952775 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf7f07441954d35916890efbfa4d836" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:05.953917 777 raft_consensus.cc:3060] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:05.954452 713 leader_election.cc:304] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:05.954841 1172 ts_tablet_manager.cc:1434] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260617 07:53:05.955145 1172 tablet_bootstrap.cc:492] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:05.955837 1425 raft_consensus.cc:2749] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.956332 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 262a34e120f34689ba0b598d7a2999fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:05.956801 1172 tablet_bootstrap.cc:654] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.958755 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:05.959534 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.961526 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_bd0db0a6290342548196f468ee98943f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:05.961628 1527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29a94ff9f875443ab6aeac00922cda0d. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:05.961871 1527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:53:05.962049 1527 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29a94ff9f875443ab6aeac00922cda0d)
W20260617 07:53:05.962136 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd0db0a6290342548196f468ee98943f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:05.962229 1527 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:05.965049 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1735b3a964d948ea9c83c11e8adf8c68" } modify_external_catalogs: true
I20260617 07:53:05.965248 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1735b3a964d948ea9c83c11e8adf8c68" } modify_external_catalogs: true
I20260617 07:53:05.967334 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_4d28d190e4ca42dc96c1b61c33672c61" } modify_external_catalogs: true
I20260617 07:53:05.967589 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_4d28d190e4ca42dc96c1b61c33672c61" } modify_external_catalogs: true
I20260617 07:53:05.968892 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_7a1f339bec3247f88e0532b180d8222a" } new_table_name: "default.Table_76ba66e135e34c4cab87ecfb9db4d2f5" modify_external_catalogs: true
I20260617 07:53:05.970641 1172 tablet_bootstrap.cc:492] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.970808 1172 ts_tablet_manager.cc:1403] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
I20260617 07:53:05.971971 1527 leader_election.cc:290] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becdd6b4fad846399c95f04697e01d0f (127.0.105.190:41615), 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505)
I20260617 07:53:05.972602 1172 raft_consensus.cc:359] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.972779 1172 raft_consensus.cc:385] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.972908 1172 raft_consensus.cc:740] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.974867 1172 consensus_queue.cc:260] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.975898 1172 ts_tablet_manager.cc:1434] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:05.976188 1172 tablet_bootstrap.cc:492] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:05.976701 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc84665c7849469aa27e6505dbed1516 consensus state has no leader
W20260617 07:53:05.977459 988 consensus_peers.cc:597] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:05.977953 1172 tablet_bootstrap.cc:654] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:05.979815 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b5dd15921c6b423fad2fcbc1f3731fae" } modify_external_catalogs: true
I20260617 07:53:05.980018 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b5dd15921c6b423fad2fcbc1f3731fae" } modify_external_catalogs: true
I20260617 07:53:05.992802 1425 raft_consensus.cc:493] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:05.993059 1425 raft_consensus.cc:515] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:05.994035 1425 leader_election.cc:290] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:05.994671 1172 tablet_bootstrap.cc:492] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:05.994868 1172 ts_tablet_manager.cc:1403] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.005s
W20260617 07:53:05.995801 716 leader_election.cc:343] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a5b7b95327604ef8b43944c4821d4ed7
I20260617 07:53:05.996441 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5b7b95327604ef8b43944c4821d4ed7" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:05.996838 1172 raft_consensus.cc:359] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.997058 1172 raft_consensus.cc:385] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:05.997128 1172 raft_consensus.cc:740] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:05.997323 713 leader_election.cc:304] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:05.998003 1172 consensus_queue.cc:260] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:05.998070 1425 raft_consensus.cc:2749] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:05.999094 1172 ts_tablet_manager.cc:1434] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:05.999452 1172 tablet_bootstrap.cc:492] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.003455 917 raft_consensus.cc:2468] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:06.004454 988 leader_election.cc:304] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:06.004864 1400 raft_consensus.cc:2804] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:06.005013 1400 raft_consensus.cc:697] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:06.005254 1400 consensus_queue.cc:237] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.010243 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 231) took 1563 ms. Trace:
I20260617 07:53:06.010370 1170 rpcz_store.cc:276] 0617 07:53:04.446873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.447160 (+ 287us) service_pool.cc:224] Handling call
0617 07:53:05.725034 (+1277874us) ts_tablet_manager.cc:1151] Deleting tablet 2a2ee285802f47b98c152daad8cfd9d7
0617 07:53:05.725043 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:05.815527 (+ 90484us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:05.915274 (+ 99747us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.010179 (+ 94905us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1277720}
I20260617 07:53:06.010840 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 235) took 1513 ms. Trace:
I20260617 07:53:06.010953 1170 rpcz_store.cc:276] 0617 07:53:04.497432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.497933 (+ 501us) service_pool.cc:224] Handling call
0617 07:53:06.010663 (+1512730us) ts_tablet_manager.cc:1151] Deleting tablet 2684f3200e604bb6bf37a2f97a193eff
0617 07:53:06.010673 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.010779 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1512524}
I20260617 07:53:06.011328 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 237) took 1513 ms. Trace:
I20260617 07:53:06.011530 1170 rpcz_store.cc:276] 0617 07:53:04.497638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.498181 (+ 543us) service_pool.cc:224] Handling call
0617 07:53:06.011159 (+1512978us) ts_tablet_manager.cc:1151] Deleting tablet ab8388648475499db50cc16a7c36775a
0617 07:53:06.011169 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.011257 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1512805}
I20260617 07:53:06.011976 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 238) took 1514 ms. Trace:
I20260617 07:53:06.012074 1170 rpcz_store.cc:276] 0617 07:53:04.497792 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.498383 (+ 591us) service_pool.cc:224] Handling call
0617 07:53:06.011781 (+1513398us) ts_tablet_manager.cc:1151] Deleting tablet be14a95f458d440e86133ef65c484571
0617 07:53:06.011790 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.011871 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1513235}
I20260617 07:53:06.012501 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 239) took 1514 ms. Trace:
I20260617 07:53:06.012594 1170 rpcz_store.cc:276] 0617 07:53:04.497887 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.498589 (+ 702us) service_pool.cc:224] Handling call
0617 07:53:06.012347 (+1513758us) ts_tablet_manager.cc:1151] Deleting tablet 82d682ae37d74b4b967da0f8e2de6301
0617 07:53:06.012356 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.012447 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1513554}
I20260617 07:53:06.012988 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 240) took 1514 ms. Trace:
I20260617 07:53:06.013082 1170 rpcz_store.cc:276] 0617 07:53:04.498940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.498988 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:06.012837 (+1513849us) ts_tablet_manager.cc:1151] Deleting tablet c7343400555f447b8a1721ba36d7766d
0617 07:53:06.012846 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.012928 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1513650}
I20260617 07:53:06.013386 1170 tablet_replica.cc:333] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:06.013594 1170 raft_consensus.cc:2243] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:06.014020 1169 ts_tablet_manager.cc:1929] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:06.014156 1169 log.cc:1199] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/452f7d2bceb5447290370f72ec788608
I20260617 07:53:06.014671 1169 ts_tablet_manager.cc:1950] T 452f7d2bceb5447290370f72ec788608 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:06.016747 532 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 4ecf80e090494539ae3d20448f8d1126 (table default.Table_ac940c0f5a9d49babeff827981e9d7d3 [id=829b5684836747b2aa4265ac17eccd80]). Expected version 1 got 0
I20260617 07:53:06.024719 1172 tablet_bootstrap.cc:654] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.025571 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 57e05a97a4ab4ed7bff523d1fb1c59ae from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:06.026046 1366 consensus_queue.cc:1048] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:06.027446 760 tablet_service.cc:1511] Processing CreateTablet for tablet 70e4068fdcbb41de966bcc72a4d1d426 (DEFAULT_TABLE table=default.Table_0ebdf4b1d9ba4845958bccb5883ec491 [id=369a4a7b1948442aa0520b679c3cf974]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.027938 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e4068fdcbb41de966bcc72a4d1d426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.028116 890 tablet_service.cc:1511] Processing CreateTablet for tablet 70e4068fdcbb41de966bcc72a4d1d426 (DEFAULT_TABLE table=default.Table_0ebdf4b1d9ba4845958bccb5883ec491 [id=369a4a7b1948442aa0520b679c3cf974]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.028591 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e4068fdcbb41de966bcc72a4d1d426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.035878 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 2a2ee285802f47b98c152daad8cfd9d7 (table default.Table_41b3fa5c301945ff93a84c7b89309508 [id=29666c7cf6b54264910c2352e985ea96]) successfully deleted
I20260617 07:53:06.035964 1172 tablet_bootstrap.cc:492] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.036098 1172 ts_tablet_manager.cc:1403] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.004s
W20260617 07:53:06.036208 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2684f3200e604bb6bf37a2f97a193eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2684f3200e604bb6bf37a2f97a193eff already in progress: creating tablet
W20260617 07:53:06.036481 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ab8388648475499db50cc16a7c36775a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab8388648475499db50cc16a7c36775a already in progress: creating tablet
W20260617 07:53:06.036705 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet be14a95f458d440e86133ef65c484571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be14a95f458d440e86133ef65c484571 already in progress: creating tablet
W20260617 07:53:06.036937 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 82d682ae37d74b4b967da0f8e2de6301 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d682ae37d74b4b967da0f8e2de6301 already in progress: creating tablet
W20260617 07:53:06.037161 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c7343400555f447b8a1721ba36d7766d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7343400555f447b8a1721ba36d7766d already in progress: creating tablet
I20260617 07:53:06.038360 1172 raft_consensus.cc:359] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.038553 1172 raft_consensus.cc:385] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.038659 1172 raft_consensus.cc:740] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.041566 1172 consensus_queue.cc:260] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.043215 1172 ts_tablet_manager.cc:1434] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260617 07:53:06.043428 1170 raft_consensus.cc:2272] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.043532 1172 tablet_bootstrap.cc:492] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.046993 1364 raft_consensus.cc:493] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.047143 1364 raft_consensus.cc:515] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.047814 1364 leader_election.cc:290] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.048195 1584 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260617 07:53:06.048650 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:06.049186 986 leader_election.cc:343] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.049630 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:06.050146 988 leader_election.cc:343] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.050268 988 leader_election.cc:304] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:06.051168 1272 raft_consensus.cc:2749] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.055043 1170 ts_tablet_manager.cc:1916] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.059027 1172 tablet_bootstrap.cc:654] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.063500 1171 tablet_bootstrap.cc:492] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:06.063702 1171 ts_tablet_manager.cc:1403] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.198s user 0.013s sys 0.025s
I20260617 07:53:06.064826 1171 raft_consensus.cc:359] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.065093 1171 raft_consensus.cc:385] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.065184 1171 raft_consensus.cc:740] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.065874 1171 consensus_queue.cc:260] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.067226 1431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29a94ff9f875443ab6aeac00922cda0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:06.067498 1431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: This master's current role is: LEADER
I20260617 07:53:06.071664 1171 ts_tablet_manager.cc:1434] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260617 07:53:06.074760 1171 tablet_bootstrap.cc:492] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:06.079459 1171 tablet_bootstrap.cc:654] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.086992 1178 tablet_bootstrap.cc:492] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:06.087168 1178 ts_tablet_manager.cc:1403] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.327s user 0.055s sys 0.102s
I20260617 07:53:06.088145 1178 raft_consensus.cc:359] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:06.088379 1178 raft_consensus.cc:385] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.088481 1178 raft_consensus.cc:740] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.091302 1178 consensus_queue.cc:260] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:06.094714 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 70e4068fdcbb41de966bcc72a4d1d426 (DEFAULT_TABLE table=default.Table_0ebdf4b1d9ba4845958bccb5883ec491 [id=369a4a7b1948442aa0520b679c3cf974]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.095585 1178 ts_tablet_manager.cc:1434] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 07:53:06.095908 1178 tablet_bootstrap.cc:492] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:06.097431 1425 raft_consensus.cc:493] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.097642 1178 tablet_bootstrap.cc:654] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.097585 1425 raft_consensus.cc:515] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:06.098352 1425 leader_election.cc:290] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:06.098563 517 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet cc84665c7849469aa27e6505dbed1516 (table default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet cc84665c7849469aa27e6505dbed1516 consensus state has no leader
W20260617 07:53:06.099913 716 leader_election.cc:343] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 2063248863ed46c196c93013230529fe
W20260617 07:53:06.100613 713 leader_election.cc:343] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 2063248863ed46c196c93013230529fe
I20260617 07:53:06.100767 713 leader_election.cc:304] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:06.103961 1425 raft_consensus.cc:2749] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.104764 778 raft_consensus.cc:3060] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:06.107913 890 tablet_service.cc:1511] Processing CreateTablet for tablet 370c8ddac0c747f6b44926f982233ea9 (DEFAULT_TABLE table=default.Table_4b89f3bc484f44458e623c0e47f28f5f [id=683c9be609d948c8b135b8648a820447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.108425 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370c8ddac0c747f6b44926f982233ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.109115 1178 tablet_bootstrap.cc:492] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:06.109285 1178 ts_tablet_manager.cc:1403] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20260617 07:53:06.110545 1178 raft_consensus.cc:359] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.110736 1178 raft_consensus.cc:385] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.110828 1178 raft_consensus.cc:740] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.111210 1169 tablet_replica.cc:333] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:06.111438 1169 raft_consensus.cc:2243] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:06.111600 1169 raft_consensus.cc:2272] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.112180 1169 ts_tablet_manager.cc:1916] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.113425 1178 consensus_queue.cc:260] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.114776 1400 consensus_queue.cc:1048] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:06.114981 1175 ts_tablet_manager.cc:1929] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:06.115149 1175 log.cc:1199] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/086e43b610f9430c872daeef35c5586a
I20260617 07:53:06.115640 1175 ts_tablet_manager.cc:1950] T 086e43b610f9430c872daeef35c5586a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:06.116888 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 452f7d2bceb5447290370f72ec788608 (table default.Table_4d28d190e4ca42dc96c1b61c33672c61 [id=26e1a39e290446dd976682e916b6bd0d]) successfully deleted
I20260617 07:53:06.117600 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e4068fdcbb41de966bcc72a4d1d426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.123862 754 tablet_service.cc:1511] Processing CreateTablet for tablet 370c8ddac0c747f6b44926f982233ea9 (DEFAULT_TABLE table=default.Table_4b89f3bc484f44458e623c0e47f28f5f [id=683c9be609d948c8b135b8648a820447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.124344 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370c8ddac0c747f6b44926f982233ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.127995 1178 ts_tablet_manager.cc:1434] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.019s user 0.000s sys 0.003s
I20260617 07:53:06.128304 1178 tablet_bootstrap.cc:492] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:06.128858 1425 raft_consensus.cc:493] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.129187 1425 raft_consensus.cc:515] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:06.129920 1425 leader_election.cc:290] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:06.130345 1178 tablet_bootstrap.cc:654] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.130751 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc0439f992048358f1de4381516e543" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:06.131652 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc0439f992048358f1de4381516e543" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:06.132445 713 leader_election.cc:304] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:06.133114 1425 raft_consensus.cc:2749] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.138504 1171 tablet_bootstrap.cc:492] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:06.138669 1171 ts_tablet_manager.cc:1403] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.064s user 0.001s sys 0.002s
I20260617 07:53:06.139503 1171 raft_consensus.cc:359] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.139688 1171 raft_consensus.cc:385] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.139778 1171 raft_consensus.cc:740] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.140009 1171 consensus_queue.cc:260] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.140300 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 370c8ddac0c747f6b44926f982233ea9 (DEFAULT_TABLE table=default.Table_4b89f3bc484f44458e623c0e47f28f5f [id=683c9be609d948c8b135b8648a820447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.140544 1171 ts_tablet_manager.cc:1434] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:06.141269 1171 tablet_bootstrap.cc:492] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:06.143874 1178 tablet_bootstrap.cc:492] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:06.144034 1178 ts_tablet_manager.cc:1403] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260617 07:53:06.145666 1171 tablet_bootstrap.cc:654] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.150818 894 tablet_service.cc:1511] Processing CreateTablet for tablet 95865af94c04410386d23cb369180611 (DEFAULT_TABLE table=default.Table_a9de59c0e19946de8df23f1869eab317 [id=9b3274df0c184a92af3bc0f10185e41e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.150996 753 tablet_service.cc:1511] Processing CreateTablet for tablet 95865af94c04410386d23cb369180611 (DEFAULT_TABLE table=default.Table_a9de59c0e19946de8df23f1869eab317 [id=9b3274df0c184a92af3bc0f10185e41e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.151556 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95865af94c04410386d23cb369180611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.151510 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 95865af94c04410386d23cb369180611 (DEFAULT_TABLE table=default.Table_a9de59c0e19946de8df23f1869eab317 [id=9b3274df0c184a92af3bc0f10185e41e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:06.155807 988 consensus_peers.cc:597] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5b7b95327604ef8b43944c4821d4ed7. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:06.156798 1171 tablet_bootstrap.cc:492] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:06.156961 1171 ts_tablet_manager.cc:1403] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
I20260617 07:53:06.157828 1171 raft_consensus.cc:359] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.158042 1171 raft_consensus.cc:385] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.158128 1171 raft_consensus.cc:740] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.159245 1171 consensus_queue.cc:260] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.161266 1171 ts_tablet_manager.cc:1434] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:06.161569 1171 tablet_bootstrap.cc:492] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:06.162303 525 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 440e57c1cf07484ab1a4ba721aae1ed7
I20260617 07:53:06.164464 1171 tablet_bootstrap.cc:654] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.165138 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_4eb17dccfecb4f6b87322057782dd4f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:06.165297 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 452f7d2bceb5447290370f72ec788608 with delete_type TABLET_DATA_DELETED (replaced by tablet 440e57c1cf07484ab1a4ba721aae1ed7) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.165587 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 074a3e08cc9a4be891016ce197a993be with delete_type TABLET_DATA_DELETED (replaced by tablet cc4d21f9ad9543b0b90fc66f1a6e3b13) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:06.165757 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4eb17dccfecb4f6b87322057782dd4f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.165838 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e0f2f9a75d4f9ba8702e4da75c042f with delete_type TABLET_DATA_DELETED (replaced by tablet 56c70f5c41e04ad0b913c15aa315353f) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.166188 1364 raft_consensus.cc:493] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.166357 1364 raft_consensus.cc:515] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.166996 1364 leader_election.cc:290] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.167055 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_d3c466258c0b40f09368d392be11d6dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.167574 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3c466258c0b40f09368d392be11d6dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.168411 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c1c44020a4586b3197f5f68a38963" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:06.168771 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6546b71cbcb9438cb73da79622d9b0fe" } modify_external_catalogs: true
I20260617 07:53:06.168938 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_6546b71cbcb9438cb73da79622d9b0fe" } modify_external_catalogs: true
W20260617 07:53:06.169299 986 leader_election.cc:343] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.170357 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c1c44020a4586b3197f5f68a38963" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:06.171088 988 leader_election.cc:343] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.171237 988 leader_election.cc:304] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:06.171777 1364 raft_consensus.cc:2749] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.171999 524 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d9968c8179c14d1b9bc9a2c2779fb86e (table default.Table_b1130f99f87744ee91f907e95346d984 [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 2 got 0
I20260617 07:53:06.174417 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.174830 1364 raft_consensus.cc:493] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.175458 1364 raft_consensus.cc:515] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.176081 1364 leader_election.cc:290] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.177241 524 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 875962c2e27a4ee1b9889769d53022cc (table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a]). Expected version 1 got 0
I20260617 07:53:06.179046 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01721f68e3c41f4a2ffaf05bb180761" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:06.179471 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5db1eb601069498e990dbb8635e0aa1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.180032 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5db1eb601069498e990dbb8635e0aa1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.180215 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01721f68e3c41f4a2ffaf05bb180761" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:06.181950 1171 tablet_bootstrap.cc:492] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:06.181979 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f345910256784d2085cb81473534dcaf with delete_type TABLET_DATA_DELETED (replaced by tablet 570ae1e189a64da6bad10156b401ec46) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.182117 1171 ts_tablet_manager.cc:1403] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.001s
I20260617 07:53:06.182236 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.182469 889 tablet_service.cc:1558] Processing DeleteTablet for tablet a460aee4eb514a87b272c4fc858335e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.182971 1171 raft_consensus.cc:359] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.183164 1171 raft_consensus.cc:385] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.183279 1171 raft_consensus.cc:740] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.184003 1171 consensus_queue.cc:260] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.187007 1171 ts_tablet_manager.cc:1434] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:06.187335 1171 tablet_bootstrap.cc:492] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:06.190841 1171 tablet_bootstrap.cc:654] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:06.199673 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e3b5cb887da4d86bdc3d69f350fdb40 consensus state has no leader
I20260617 07:53:06.200654 469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b274c37ad4445ba8b41d6784b3cd336" candidate_term: 2 candidate_status { last_received { term: 1 index: 331 } } ignore_live_leader: false dest_uuid: "becdd6b4fad846399c95f04697e01d0f" is_pre_election: true
W20260617 07:53:06.201584 988 leader_election.cc:343] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:06.202489 986 leader_election.cc:343] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.202877 986 leader_election.cc:304] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:06.203672 1364 raft_consensus.cc:2749] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.203821 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 245cff69d83b43e98b1c72b8d3011347
I20260617 07:53:06.202129 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 with delete_type TABLET_DATA_DELETED (replaced by tablet d6ab00c0be9545cc97a0f29d82de4877) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.202229 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.205518 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 245cff69d83b43e98b1c72b8d3011347 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.206414 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 245cff69d83b43e98b1c72b8d3011347 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.206905 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 245cff69d83b43e98b1c72b8d3011347 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.207782 889 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7611958cf143438497c93f5f2bc098 (DEFAULT_TABLE table=default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.208877 751 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7611958cf143438497c93f5f2bc098 (DEFAULT_TABLE table=default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.209985 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7611958cf143438497c93f5f2bc098 (DEFAULT_TABLE table=default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.210388 1017 tablet_service.cc:1511] Processing CreateTablet for tablet d9f7a4ea634f429794b402439d19bbfe (DEFAULT_TABLE table=default.Table_768b8c0a1c2b4100aa62ae9ce4250864 [id=0520008198914d0994fb211238c522bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.211341 895 tablet_service.cc:1511] Processing CreateTablet for tablet d9f7a4ea634f429794b402439d19bbfe (DEFAULT_TABLE table=default.Table_768b8c0a1c2b4100aa62ae9ce4250864 [id=0520008198914d0994fb211238c522bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.211934 892 tablet_service.cc:1511] Processing CreateTablet for tablet 28538804fd254dc8b4a341debf508a85 (DEFAULT_TABLE table=default.Table_e59c908749124f0abd3e5aabc1029149 [id=84bcdf2b9c4e41c5bcd458e52fe90144]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.212376 890 tablet_service.cc:1511] Processing CreateTablet for tablet 956eefc9ac3147bb857a448563c6fb6f (DEFAULT_TABLE table=default.Table_26c85eb5e09949859f6e4039e66bd282 [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.212720 1170 ts_tablet_manager.cc:1929] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:06.212852 1170 log.cc:1199] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/52ae3c99bec7426caac18a6e3880bf51
I20260617 07:53:06.213246 1170 ts_tablet_manager.cc:1950] T 52ae3c99bec7426caac18a6e3880bf51 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:06.213861 752 tablet_service.cc:1511] Processing CreateTablet for tablet d9f7a4ea634f429794b402439d19bbfe (DEFAULT_TABLE table=default.Table_768b8c0a1c2b4100aa62ae9ce4250864 [id=0520008198914d0994fb211238c522bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.214287 749 tablet_service.cc:1511] Processing CreateTablet for tablet 28538804fd254dc8b4a341debf508a85 (DEFAULT_TABLE table=default.Table_e59c908749124f0abd3e5aabc1029149 [id=84bcdf2b9c4e41c5bcd458e52fe90144]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.215224 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95865af94c04410386d23cb369180611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.215194 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 28538804fd254dc8b4a341debf508a85 (DEFAULT_TABLE table=default.Table_e59c908749124f0abd3e5aabc1029149 [id=84bcdf2b9c4e41c5bcd458e52fe90144]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.215930 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28538804fd254dc8b4a341debf508a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.215930 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956eefc9ac3147bb857a448563c6fb6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.216368 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28538804fd254dc8b4a341debf508a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.216545 1178 raft_consensus.cc:359] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.216781 1178 raft_consensus.cc:385] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.216792 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f7a4ea634f429794b402439d19bbfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.216864 1178 raft_consensus.cc:740] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.217134 1178 consensus_queue.cc:260] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.217335 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7611958cf143438497c93f5f2bc098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.217729 1178 ts_tablet_manager.cc:1434] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.074s user 0.002s sys 0.001s
I20260617 07:53:06.219153 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b274c37ad4445ba8b41d6784b3cd336" candidate_term: 2 candidate_status { last_received { term: 1 index: 331 } } ignore_live_leader: false dest_uuid: "29a94ff9f875443ab6aeac00922cda0d" is_pre_election: true
I20260617 07:53:06.220956 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7611958cf143438497c93f5f2bc098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.222815 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f7a4ea634f429794b402439d19bbfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.225908 1361 leader_election.cc:304] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b274c37ad4445ba8b41d6784b3cd336; no voters: 29a94ff9f875443ab6aeac00922cda0d, becdd6b4fad846399c95f04697e01d0f
I20260617 07:53:06.226207 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95865af94c04410386d23cb369180611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.227573 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370c8ddac0c747f6b44926f982233ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.228065 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7611958cf143438497c93f5f2bc098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.231211 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28538804fd254dc8b4a341debf508a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.231352 531 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 875962c2e27a4ee1b9889769d53022cc (table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a]). Expected version 1 got 0
I20260617 07:53:06.231570 531 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ccf7f07441954d35916890efbfa4d836 (table default.Table_d7a2cf493ddd427c9087f6b6b1971450 [id=8b962c8429894c52a1ba7296a6f02205]). Expected version 2 got 0
I20260617 07:53:06.234462 530 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 875962c2e27a4ee1b9889769d53022cc (table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a]). Expected version 1 got 0
I20260617 07:53:06.234508 1175 tablet_replica.cc:333] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:06.234676 1175 raft_consensus.cc:2243] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:06.234884 1175 raft_consensus.cc:2272] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.235397 1175 ts_tablet_manager.cc:1916] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.235524 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_3feac2a6e61848588a7739fe7f28171b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.236084 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3feac2a6e61848588a7739fe7f28171b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.238888 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f2cb23911614f9dab0767b1f6af3d00 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:06.239466 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f7a4ea634f429794b402439d19bbfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.240969 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.241230 1341 consensus_queue.cc:1048] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:06.241968 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 086e43b610f9430c872daeef35c5586a (table default.Table_09a7839ef9df4c6cb77cf0a55a133446 [id=e2e28ecbf16446ae9e53e20ff4537b7d]) successfully deleted
I20260617 07:53:06.242388 754 tablet_service.cc:1558] Processing DeleteTablet for tablet a5b7b95327604ef8b43944c4821d4ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.242406 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 950c1c44020a4586b3197f5f68a38963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.242663 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 52ae3c99bec7426caac18a6e3880bf51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.244659 1272 consensus_queue.cc:1048] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:06.245935 778 raft_consensus.cc:3060] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:06.249552 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 956eefc9ac3147bb857a448563c6fb6f (DEFAULT_TABLE table=default.Table_26c85eb5e09949859f6e4039e66bd282 [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.249958 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956eefc9ac3147bb857a448563c6fb6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.251071 759 tablet_service.cc:1511] Processing CreateTablet for tablet 956eefc9ac3147bb857a448563c6fb6f (DEFAULT_TABLE table=default.Table_26c85eb5e09949859f6e4039e66bd282 [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.251463 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956eefc9ac3147bb857a448563c6fb6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.252091 753 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e253dca6904dfb914ed4be554da4b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.252336 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b99b80966c94937baf7172b0c36af2a with delete_type TABLET_DATA_DELETED (replaced by tablet 82d682ae37d74b4b967da0f8e2de6301) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:06.253764 986 consensus_peers.cc:597] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:06.256577 898 tablet_service.cc:1511] Processing CreateTablet for tablet 121339ab4842432e9fb7bc357750f8ad (DEFAULT_TABLE table=default.Table_4dd323be87d94043a38bea68d8437107 [id=121feb8666fe4cb5b796fecf0bf1f8b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.257062 760 tablet_service.cc:1511] Processing CreateTablet for tablet 121339ab4842432e9fb7bc357750f8ad (DEFAULT_TABLE table=default.Table_4dd323be87d94043a38bea68d8437107 [id=121feb8666fe4cb5b796fecf0bf1f8b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.257477 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121339ab4842432e9fb7bc357750f8ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.260003 1178 tablet_bootstrap.cc:492] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:06.261876 1178 tablet_bootstrap.cc:654] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.269487 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 36ce60b466f7420992ef194d72b5718d
I20260617 07:53:06.270128 526 catalog_manager.cc:6784] ReplaceTablet: tablet 36ce60b466f7420992ef194d72b5718d deleted and replaced by tablet 7ca402543247461aa5384abb65fff364
I20260617 07:53:06.270581 1171 tablet_bootstrap.cc:492] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:06.270735 1171 ts_tablet_manager.cc:1403] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.001s
I20260617 07:53:06.271579 1341 raft_consensus.cc:493] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.271714 1341 raft_consensus.cc:515] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.271987 1171 raft_consensus.cc:359] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.272158 1171 raft_consensus.cc:385] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.272229 1171 raft_consensus.cc:740] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.272492 1341 leader_election.cc:290] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.273168 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074a3e08cc9a4be891016ce197a993be" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:06.273191 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074a3e08cc9a4be891016ce197a993be" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:06.273371 1052 raft_consensus.cc:2468] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:06.273761 852 leader_election.cc:343] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.273895 851 leader_election.cc:304] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:06.273975 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 63bf519b83c445798bddda3120b542ce
I20260617 07:53:06.274497 523 catalog_manager.cc:6784] ReplaceTablet: tablet 63bf519b83c445798bddda3120b542ce deleted and replaced by tablet eb75a965740344c2bd0b68a8dda28be5
I20260617 07:53:06.274546 1341 raft_consensus.cc:2804] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:06.274675 1341 raft_consensus.cc:493] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:06.274770 1341 raft_consensus.cc:3060] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:06.277081 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_11f15932db66445d80bde9f89d93a895" } new_table_name: "default.Table_3d57115da6cb45ca9f32f025cdf4b660" modify_external_catalogs: true
I20260617 07:53:06.277957 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:06.278726 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1ff79467c5924c02bd95106f502854eb" } new_table_name: "default.Table_e57d7374905b4ff0b1e620e152b6d6c0" modify_external_catalogs: true
I20260617 07:53:06.280230 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
I20260617 07:53:06.280750 527 catalog_manager.cc:6784] ReplaceTablet: tablet 57e05a97a4ab4ed7bff523d1fb1c59ae deleted and replaced by tablet 8cf4025a0f784cc6868950e51a45da2e
I20260617 07:53:06.281056 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a479873a764443988e25350cedbbcc16" } new_table_name: "default.Table_be503ca177d549f6a02bc394edcc4fe7" modify_external_catalogs: true
I20260617 07:53:06.282774 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_9e163236fd4f4a23b074e860f9688936"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.283357 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e163236fd4f4a23b074e860f9688936 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.283380 1171 consensus_queue.cc:260] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.285022 1171 ts_tablet_manager.cc:1434] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.014s user 0.001s sys 0.002s
I20260617 07:53:06.285321 1171 tablet_bootstrap.cc:492] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:06.290752 1171 tablet_bootstrap.cc:654] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.296430 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.296922 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.296721 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.297269 1172 tablet_bootstrap.cc:492] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.297452 1172 ts_tablet_manager.cc:1403] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.254s user 0.012s sys 0.025s
I20260617 07:53:06.298261 1172 raft_consensus.cc:359] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.298446 1172 raft_consensus.cc:385] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.298520 1172 raft_consensus.cc:740] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.298761 1172 consensus_queue.cc:260] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.298943 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.298645 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.299146 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.299274 1172 ts_tablet_manager.cc:1434] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:06.299314 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.299604 1172 tablet_bootstrap.cc:492] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.301452 1172 tablet_bootstrap.cc:654] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.301749 526 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 4ecf80e090494539ae3d20448f8d1126 (table default.Table_ac940c0f5a9d49babeff827981e9d7d3 [id=829b5684836747b2aa4265ac17eccd80]). Expected version 1 got 0
I20260617 07:53:06.301880 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.302119 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.302336 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.303763 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9d9ed003c64b1abed6bd3bb14456cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.305935 758 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.306744 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.307973 1400 consensus_queue.cc:1048] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:06.308691 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 19f8525046964950884b0f9aa515ec81 with delete_type TABLET_DATA_DELETED (replaced by tablet 9cddb9e82c354f26b3abe56ebdefd008) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.309980 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.313094 1169 ts_tablet_manager.cc:1929] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:06.313259 1169 log.cc:1199] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/ddb71e5f65cd4b9e8dbe5ddf44e70340
I20260617 07:53:06.313632 1169 ts_tablet_manager.cc:1950] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:06.315780 526 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a882ae04eeb94276bb78ded81fbea708 (table default.Table_1ff79467c5924c02bd95106f502854eb [id=b602ba9d92744e8bb82c4c57e9bfccab]). Expected version 4 got 0
I20260617 07:53:06.321105 893 tablet_service.cc:1511] Processing CreateTablet for tablet 233cae2480ed457bbab22ead8c0bde2c (DEFAULT_TABLE table=default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.321566 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233cae2480ed457bbab22ead8c0bde2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.325457 896 tablet_service.cc:1511] Processing CreateTablet for tablet 2777cf575a914f59b3459f3ce96f5d9a (DEFAULT_TABLE table=default.Table_363a5452c7af426995b20c5f3786760e [id=303a8e07863a4dbe90a17c3c1aeae6c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.325850 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2777cf575a914f59b3459f3ce96f5d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.327689 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 233cae2480ed457bbab22ead8c0bde2c (DEFAULT_TABLE table=default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.328258 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233cae2480ed457bbab22ead8c0bde2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.328341 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121339ab4842432e9fb7bc357750f8ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.331750 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 121339ab4842432e9fb7bc357750f8ad (DEFAULT_TABLE table=default.Table_4dd323be87d94043a38bea68d8437107 [id=121feb8666fe4cb5b796fecf0bf1f8b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.332226 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121339ab4842432e9fb7bc357750f8ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.337037 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 236) took 1839 ms. Trace:
I20260617 07:53:06.337173 1170 rpcz_store.cc:276] 0617 07:53:04.497554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.501763 (+ 4209us) service_pool.cc:224] Handling call
0617 07:53:06.013294 (+1511531us) ts_tablet_manager.cc:1151] Deleting tablet 52ae3c99bec7426caac18a6e3880bf51
0617 07:53:06.013304 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.117459 (+104155us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.212625 (+ 95166us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.336993 (+124368us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1511367}
I20260617 07:53:06.338020 1170 tablet_replica.cc:333] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:06.338234 1170 raft_consensus.cc:2243] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:06.338534 1170 pending_rounds.cc:70] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:06.338611 1170 pending_rounds.cc:77] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772687106244608 op_type: NO_OP noop_request { }
I20260617 07:53:06.338714 1170 raft_consensus.cc:2889] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:06.338822 1170 raft_consensus.cc:2272] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.339377 1170 ts_tablet_manager.cc:1916] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.340093 529 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 0084c9c0e53d4a84aad11e8d6dab5cfa
I20260617 07:53:06.341184 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 59acdc64fe9247d28c4c277161b42f4f from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:06.341167 1341 raft_consensus.cc:515] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.341816 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:06.341974 1341 leader_election.cc:290] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.342213 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_8bcbcd3e54fe45879e296d390920d3b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.342393 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:06.342682 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bcbcd3e54fe45879e296d390920d3b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.343830 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_97c26e097b994c36a82d2b9c95b8be1d" } modify_external_catalogs: true
I20260617 07:53:06.344015 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_97c26e097b994c36a82d2b9c95b8be1d" } modify_external_catalogs: true
I20260617 07:53:06.344491 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074a3e08cc9a4be891016ce197a993be" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:06.344720 1050 raft_consensus.cc:3060] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:06.346912 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 52ae3c99bec7426caac18a6e3880bf51 (table default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]) successfully deleted
I20260617 07:53:06.347728 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 2777cf575a914f59b3459f3ce96f5d9a (DEFAULT_TABLE table=default.Table_363a5452c7af426995b20c5f3786760e [id=303a8e07863a4dbe90a17c3c1aeae6c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.348560 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2777cf575a914f59b3459f3ce96f5d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.341636 529 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 875962c2e27a4ee1b9889769d53022cc (table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a]). Expected version 1 got 0
I20260617 07:53:06.350782 1609 tablet.cc:1724] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:06.350853 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f176abc5534f4cfca902243f1fa75f63" } new_table_name: "default.Table_455c6e0722f34230977add184efbf379" modify_external_catalogs: true
I20260617 07:53:06.351998 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074a3e08cc9a4be891016ce197a993be" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:06.352682 852 leader_election.cc:343] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.353657 777 raft_consensus.cc:3060] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:06.356539 1410 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" instance_seqno: 1781682778784039) as {username='slave'} at 127.0.105.129:53131; Asking this server to re-register.
I20260617 07:53:06.357434 1414 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" instance_seqno: 1781682779293509) as {username='slave'} at 127.0.105.130:32807; Asking this server to re-register.
I20260617 07:53:06.358335 1598 raft_consensus.cc:493] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.358426 825 heartbeater.cc:461] Registering TS with master...
I20260617 07:53:06.358598 963 heartbeater.cc:461] Registering TS with master...
I20260617 07:53:06.358490 1598 raft_consensus.cc:515] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.359334 1598 leader_election.cc:290] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:06.360400 716 leader_election.cc:343] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 52ae3c99bec7426caac18a6e3880bf51
I20260617 07:53:06.360621 1579 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:06.360759 1430 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" instance_seqno: 1781682779782584) as {username='slave'} at 127.0.105.131:42977; Asking this server to re-register.
W20260617 07:53:06.360791 713 leader_election.cc:343] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 52ae3c99bec7426caac18a6e3880bf51
I20260617 07:53:06.360904 713 leader_election.cc:304] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:06.361258 1598 raft_consensus.cc:2749] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.361817 752 tablet_service.cc:1511] Processing CreateTablet for tablet 2777cf575a914f59b3459f3ce96f5d9a (DEFAULT_TABLE table=default.Table_363a5452c7af426995b20c5f3786760e [id=303a8e07863a4dbe90a17c3c1aeae6c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.362377 751 tablet_service.cc:1511] Processing CreateTablet for tablet 233cae2480ed457bbab22ead8c0bde2c (DEFAULT_TABLE table=default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.362484 1097 heartbeater.cc:461] Registering TS with master...
I20260617 07:53:06.362479 1414 ts_manager.cc:194] Registered new tserver with Master: 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.365998 1414 ts_manager.cc:194] Registered new tserver with Master: dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:06.367772 1430 ts_manager.cc:194] Registered new tserver with Master: 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:06.375782 1172 tablet_bootstrap.cc:492] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.375952 1172 ts_tablet_manager.cc:1403] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.076s user 0.006s sys 0.004s
I20260617 07:53:06.376689 1172 raft_consensus.cc:359] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.376858 1172 raft_consensus.cc:385] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.376932 1172 raft_consensus.cc:740] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.377182 1172 consensus_queue.cc:260] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.377766 1172 ts_tablet_manager.cc:1434] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:06.378073 1172 tablet_bootstrap.cc:492] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.380077 1172 tablet_bootstrap.cc:654] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.386269 1169 tablet_replica.cc:333] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:06.386518 1169 raft_consensus.cc:2243] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:06.386947 1169 raft_consensus.cc:2272] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.387552 1169 ts_tablet_manager.cc:1916] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.388396 1050 raft_consensus.cc:2468] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:06.389004 851 leader_election.cc:304] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:06.389309 1341 raft_consensus.cc:2804] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:06.389446 1341 raft_consensus.cc:697] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:06.389691 1175 ts_tablet_manager.cc:1929] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:06.389854 1175 log.cc:1199] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/1ffce17fe5c8405a94a93ad7dd67806e
I20260617 07:53:06.389768 1341 consensus_queue.cc:237] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.390240 1175 ts_tablet_manager.cc:1950] T 1ffce17fe5c8405a94a93ad7dd67806e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:06.391399 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233cae2480ed457bbab22ead8c0bde2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.392131 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2777cf575a914f59b3459f3ce96f5d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.396162 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 (table default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]) successfully deleted
I20260617 07:53:06.400607 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 1f2cb23911614f9dab0767b1f6af3d00
I20260617 07:53:06.401206 531 catalog_manager.cc:6784] ReplaceTablet: tablet 1f2cb23911614f9dab0767b1f6af3d00 deleted and replaced by tablet 4d9ace137c4e496fafac4e729718577f
W20260617 07:53:06.402158 988 consensus_peers.cc:597] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ddb71e5f65cd4b9e8dbe5ddf44e70340. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:06.403452 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_494d237d1c1a4ab8b4939b39873d9793"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.404114 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_494d237d1c1a4ab8b4939b39873d9793 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.404320 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f2cb23911614f9dab0767b1f6af3d00 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d9ace137c4e496fafac4e729718577f) from {username='slave'} at 127.0.0.1:45978
W20260617 07:53:06.405381 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a882ae04eeb94276bb78ded81fbea708 consensus state has no leader
I20260617 07:53:06.405851 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_ff5da22e90ab459a82b09212016eeb52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:06.405776 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_57c2f7c15baa4d8c84ed9e5f7e07264d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.406314 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57c2f7c15baa4d8c84ed9e5f7e07264d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:06.407482 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74ab8e93e3fe475ba9c7b5fce390a8ab consensus state has no leader
I20260617 07:53:06.407789 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_49b1276fd8f846b19cac293aa9f64723" } modify_external_catalogs: true
I20260617 07:53:06.407961 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f2cb23911614f9dab0767b1f6af3d00 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d9ace137c4e496fafac4e729718577f) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.407984 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_49b1276fd8f846b19cac293aa9f64723" } modify_external_catalogs: true
W20260617 07:53:06.406335 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff5da22e90ab459a82b09212016eeb52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.408674 1170 ts_tablet_manager.cc:1929] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:06.408787 1170 log.cc:1199] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/1ffce17fe5c8405a94a93ad7dd67806e
I20260617 07:53:06.408885 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_119ecdf0aa5343da9cee836dd150a21a" } modify_external_catalogs: true
I20260617 07:53:06.409029 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_119ecdf0aa5343da9cee836dd150a21a" } modify_external_catalogs: true
I20260617 07:53:06.409228 1170 ts_tablet_manager.cc:1950] T 1ffce17fe5c8405a94a93ad7dd67806e P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:06.409528 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b2af44d9ab34e4bbea24d6c7d95748b consensus state has no leader
I20260617 07:53:06.410641 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet d21f61a35ca544568bcfca1a6230deca
I20260617 07:53:06.411754 895 tablet_service.cc:1558] Processing DeleteTablet for tablet d21f61a35ca544568bcfca1a6230deca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.412020 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f2cb23911614f9dab0767b1f6af3d00 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d9ace137c4e496fafac4e729718577f) from {username='slave'} at 127.0.0.1:43908
W20260617 07:53:06.413383 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 301bd4d6faec429ba71ce354c23d0f75 consensus state has no leader
I20260617 07:53:06.413463 1175 tablet_replica.cc:333] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:06.413671 1175 raft_consensus.cc:2243] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:06.413866 1175 raft_consensus.cc:2272] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.414357 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet d21f61a35ca544568bcfca1a6230deca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.414440 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b1130f99f87744ee91f907e95346d984" } new_table_name: "default.Table_1ecdf060db0649d28c31d222fe25dda1" modify_external_catalogs: true
I20260617 07:53:06.416253 1175 ts_tablet_manager.cc:1916] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.420053 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 1ffce17fe5c8405a94a93ad7dd67806e (table default.Table_bac89c3b70e94d8f84681a0043fa2ea8 [id=6b5d086b3d7c428b824a39387d817f14]) successfully deleted
I20260617 07:53:06.420535 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d21f61a35ca544568bcfca1a6230deca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.426162 1400 raft_consensus.cc:493] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.426321 1400 raft_consensus.cc:515] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.426923 1400 leader_election.cc:290] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.428107 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd63aa802164f25aca72bea45ea3b96" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:06.428784 988 leader_election.cc:343] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.428859 1169 ts_tablet_manager.cc:1929] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:06.428984 1169 log.cc:1199] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/262a34e120f34689ba0b598d7a2999fd
I20260617 07:53:06.429275 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd63aa802164f25aca72bea45ea3b96" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:06.429890 986 leader_election.cc:343] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.430024 986 leader_election.cc:304] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:06.430394 1611 tablet.cc:1724] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:06.431483 1169 ts_tablet_manager.cc:1950] T 262a34e120f34689ba0b598d7a2999fd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:06.432010 1178 tablet_bootstrap.cc:492] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:06.432170 1178 ts_tablet_manager.cc:1403] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.172s user 0.000s sys 0.019s
I20260617 07:53:06.433221 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 262a34e120f34689ba0b598d7a2999fd (table default.Table_6f686d428f8c4d9bacafed83c2a72029 [id=bc72e8ae07954b5d9f55178f136a72bc]) successfully deleted
I20260617 07:53:06.433941 1178 raft_consensus.cc:359] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.434150 1178 raft_consensus.cc:385] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.430496 1400 raft_consensus.cc:2749] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.434242 1178 raft_consensus.cc:740] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.434533 1178 consensus_queue.cc:260] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.435031 1178 ts_tablet_manager.cc:1434] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:06.440819 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 248) took 1767 ms. Trace:
I20260617 07:53:06.441016 1170 rpcz_store.cc:276] 0617 07:53:04.673631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.673691 (+ 60us) service_pool.cc:224] Handling call
0617 07:53:06.337502 (+1663811us) ts_tablet_manager.cc:1151] Deleting tablet 1ffce17fe5c8405a94a93ad7dd67806e
0617 07:53:06.337511 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.405418 (+ 67907us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.408591 (+ 3173us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.440780 (+ 32189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1663391}
I20260617 07:53:06.441553 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 1ffce17fe5c8405a94a93ad7dd67806e (table default.Table_bac89c3b70e94d8f84681a0043fa2ea8 [id=6b5d086b3d7c428b824a39387d817f14]) successfully deleted
I20260617 07:53:06.442128 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 252) took 1745 ms. Trace:
I20260617 07:53:06.442287 1178 tablet_bootstrap.cc:492] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:06.442286 1170 rpcz_store.cc:276] 0617 07:53:04.696264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.696320 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:06.441934 (+1745614us) ts_tablet_manager.cc:1151] Deleting tablet 0f9db8a986b344548e435b77edc14cb6
0617 07:53:06.441942 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.442087 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1720997}
I20260617 07:53:06.444259 1178 tablet_bootstrap.cc:654] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:06.444834 519 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 452f7d2bceb5447290370f72ec788608 because the tablet was not found. No further retry: Not found: Tablet not found: 452f7d2bceb5447290370f72ec788608
W20260617 07:53:06.445154 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0f9db8a986b344548e435b77edc14cb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f9db8a986b344548e435b77edc14cb6 already in progress: creating tablet
I20260617 07:53:06.447088 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 253) took 1744 ms. Trace:
I20260617 07:53:06.447222 1170 rpcz_store.cc:276] 0617 07:53:04.702473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.705860 (+ 3387us) service_pool.cc:224] Handling call
0617 07:53:06.446879 (+1741019us) ts_tablet_manager.cc:1151] Deleting tablet 0c21efcad98348ebabcee4821dc4682e
0617 07:53:06.446891 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.447049 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1720893}
W20260617 07:53:06.447693 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0c21efcad98348ebabcee4821dc4682e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c21efcad98348ebabcee4821dc4682e already in progress: creating tablet
I20260617 07:53:06.448010 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 254) took 1732 ms. Trace:
I20260617 07:53:06.448107 1170 rpcz_store.cc:276] 0617 07:53:04.715851 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.716006 (+ 155us) service_pool.cc:224] Handling call
0617 07:53:06.447903 (+1731897us) ts_tablet_manager.cc:1151] Deleting tablet a82e4d6c09bb4414ad7f3b760f7ae681
0617 07:53:06.447911 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.447984 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1721809}
W20260617 07:53:06.449278 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a82e4d6c09bb4414ad7f3b760f7ae681 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a82e4d6c09bb4414ad7f3b760f7ae681 already in progress: creating tablet
I20260617 07:53:06.449621 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 255) took 1732 ms. Trace:
I20260617 07:53:06.449759 1170 rpcz_store.cc:276] 0617 07:53:04.716740 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.717239 (+ 499us) service_pool.cc:224] Handling call
0617 07:53:06.449482 (+1732243us) ts_tablet_manager.cc:1151] Deleting tablet f2ce51c155c04897a4cf8f7b4ac9a5c6
0617 07:53:06.449490 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.449588 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1723299}
W20260617 07:53:06.450172 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 already in progress: creating tablet
I20260617 07:53:06.450361 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 262) took 1699 ms. Trace:
I20260617 07:53:06.450471 1170 rpcz_store.cc:276] 0617 07:53:04.751279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.751338 (+ 59us) service_pool.cc:224] Handling call
0617 07:53:06.450179 (+1698841us) ts_tablet_manager.cc:1151] Deleting tablet 6ddfb822b5af4bb6b664936c769d9625
0617 07:53:06.450188 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.450331 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1698609}
W20260617 07:53:06.450862 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 6ddfb822b5af4bb6b664936c769d9625 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ddfb822b5af4bb6b664936c769d9625 already in progress: creating tablet
I20260617 07:53:06.451107 1172 tablet_bootstrap.cc:492] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.451195 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 264) took 1635 ms. Trace:
I20260617 07:53:06.451293 1172 ts_tablet_manager.cc:1403] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.073s user 0.000s sys 0.003s
I20260617 07:53:06.452009 1172 raft_consensus.cc:359] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.452215 1172 raft_consensus.cc:385] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.452291 1172 raft_consensus.cc:740] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.452539 1172 consensus_queue.cc:260] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.458102 1172 ts_tablet_manager.cc:1434] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:06.458278 1170 rpcz_store.cc:276] 0617 07:53:04.816231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.816937 (+ 706us) service_pool.cc:224] Handling call
0617 07:53:06.451066 (+1634129us) ts_tablet_manager.cc:1151] Deleting tablet 5a547dabaeb742ba941690f4895955bd
0617 07:53:06.451074 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.451162 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1599110}
I20260617 07:53:06.458745 1172 tablet_bootstrap.cc:492] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.461103 1172 tablet_bootstrap.cc:654] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.460453 1175 ts_tablet_manager.cc:1929] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:06.464603 1175 log.cc:1199] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/2063248863ed46c196c93013230529fe
W20260617 07:53:06.464775 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5a547dabaeb742ba941690f4895955bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a547dabaeb742ba941690f4895955bd already in progress: creating tablet
I20260617 07:53:06.465164 1175 ts_tablet_manager.cc:1950] T 2063248863ed46c196c93013230529fe P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:06.466535 1171 tablet_bootstrap.cc:492] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:06.466753 1171 ts_tablet_manager.cc:1403] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.182s user 0.003s sys 0.007s
W20260617 07:53:06.469077 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9968c8179c14d1b9bc9a2c2779fb86e consensus state has no leader
I20260617 07:53:06.470330 1171 raft_consensus.cc:359] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.470547 1171 raft_consensus.cc:385] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.470659 1171 raft_consensus.cc:740] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.471118 1171 consensus_queue.cc:260] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.461342 1170 tablet_replica.cc:333] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:06.474777 1170 raft_consensus.cc:2243] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:06.475075 1171 ts_tablet_manager.cc:1434] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 07:53:06.475103 1170 raft_consensus.cc:2272] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.476506 1170 ts_tablet_manager.cc:1916] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.478279 1171 tablet_bootstrap.cc:492] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:06.481376 1171 tablet_bootstrap.cc:654] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.484104 751 tablet_service.cc:1511] Processing CreateTablet for tablet 3fcf87953dc14bf190ac74101547e52f (DEFAULT_TABLE table=default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.485423 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fcf87953dc14bf190ac74101547e52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.485858 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 60d1b4975077493eb6919b23d6523d3d (DEFAULT_TABLE table=default.Table_d199dae87e49454e8a74b84f1e0e28df [id=db2d3339eca0486bae7ce80d2f36323b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.486402 1017 tablet_service.cc:1511] Processing CreateTablet for tablet eba5976fcadd4add9c671300b431617b (DEFAULT_TABLE table=default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb [id=ee23302b46474cb096ae93bc49011eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.487062 530 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a882ae04eeb94276bb78ded81fbea708 (table default.Table_e57d7374905b4ff0b1e620e152b6d6c0 [id=b602ba9d92744e8bb82c4c57e9bfccab]). Expected version 5 got 0
I20260617 07:53:06.487178 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 3fcf87953dc14bf190ac74101547e52f (DEFAULT_TABLE table=default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.487257 530 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 5203534569bd4da18bc06751f094735f (table default.Table_9e10117b19d649668289e1ad8374ff7d [id=77f9a3f7e2e441b888caf756936d7ee5]). Expected version 3 got 0
I20260617 07:53:06.484977 752 tablet_service.cc:1511] Processing CreateTablet for tablet eba5976fcadd4add9c671300b431617b (DEFAULT_TABLE table=default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb [id=ee23302b46474cb096ae93bc49011eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.488093 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba5976fcadd4add9c671300b431617b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.488659 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 (DEFAULT_TABLE table=default.Table_29487528287c44c0bdddf8d719e80f08 [id=94a23a9e1e434285acc94bced26578f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.489467 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d1b4975077493eb6919b23d6523d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.492914 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba5976fcadd4add9c671300b431617b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.497254 1023 tablet_service.cc:1511] Processing CreateTablet for tablet a6f90a0d37cb483faa540451bf4dbe85 (DEFAULT_TABLE table=default.Table_135d8e6c7f9a41ef809b7e98a6e02c97 [id=3d306a3bde784759bd8e3a45fa8cddec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.497673 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f90a0d37cb483faa540451bf4dbe85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.501791 1024 tablet_service.cc:1511] Processing CreateTablet for tablet c019792d23484fb789378bf377547415 (DEFAULT_TABLE table=default.Table_e2dd4c72e519463587685ed8940d442e [id=b20987ff1f1c43098b1408b126b32913]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.502166 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c019792d23484fb789378bf377547415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.503787 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5b5a4062a59c4b3f811cc1d4441fd030" } modify_external_catalogs: true
I20260617 07:53:06.504052 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5b5a4062a59c4b3f811cc1d4441fd030" } modify_external_catalogs: true
I20260617 07:53:06.505801 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_0a73e0c5eead4482b2f6747fec27846f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.506477 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a73e0c5eead4482b2f6747fec27846f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.507318 889 tablet_service.cc:1511] Processing CreateTablet for tablet 24066965db7141a6a970ec08f835a820 (DEFAULT_TABLE table=default.Table_bd0db0a6290342548196f468ee98943f [id=8193bedf37784197bebc39d711a8eb2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.507393 893 tablet_service.cc:1511] Processing CreateTablet for tablet c019792d23484fb789378bf377547415 (DEFAULT_TABLE table=default.Table_e2dd4c72e519463587685ed8940d442e [id=b20987ff1f1c43098b1408b126b32913]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.507753 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24066965db7141a6a970ec08f835a820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.507988 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c019792d23484fb789378bf377547415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.508277 891 tablet_service.cc:1511] Processing CreateTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 (DEFAULT_TABLE table=default.Table_da5430a09e3e44e48bafd3678bf638a2 [id=27e37deb26df4bb28507736f1decf709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.508613 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de8df5e15cb43c0b95ec5af3110db66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.512296 892 tablet_service.cc:1511] Processing CreateTablet for tablet 60d1b4975077493eb6919b23d6523d3d (DEFAULT_TABLE table=default.Table_d199dae87e49454e8a74b84f1e0e28df [id=db2d3339eca0486bae7ce80d2f36323b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.513214 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d1b4975077493eb6919b23d6523d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.513749 894 tablet_service.cc:1511] Processing CreateTablet for tablet a6f90a0d37cb483faa540451bf4dbe85 (DEFAULT_TABLE table=default.Table_135d8e6c7f9a41ef809b7e98a6e02c97 [id=3d306a3bde784759bd8e3a45fa8cddec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.515475 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fcf87953dc14bf190ac74101547e52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.516916 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f7c3f6260c4db690de1a5081bb2493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.519232 749 tablet_service.cc:1511] Processing CreateTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 (DEFAULT_TABLE table=default.Table_29487528287c44c0bdddf8d719e80f08 [id=94a23a9e1e434285acc94bced26578f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.520000 759 tablet_service.cc:1511] Processing CreateTablet for tablet a6f90a0d37cb483faa540451bf4dbe85 (DEFAULT_TABLE table=default.Table_135d8e6c7f9a41ef809b7e98a6e02c97 [id=3d306a3bde784759bd8e3a45fa8cddec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.520452 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f90a0d37cb483faa540451bf4dbe85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.523010 753 tablet_service.cc:1511] Processing CreateTablet for tablet 24066965db7141a6a970ec08f835a820 (DEFAULT_TABLE table=default.Table_bd0db0a6290342548196f468ee98943f [id=8193bedf37784197bebc39d711a8eb2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.523273 760 tablet_service.cc:1511] Processing CreateTablet for tablet 60d1b4975077493eb6919b23d6523d3d (DEFAULT_TABLE table=default.Table_d199dae87e49454e8a74b84f1e0e28df [id=db2d3339eca0486bae7ce80d2f36323b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.523828 758 tablet_service.cc:1511] Processing CreateTablet for tablet c019792d23484fb789378bf377547415 (DEFAULT_TABLE table=default.Table_e2dd4c72e519463587685ed8940d442e [id=b20987ff1f1c43098b1408b126b32913]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.524097 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f7c3f6260c4db690de1a5081bb2493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.524621 755 tablet_service.cc:1511] Processing CreateTablet for tablet 2735f7dd40e54aec9004b9b38702607c (DEFAULT_TABLE table=default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.524665 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e0f2f9a75d4f9ba8702e4da75c042f with delete_type TABLET_DATA_DELETED (replaced by tablet 56c70f5c41e04ad0b913c15aa315353f) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.524930 754 tablet_service.cc:1511] Processing CreateTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 (DEFAULT_TABLE table=default.Table_da5430a09e3e44e48bafd3678bf638a2 [id=27e37deb26df4bb28507736f1decf709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.527182 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24066965db7141a6a970ec08f835a820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.527209 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 (DEFAULT_TABLE table=default.Table_da5430a09e3e44e48bafd3678bf638a2 [id=27e37deb26df4bb28507736f1decf709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.527427 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 24066965db7141a6a970ec08f835a820 (DEFAULT_TABLE table=default.Table_bd0db0a6290342548196f468ee98943f [id=8193bedf37784197bebc39d711a8eb2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.527612 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de8df5e15cb43c0b95ec5af3110db66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.527917 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24066965db7141a6a970ec08f835a820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.527995 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2735f7dd40e54aec9004b9b38702607c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.528147 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 2735f7dd40e54aec9004b9b38702607c (DEFAULT_TABLE table=default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.528530 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2735f7dd40e54aec9004b9b38702607c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.528623 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de8df5e15cb43c0b95ec5af3110db66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.529201 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c019792d23484fb789378bf377547415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.528237 757 tablet_service.cc:1511] Processing CreateTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 (DEFAULT_TABLE table=default.Table_0b705f18dfe34487821e76d515b4a2be [id=d3c16f845bc84f5f916ae4a5cf3e8254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.530074 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d1b4975077493eb6919b23d6523d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.530274 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bf5384ec244d36ba3d4e781c5eb8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.532661 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 9d94915d96694d6f9a86063640e5fe18 (DEFAULT_TABLE table=default.Table_599c014ad57e446a951f4d7cfc3a09b3 [id=885235c3332d4c4c9f62503732d3a38e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.533025 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d94915d96694d6f9a86063640e5fe18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.534278 1400 raft_consensus.cc:493] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.534399 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf4025a0f784cc6868950e51a45da2e (DEFAULT_TABLE table=default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.534443 1400 raft_consensus.cc:515] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.534751 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf4025a0f784cc6868950e51a45da2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.535218 1400 leader_election.cc:290] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.533175 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9d94915d96694d6f9a86063640e5fe18 (DEFAULT_TABLE table=default.Table_599c014ad57e446a951f4d7cfc3a09b3 [id=885235c3332d4c4c9f62503732d3a38e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.537251 748 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf4025a0f784cc6868950e51a45da2e (DEFAULT_TABLE table=default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.538300 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5203534569bd4da18bc06751f094735f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:06.540169 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf4025a0f784cc6868950e51a45da2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.541566 526 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: default.Table_ac940c0f5a9d49babeff827981e9d7d3 [id=829b5684836747b2aa4265ac17eccd80] alter complete (version 1)
I20260617 07:53:06.541780 750 tablet_service.cc:1511] Processing CreateTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e (DEFAULT_TABLE table=default.Table_5346310486bb4b0ea18fdc5d30e84379 [id=7543297cccfb4a3d90a50fe63ba0742f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.542536 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d94915d96694d6f9a86063640e5fe18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.542766 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f0f68dcef34228a1b2a018e8aa329e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:06.549113 986 leader_election.cc:343] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.549201 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 0cfb98aecc4546c88371436fcfbf8e86
I20260617 07:53:06.549922 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 6d8f144d04af4ea18f99aee3b82f4a28
I20260617 07:53:06.552197 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet d80c2ffcf1b84df0bc6a468ea0929e80
I20260617 07:53:06.554757 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_378c24318c924a5e8dcfb5295dc43493" } modify_external_catalogs: true
I20260617 07:53:06.555018 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_378c24318c924a5e8dcfb5295dc43493" } modify_external_catalogs: true
I20260617 07:53:06.557034 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_0ed7b7e3b00f4ef7bc09698697e20931"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.557657 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ed7b7e3b00f4ef7bc09698697e20931 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.559381 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_8fd650978f1f476f81cdd48faa9f9b0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.559958 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fd650978f1f476f81cdd48faa9f9b0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.563095 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_bd56bbbe6c6146e0aed7c57090a64d9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.563665 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd56bbbe6c6146e0aed7c57090a64d9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.566162 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.563652 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 (DEFAULT_TABLE table=default.Table_0b705f18dfe34487821e76d515b4a2be [id=d3c16f845bc84f5f916ae4a5cf3e8254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.577229 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
I20260617 07:53:06.598275 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.598516 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 296) took 1027 ms. Trace:
I20260617 07:53:06.598625 1175 rpcz_store.cc:276] 0617 07:53:05.541531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.541579 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:06.413402 (+871823us) ts_tablet_manager.cc:1151] Deleting tablet 2063248863ed46c196c93013230529fe
0617 07:53:06.413410 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.419334 (+ 5924us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.460364 (+ 41030us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.569183 (+108819us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83112,"tablet-delete.queue_time_us":871632}
I20260617 07:53:06.604903 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.606949 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 (DEFAULT_TABLE table=default.Table_119ecdf0aa5343da9cee836dd150a21a [id=ec04f28d4a6e4fa18078aacb6b6f0bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.607380 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e (DEFAULT_TABLE table=default.Table_5346310486bb4b0ea18fdc5d30e84379 [id=7543297cccfb4a3d90a50fe63ba0742f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.607642 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca402543247461aa5384abb65fff364 (DEFAULT_TABLE table=default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.608186 1018 tablet_service.cc:1511] Processing CreateTablet for tablet eb75a965740344c2bd0b68a8dda28be5 (DEFAULT_TABLE table=default.Table_a97317a462514e6384cb34f5fa00851f [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.610172 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a97317a462514e6384cb34f5fa00851f" } new_table_name: "default.Table_a50118b40547426eaf2f40d1b0cfb2e1" modify_external_catalogs: true
I20260617 07:53:06.611599 745 tablet_service.cc:1558] Processing DeleteTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.611621 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5346310486bb4b0ea18fdc5d30e84379" } new_table_name: "default.Table_4b11386c9de448719673afea74a4e6a0" modify_external_catalogs: true
I20260617 07:53:06.611995 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.612227 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e01c4bf739194d638e2a3988702d4cfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.612865 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e01c4bf739194d638e2a3988702d4cfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.611563 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.618053 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bf5384ec244d36ba3d4e781c5eb8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.618356 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f0f68dcef34228a1b2a018e8aa329e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.619195 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8f144d04af4ea18f99aee3b82f4a28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:06.619524 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb75a965740344c2bd0b68a8dda28be5 consensus state has no leader
I20260617 07:53:06.620029 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.621886 744 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca402543247461aa5384abb65fff364 (DEFAULT_TABLE table=default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.623065 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.624630 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 2063248863ed46c196c93013230529fe (table default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]) successfully deleted
W20260617 07:53:06.624927 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 28e1fd7f91f94221884be2166f0cc793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28e1fd7f91f94221884be2166f0cc793 already in progress: creating tablet
I20260617 07:53:06.624841 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_f4f0f22885f3419fac4d346d06c53b8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:06.625146 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca402543247461aa5384abb65fff364. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:06.625154 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet de030009192748118b388eec555d90da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de030009192748118b388eec555d90da already in progress: creating tablet
W20260617 07:53:06.625385 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df705c2300064db680bec1fefab08d2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df705c2300064db680bec1fefab08d2f already in progress: creating tablet
W20260617 07:53:06.625416 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4f0f22885f3419fac4d346d06c53b8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:06.625655 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df4f9101deaa4e6ebddacbce14f32810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df4f9101deaa4e6ebddacbce14f32810 already in progress: creating tablet
I20260617 07:53:06.625898 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_57c2f7c15baa4d8c84ed9e5f7e07264d" } new_table_name: "default.Table_25ce7515adee4a9bb9f50098d1fb2050" modify_external_catalogs: true
I20260617 07:53:06.627434 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_94b6f54366a140ccad0120180ad1ed11" } new_table_name: "default.Table_c99ee356fa09454c8761e05cdd2b4295" modify_external_catalogs: true
I20260617 07:53:06.627461 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e57d7374905b4ff0b1e620e152b6d6c0" } modify_external_catalogs: true
I20260617 07:53:06.627640 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e57d7374905b4ff0b1e620e152b6d6c0" } modify_external_catalogs: true
I20260617 07:53:06.628737 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_fceae19017b24062acf8baff4d043ec9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.629303 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fceae19017b24062acf8baff4d043ec9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.630308 1175 tablet_replica.cc:333] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:06.633044 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb75a965740344c2bd0b68a8dda28be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.637840 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 (DEFAULT_TABLE table=default.Table_119ecdf0aa5343da9cee836dd150a21a [id=ec04f28d4a6e4fa18078aacb6b6f0bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.638317 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8f144d04af4ea18f99aee3b82f4a28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:06.640033 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49f0f68dcef34228a1b2a018e8aa329e consensus state has no leader
I20260617 07:53:06.645310 1170 ts_tablet_manager.cc:1929] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:06.645686 1170 log.cc:1199] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/f9e253dca6904dfb914ed4be554da4b5
I20260617 07:53:06.646912 1170 ts_tablet_manager.cc:1950] T f9e253dca6904dfb914ed4be554da4b5 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:06.647984 1400 raft_consensus.cc:493] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.648156 1400 raft_consensus.cc:515] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.648942 1400 leader_election.cc:290] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:06.650476 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa23bb0929440b1820afdce4b9e8d8c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:06.651158 986 leader_election.cc:343] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.655615 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca402543247461aa5384abb65fff364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.657061 1172 tablet_bootstrap.cc:492] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.657223 1172 ts_tablet_manager.cc:1403] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.199s user 0.015s sys 0.025s
I20260617 07:53:06.657491 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_665c19b8c9d14ccc9f5beb633b690e13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:06.658108 1172 raft_consensus.cc:359] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.658160 1169 tablet_replica.cc:333] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:06.658195 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_665c19b8c9d14ccc9f5beb633b690e13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.658267 1172 raft_consensus.cc:385] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.658368 1172 raft_consensus.cc:740] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.658619 1172 consensus_queue.cc:260] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.659224 1172 ts_tablet_manager.cc:1434] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:06.659710 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_aedfbb83a89a41f3baded7b851c5f75b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:06.660121 1172 tablet_bootstrap.cc:492] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.662034 1172 tablet_bootstrap.cc:654] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.648023 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 263) took 1869 ms. Trace:
I20260617 07:53:06.666352 1170 rpcz_store.cc:276] 0617 07:53:04.778234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:04.817771 (+ 39537us) service_pool.cc:224] Handling call
0617 07:53:06.461269 (+1643498us) ts_tablet_manager.cc:1151] Deleting tablet f9e253dca6904dfb914ed4be554da4b5
0617 07:53:06.461279 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.515386 (+ 54107us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.645132 (+129746us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.647961 (+ 2829us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1538581}
I20260617 07:53:06.670255 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet f9e253dca6904dfb914ed4be554da4b5 (table default.Table_9bae350dffe04a48933fbb60e3f26699 [id=d455eadd7e304b7bbb55ccff97befb5c]) successfully deleted
I20260617 07:53:06.670904 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 278) took 1642 ms. Trace:
W20260617 07:53:06.671240 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aedfbb83a89a41f3baded7b851c5f75b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.671329 1598 raft_consensus.cc:493] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.671535 1598 raft_consensus.cc:515] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.672400 1598 leader_election.cc:290] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:06.672581 1598 raft_consensus.cc:493] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.672746 1598 raft_consensus.cc:515] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:06.672730 1170 rpcz_store.cc:276] 0617 07:53:05.028694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.028752 (+ 58us) service_pool.cc:224] Handling call
0617 07:53:06.670730 (+1641978us) ts_tablet_manager.cc:1151] Deleting tablet 59acdc64fe9247d28c4c277161b42f4f
0617 07:53:06.670740 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.670850 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1633858}
I20260617 07:53:06.673350 1598 leader_election.cc:290] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:06.673561 777 raft_consensus.cc:3060] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:06.673599 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 59acdc64fe9247d28c4c277161b42f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59acdc64fe9247d28c4c277161b42f4f already in progress: creating tablet
I20260617 07:53:06.674188 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 283) took 1549 ms. Trace:
I20260617 07:53:06.674216 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ecf80e090494539ae3d20448f8d1126" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:06.674964 1170 rpcz_store.cc:276] 0617 07:53:05.124597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.138624 (+ 14027us) service_pool.cc:224] Handling call
0617 07:53:06.674028 (+1535404us) ts_tablet_manager.cc:1151] Deleting tablet 076c6f6f406842ceb3db75e886e3ce50
0617 07:53:06.674038 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.674133 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1535117}
I20260617 07:53:06.675175 748 tablet_service.cc:1511] Processing CreateTablet for tablet eb75a965740344c2bd0b68a8dda28be5 (DEFAULT_TABLE table=default.Table_a97317a462514e6384cb34f5fa00851f [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.675637 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb75a965740344c2bd0b68a8dda28be5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:06.677610 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4681e8e3f1174b299d89ec541ca8e6b3 has no consensus state
I20260617 07:53:06.679056 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb71e5f65cd4b9e8dbe5ddf44e70340" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:06.679177 516 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 076c6f6f406842ceb3db75e886e3ce50 because the tablet was not found. No further retry: Not found: Tablet not found: 076c6f6f406842ceb3db75e886e3ce50
I20260617 07:53:06.679704 1170 tablet_replica.cc:333] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:06.679940 1170 raft_consensus.cc:2243] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:06.680356 1170 raft_consensus.cc:2272] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.678534 1172 tablet_bootstrap.cc:492] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.680667 1172 ts_tablet_manager.cc:1403] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260617 07:53:06.681583 1172 raft_consensus.cc:359] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.681849 1172 raft_consensus.cc:385] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.681968 1172 raft_consensus.cc:740] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.682240 1172 consensus_queue.cc:260] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.683377 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_66c2a830c5a94c0c9f70f12f18100bd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:06.683898 1172 ts_tablet_manager.cc:1434] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260617 07:53:06.683924 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66c2a830c5a94c0c9f70f12f18100bd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.684285 1172 tablet_bootstrap.cc:492] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.686035 1172 tablet_bootstrap.cc:654] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:06.686946 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fd8cedb539748dc917128511325bbcc consensus state has no leader
I20260617 07:53:06.692209 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 7392ca4ba6a140e19c57e962a26162af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.692384 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 4996cde4d1514aa081257c802339abe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.693332 1170 ts_tablet_manager.cc:1916] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.695557 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b365fa4f3a0147ef9b28a320dab6f49f" } new_table_name: "default.Table_39e76c41c1f84fd1ab2024365c1cd5a1" modify_external_catalogs: true
I20260617 07:53:06.700078 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a882ae04eeb94276bb78ded81fbea708
I20260617 07:53:06.701594 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet a882ae04eeb94276bb78ded81fbea708 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.709497 1172 tablet_bootstrap.cc:492] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.709757 1172 ts_tablet_manager.cc:1403] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260617 07:53:06.710690 1172 raft_consensus.cc:359] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.710963 1172 raft_consensus.cc:385] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.711110 1172 raft_consensus.cc:740] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.711393 1172 consensus_queue.cc:260] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.712038 1172 ts_tablet_manager.cc:1434] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:06.712391 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f90a0d37cb483faa540451bf4dbe85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.718000 1172 tablet_bootstrap.cc:492] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:06.717213 777 raft_consensus.cc:1579] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Could not prepare op 'term: 1 index: 2' and following 0 ops. Status for this op: Illegal state: STOPPING
I20260617 07:53:06.719924 1172 tablet_bootstrap.cc:654] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.722302 1170 ts_tablet_manager.cc:1929] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:06.722518 1170 log.cc:1199] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a5b7b95327604ef8b43944c4821d4ed7
I20260617 07:53:06.722996 1170 ts_tablet_manager.cc:1950] T a5b7b95327604ef8b43944c4821d4ed7 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:06.723850 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 285) took 1464 ms. Trace:
I20260617 07:53:06.724020 1170 rpcz_store.cc:276] 0617 07:53:05.259605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.259668 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:06.679616 (+1419948us) ts_tablet_manager.cc:1151] Deleting tablet a5b7b95327604ef8b43944c4821d4ed7
0617 07:53:06.679626 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.697256 (+ 17630us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.722209 (+ 24953us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.723817 (+ 1608us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1419706}
I20260617 07:53:06.724628 1170 tablet_replica.cc:333] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:06.724905 1170 raft_consensus.cc:2243] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:06.725200 1170 pending_rounds.cc:70] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:06.725342 1170 pending_rounds.cc:77] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772691161055232 op_type: NO_OP noop_request { }
I20260617 07:53:06.725546 1170 raft_consensus.cc:2889] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:06.725680 1178 tablet_bootstrap.cc:492] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:06.726270 1170 raft_consensus.cc:2272] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.726445 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a5b7b95327604ef8b43944c4821d4ed7 (table default.Table_5fcf50bba845478aa1765c2ac162b1c1 [id=0d961292ee114171bd682606f6df393d]) successfully deleted
I20260617 07:53:06.726980 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.727128 753 tablet_service.cc:1558] Processing DeleteTablet for tablet a882ae04eeb94276bb78ded81fbea708 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.727680 1170 ts_tablet_manager.cc:1916] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.730371 1178 ts_tablet_manager.cc:1403] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.284s user 0.000s sys 0.006s
I20260617 07:53:06.732950 1178 raft_consensus.cc:359] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.733289 1178 raft_consensus.cc:385] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.733654 1178 raft_consensus.cc:740] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.734275 1178 consensus_queue.cc:260] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.738534 1172 tablet_bootstrap.cc:492] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.738711 1172 ts_tablet_manager.cc:1403] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20260617 07:53:06.739545 1172 raft_consensus.cc:359] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.739742 1172 raft_consensus.cc:385] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.739815 1172 raft_consensus.cc:740] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.740037 1172 consensus_queue.cc:260] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.740600 1172 ts_tablet_manager.cc:1434] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:06.740940 1172 tablet_bootstrap.cc:492] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.742722 1172 tablet_bootstrap.cc:654] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.745842 890 tablet_service.cc:1511] Processing CreateTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 (DEFAULT_TABLE table=default.Table_29487528287c44c0bdddf8d719e80f08 [id=94a23a9e1e434285acc94bced26578f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.746759 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.747332 1178 ts_tablet_manager.cc:1434] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260617 07:53:06.747632 1178 tablet_bootstrap.cc:492] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:06.747812 1341 raft_consensus.cc:493] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.750526 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2735f7dd40e54aec9004b9b38702607c (DEFAULT_TABLE table=default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.753801 1172 tablet_bootstrap.cc:492] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.753970 1172 ts_tablet_manager.cc:1403] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.001s
I20260617 07:53:06.755101 1172 raft_consensus.cc:359] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.755288 1172 raft_consensus.cc:385] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.755430 1172 raft_consensus.cc:740] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.755643 1172 consensus_queue.cc:260] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.756193 1172 ts_tablet_manager.cc:1434] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:06.756510 1172 tablet_bootstrap.cc:492] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.756708 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5203534569bd4da18bc06751f094735f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:06.757100 887 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf4025a0f784cc6868950e51a45da2e (DEFAULT_TABLE table=default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.757138 896 tablet_service.cc:1511] Processing CreateTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 (DEFAULT_TABLE table=default.Table_0b705f18dfe34487821e76d515b4a2be [id=d3c16f845bc84f5f916ae4a5cf3e8254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.757398 898 tablet_service.cc:1511] Processing CreateTablet for tablet 3fcf87953dc14bf190ac74101547e52f (DEFAULT_TABLE table=default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.761504 1178 tablet_bootstrap.cc:654] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.762804 1170 ts_tablet_manager.cc:1929] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:06.762935 1170 log.cc:1199] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5b99b80966c94937baf7172b0c36af2a
I20260617 07:53:06.763439 1170 ts_tablet_manager.cc:1950] T 5b99b80966c94937baf7172b0c36af2a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:06.764225 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 284) took 1505 ms. Trace:
I20260617 07:53:06.765964 1172 tablet_bootstrap.cc:654] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.765851 895 tablet_service.cc:1511] Processing CreateTablet for tablet eba5976fcadd4add9c671300b431617b (DEFAULT_TABLE table=default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb [id=ee23302b46474cb096ae93bc49011eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.767835 1175 raft_consensus.cc:2243] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:06.768268 1175 raft_consensus.cc:2272] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.764364 1170 rpcz_store.cc:276] 0617 07:53:05.259152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.265641 (+ 6489us) service_pool.cc:224] Handling call
0617 07:53:06.724547 (+1458906us) ts_tablet_manager.cc:1151] Deleting tablet 5b99b80966c94937baf7172b0c36af2a
0617 07:53:06.724556 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.737677 (+ 13121us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.762715 (+ 25038us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.764184 (+ 1469us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1458619}
I20260617 07:53:06.768723 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.768102 888 tablet_service.cc:1511] Processing CreateTablet for tablet 9d94915d96694d6f9a86063640e5fe18 (DEFAULT_TABLE table=default.Table_599c014ad57e446a951f4d7cfc3a09b3 [id=885235c3332d4c4c9f62503732d3a38e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.768728 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 296) took 1435 ms. Trace:
I20260617 07:53:06.770082 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 5b99b80966c94937baf7172b0c36af2a (table default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]) successfully deleted
I20260617 07:53:06.770233 1170 rpcz_store.cc:276] 0617 07:53:05.332963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.333036 (+ 73us) service_pool.cc:224] Handling call
0617 07:53:06.768588 (+1435552us) ts_tablet_manager.cc:1151] Deleting tablet 92e55be5f28740fba65c1199a571d97a
0617 07:53:06.768598 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.768696 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1435305}
W20260617 07:53:06.770845 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92e55be5f28740fba65c1199a571d97a already in progress: creating tablet
I20260617 07:53:06.770931 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 295) took 1438 ms. Trace:
I20260617 07:53:06.771246 1170 rpcz_store.cc:276] 0617 07:53:05.332811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.376411 (+ 43600us) service_pool.cc:224] Handling call
0617 07:53:06.770653 (+1394242us) ts_tablet_manager.cc:1151] Deleting tablet 66140c5d364f453a8089f143cc96ede8
0617 07:53:06.770664 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.770874 (+ 210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1393991}
W20260617 07:53:06.772225 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66140c5d364f453a8089f143cc96ede8 already in progress: creating tablet
I20260617 07:53:06.772954 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 294) took 1442 ms. Trace:
I20260617 07:53:06.773483 1170 rpcz_store.cc:276] 0617 07:53:05.329955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.377398 (+ 47443us) service_pool.cc:224] Handling call
0617 07:53:06.772228 (+1394830us) ts_tablet_manager.cc:1151] Deleting tablet 3ae9261c0ac94defaecfc7d14ba1ae61
0617 07:53:06.772340 (+ 112us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.772822 (+ 482us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1394632}
W20260617 07:53:06.774425 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae9261c0ac94defaecfc7d14ba1ae61 already in progress: creating tablet
W20260617 07:53:06.774876 986 consensus_peers.cc:597] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:06.774955 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 297) took 1374 ms. Trace:
I20260617 07:53:06.775435 1170 rpcz_store.cc:276] 0617 07:53:05.400673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.400726 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:06.774448 (+1373722us) ts_tablet_manager.cc:1151] Deleting tablet 0ebafc920ed34216be5fb115f9bc6f7f
0617 07:53:06.774459 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.774820 (+ 361us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1373392}
W20260617 07:53:06.776383 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0ebafc920ed34216be5fb115f9bc6f7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ebafc920ed34216be5fb115f9bc6f7f already in progress: creating tablet
W20260617 07:53:06.776501 716 leader_election.cc:343] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: ddb71e5f65cd4b9e8dbe5ddf44e70340
I20260617 07:53:06.776672 716 leader_election.cc:304] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:06.777267 1623 raft_consensus.cc:2749] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.777182 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 298) took 1376 ms. Trace:
I20260617 07:53:06.777525 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.777908 1170 rpcz_store.cc:276] 0617 07:53:05.400814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.400987 (+ 173us) service_pool.cc:224] Handling call
0617 07:53:06.776393 (+1375406us) ts_tablet_manager.cc:1151] Deleting tablet cb95639e16ed423fbe60b15a1bcdf5a6
0617 07:53:06.776515 (+ 122us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.777045 (+ 530us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1375236}
I20260617 07:53:06.779752 1170 tablet_replica.cc:333] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:06.779953 1175 ts_tablet_manager.cc:1916] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.780928 1170 raft_consensus.cc:2243] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:06.782586 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet cb95639e16ed423fbe60b15a1bcdf5a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb95639e16ed423fbe60b15a1bcdf5a6 already in progress: creating tablet
I20260617 07:53:06.782613 1170 raft_consensus.cc:2272] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.783829 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa23bb0929440b1820afdce4b9e8d8c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:06.786419 1170 ts_tablet_manager.cc:1916] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.787299 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b12221b517d346f3adec5874b70f1eb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.787964 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b12221b517d346f3adec5874b70f1eb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.790166 886 tablet_service.cc:1511] Processing CreateTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e (DEFAULT_TABLE table=default.Table_5346310486bb4b0ea18fdc5d30e84379 [id=7543297cccfb4a3d90a50fe63ba0742f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:06.790760 988 leader_election.cc:343] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.790920 988 leader_election.cc:304] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:06.791551 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.791816 1272 raft_consensus.cc:2749] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.795217 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9e163236fd4f4a23b074e860f9688936" } modify_external_catalogs: true
I20260617 07:53:06.795428 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9e163236fd4f4a23b074e860f9688936" } modify_external_catalogs: true
I20260617 07:53:06.795998 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9e10117b19d649668289e1ad8374ff7d" } modify_external_catalogs: true
I20260617 07:53:06.796136 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_9e10117b19d649668289e1ad8374ff7d" } modify_external_catalogs: true
I20260617 07:53:06.797209 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_47a904a2ae6045519235b5988330eeff" } modify_external_catalogs: true
I20260617 07:53:06.797400 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_47a904a2ae6045519235b5988330eeff" } modify_external_catalogs: true
I20260617 07:53:06.799124 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ecf80e090494539ae3d20448f8d1126" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:06.799609 1341 raft_consensus.cc:515] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.800305 1623 raft_consensus.cc:493] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.800807 1170 ts_tablet_manager.cc:1929] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:06.800971 1170 log.cc:1199] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/f345910256784d2085cb81473534dcaf
I20260617 07:53:06.801395 1170 ts_tablet_manager.cc:1950] T f345910256784d2085cb81473534dcaf P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:06.801148 1623 raft_consensus.cc:515] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.810303 716 leader_election.cc:304] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:06.810806 1598 raft_consensus.cc:2749] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:06.812383 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f7c3f6260c4db690de1a5081bb2493. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:06.813087 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee5ddac997834e97a2d6c9b1855ee4e8 consensus state has no leader
I20260617 07:53:06.814164 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.814646 1169 raft_consensus.cc:2243] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:06.815163 1341 leader_election.cc:290] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.817024 1175 ts_tablet_manager.cc:1929] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:06.817179 1175 log.cc:1199] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/452f7d2bceb5447290370f72ec788608
I20260617 07:53:06.817750 1175 ts_tablet_manager.cc:1950] T 452f7d2bceb5447290370f72ec788608 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:06.818907 1175 tablet_replica.cc:333] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:06.805310 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d9ed003c64b1abed6bd3bb14456cd" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:06.819214 1175 raft_consensus.cc:2243] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:06.819388 1175 raft_consensus.cc:2272] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.819396 1052 raft_consensus.cc:2468] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:06.809834 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f8525046964950884b0f9aa515ec81" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:06.810035 1272 raft_consensus.cc:493] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.816179 1364 raft_consensus.cc:493] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.819761 1050 raft_consensus.cc:2468] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:06.819859 1364 raft_consensus.cc:515] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.820566 1364 leader_election.cc:290] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.819763 1272 raft_consensus.cc:515] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.821130 713 leader_election.cc:304] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:06.821516 1598 raft_consensus.cc:2804] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:06.821699 1272 leader_election.cc:290] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.821691 1598 raft_consensus.cc:493] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:06.821882 1598 raft_consensus.cc:3060] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:06.822546 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc0676db18c42259efb1ad7dbd140c8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:06.822959 716 leader_election.cc:343] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 4d9d9ed003c64b1abed6bd3bb14456cd
W20260617 07:53:06.824052 986 leader_election.cc:343] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.824278 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 299) took 1423 ms. Trace:
I20260617 07:53:06.824433 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7392ca4ba6a140e19c57e962a26162af" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:06.825191 1598 raft_consensus.cc:515] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.826588 1598 leader_election.cc:290] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:06.826967 777 raft_consensus.cc:3060] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:06.825012 986 leader_election.cc:343] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.825628 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6264adc3994c22864ea73106ba2320 (DEFAULT_TABLE table=default.Table_0ed7b7e3b00f4ef7bc09698697e20931 [id=ddf79f1c39544fabb0b412114c2f0e21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.828495 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6264adc3994c22864ea73106ba2320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.829455 1366 raft_consensus.cc:493] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.829618 1366 raft_consensus.cc:515] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.830297 918 raft_consensus.cc:2468] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:06.832980 1175 ts_tablet_manager.cc:1916] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.833803 879 tablet_service.cc:1558] Processing DeleteTablet for tablet a882ae04eeb94276bb78ded81fbea708 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.833922 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9d9ed003c64b1abed6bd3bb14456cd" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:06.834010 883 tablet_service.cc:1558] Processing DeleteTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:06.834110 1050 raft_consensus.cc:3060] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:06.834391 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
I20260617 07:53:06.834740 1341 raft_consensus.cc:493] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.834892 1341 raft_consensus.cc:515] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:06.835435 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.836748 1050 raft_consensus.cc:2468] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:06.826880 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 596ef68705c84791b54f07e03b219b4c (DEFAULT_TABLE table=default.Table_0a73e0c5eead4482b2f6747fec27846f [id=3cda30618acd40f08728b0ccb01bb973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.837297 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596ef68705c84791b54f07e03b219b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.840553 1175 ts_tablet_manager.cc:1929] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:06.840692 1175 log.cc:1199] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/262a34e120f34689ba0b598d7a2999fd
I20260617 07:53:06.841073 1175 ts_tablet_manager.cc:1950] T 262a34e120f34689ba0b598d7a2999fd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:06.842150 713 leader_election.cc:304] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:06.842459 1598 raft_consensus.cc:2804] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:06.845937 1170 rpcz_store.cc:276] 0617 07:53:05.400959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.401207 (+ 248us) service_pool.cc:224] Handling call
0617 07:53:06.779354 (+1378147us) ts_tablet_manager.cc:1151] Deleting tablet f345910256784d2085cb81473534dcaf
0617 07:53:06.779485 (+ 131us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.797525 (+ 18040us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.800726 (+ 3201us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.824221 (+ 23495us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1377853}
I20260617 07:53:06.846307 778 raft_consensus.cc:3060] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:06.846486 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet f345910256784d2085cb81473534dcaf (table default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]) successfully deleted
I20260617 07:53:06.847179 1170 tablet_replica.cc:333] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:06.847529 1170 raft_consensus.cc:2243] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:06.847865 1170 pending_rounds.cc:70] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:06.847944 1170 pending_rounds.cc:77] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772689921462272 op_type: NO_OP noop_request { }
I20260617 07:53:06.848109 1170 raft_consensus.cc:2889] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:06.848232 1170 raft_consensus.cc:2272] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.848958 1170 ts_tablet_manager.cc:1916] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.852931 1169 pending_rounds.cc:70] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:06.852856 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 18f9bace06e34602acc7fcd7501b3671 (DEFAULT_TABLE table=default.Table_494d237d1c1a4ab8b4939b39873d9793 [id=ac5919d00ecb484db9c6428a472f080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.855664 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f9bace06e34602acc7fcd7501b3671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.858739 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 68b448c65e684f49bf142ce2b5084d33 (DEFAULT_TABLE table=default.Table_d3c466258c0b40f09368d392be11d6dc [id=eb9a1f29372d468bb9449eb1b84c87ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.859283 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b448c65e684f49bf142ce2b5084d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.864951 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 5203534569bd4da18bc06751f094735f
I20260617 07:53:06.866025 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 5203534569bd4da18bc06751f094735f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.866619 1272 raft_consensus.cc:493] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.866791 1272 raft_consensus.cc:515] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.867568 1272 leader_election.cc:290] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.868091 1172 tablet_bootstrap.cc:492] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.868261 1172 ts_tablet_manager.cc:1403] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.112s user 0.003s sys 0.016s
I20260617 07:53:06.869063 1172 raft_consensus.cc:359] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.869282 1172 raft_consensus.cc:385] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.869379 1172 raft_consensus.cc:740] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.869654 1172 consensus_queue.cc:260] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.870196 1172 ts_tablet_manager.cc:1434] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:06.870529 1172 tablet_bootstrap.cc:492] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.872335 1172 tablet_bootstrap.cc:654] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.872627 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a882ae04eeb94276bb78ded81fbea708" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:06.873401 986 leader_election.cc:343] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.876914 1623 leader_election.cc:290] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:06.880874 1170 ts_tablet_manager.cc:1929] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:06.882742 1170 log.cc:1199] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/ddb71e5f65cd4b9e8dbe5ddf44e70340
I20260617 07:53:06.883304 1170 ts_tablet_manager.cc:1950] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:06.884366 1172 tablet_bootstrap.cc:492] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.884796 1172 ts_tablet_manager.cc:1403] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260617 07:53:06.885731 1172 raft_consensus.cc:359] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.886016 1172 raft_consensus.cc:385] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:06.886384 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8388648475499db50cc16a7c36775a with delete_type TABLET_DATA_DELETED (replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.886173 1172 raft_consensus.cc:740] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:06.886945 1172 consensus_queue.cc:260] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.887223 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 300) took 1483 ms. Trace:
I20260617 07:53:06.887334 1170 rpcz_store.cc:276] 0617 07:53:05.404131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.404185 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:06.847086 (+1442901us) ts_tablet_manager.cc:1151] Deleting tablet ddb71e5f65cd4b9e8dbe5ddf44e70340
0617 07:53:06.847094 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.864601 (+ 17507us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.880787 (+ 16186us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:06.887147 (+ 6360us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1442708}
I20260617 07:53:06.887667 1172 ts_tablet_manager.cc:1434] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:06.889362 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 (table default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]) successfully deleted
I20260617 07:53:06.889593 757 tablet_service.cc:1511] Processing CreateTablet for tablet 596ef68705c84791b54f07e03b219b4c (DEFAULT_TABLE table=default.Table_0a73e0c5eead4482b2f6747fec27846f [id=3cda30618acd40f08728b0ccb01bb973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.890108 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596ef68705c84791b54f07e03b219b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.890400 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 630e540a77374c11895ab5a0e394b3bb (DEFAULT_TABLE table=default.Table_3feac2a6e61848588a7739fe7f28171b [id=5000dc26300c4d94a567bd56e0d8599c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.891345 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 302) took 1416 ms. Trace:
I20260617 07:53:06.891441 1170 rpcz_store.cc:276] 0617 07:53:05.474418 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.503491 (+ 29073us) service_pool.cc:224] Handling call
0617 07:53:06.887627 (+1384136us) ts_tablet_manager.cc:1151] Deleting tablet 89783bab2e584fe9a8eda963f78bf3ec
0617 07:53:06.891146 (+ 3519us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.891286 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1383914}
W20260617 07:53:06.892092 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 89783bab2e584fe9a8eda963f78bf3ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89783bab2e584fe9a8eda963f78bf3ec already in progress: creating tablet
I20260617 07:53:06.894519 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 (DEFAULT_TABLE table=default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa [id=4d565f22e74c4c9d97a5b367e2b016b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.894847 1026 tablet_service.cc:1511] Processing CreateTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (DEFAULT_TABLE table=default.Table_ff5da22e90ab459a82b09212016eeb52 [id=cd211da523fd4c43a9915b8f98dddae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.895890 1021 tablet_service.cc:1511] Processing CreateTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 (DEFAULT_TABLE table=default.Table_9e163236fd4f4a23b074e860f9688936 [id=bfdf05bf71594f8a9eb9d4c4898c2e23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.896796 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad (DEFAULT_TABLE table=default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.897265 1172 tablet_bootstrap.cc:492] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:06.899590 1172 tablet_bootstrap.cc:654] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:06.904479 527 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 (table default.Table_76ba66e135e34c4cab87ecfb9db4d2f5 [id=408ae87558644eb799bec6ab8d1ad2c1]). Expected version 2 got 0
I20260617 07:53:06.905488 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c3bf1860c34ee3821bf273234cb0a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.906018 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58bbdbf59c7426c8adbbbe3f0aafaed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.910040 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc3d13d519843a9bc38e97dc85b67c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.910367 748 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6264adc3994c22864ea73106ba2320 (DEFAULT_TABLE table=default.Table_0ed7b7e3b00f4ef7bc09698697e20931 [id=ddf79f1c39544fabb0b412114c2f0e21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.914018 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5578fd5cb3724ed5b92b313bd52889ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.913899 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6264adc3994c22864ea73106ba2320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.918336 1024 tablet_service.cc:1511] Processing CreateTablet for tablet e9488e8a501e404f85540fb045d8916f (DEFAULT_TABLE table=default.Table_bd56bbbe6c6146e0aed7c57090a64d9a [id=5a246dffaba54437a4400032419c5354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.918728 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9488e8a501e404f85540fb045d8916f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.923190 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet bbc3d13d519843a9bc38e97dc85b67c8
I20260617 07:53:06.924259 744 tablet_service.cc:1511] Processing CreateTablet for tablet 18f9bace06e34602acc7fcd7501b3671 (DEFAULT_TABLE table=default.Table_494d237d1c1a4ab8b4939b39873d9793 [id=ac5919d00ecb484db9c6428a472f080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.924718 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f9bace06e34602acc7fcd7501b3671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.932018 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630e540a77374c11895ab5a0e394b3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.932090 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.932147 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.938944 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 301) took 1464 ms. Trace:
I20260617 07:53:06.939415 1170 rpcz_store.cc:276] 0617 07:53:05.474273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.504973 (+ 30700us) service_pool.cc:224] Handling call
0617 07:53:06.891694 (+1386721us) ts_tablet_manager.cc:1151] Deleting tablet a38bb8a140ef4bcab65aaa03bdb79040
0617 07:53:06.905186 (+ 13492us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.938880 (+ 33694us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1386556}
W20260617 07:53:06.940325 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a38bb8a140ef4bcab65aaa03bdb79040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a38bb8a140ef4bcab65aaa03bdb79040 already in progress: creating tablet
I20260617 07:53:06.940572 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 305) took 1159 ms. Trace:
I20260617 07:53:06.940693 1170 rpcz_store.cc:276] 0617 07:53:05.780725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.780790 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:06.940291 (+1159501us) ts_tablet_manager.cc:1151] Deleting tablet 28e1fd7f91f94221884be2166f0cc793
0617 07:53:06.940302 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.940512 (+ 210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159203}
I20260617 07:53:06.938376 1175 tablet_replica.cc:333] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:06.941195 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 28e1fd7f91f94221884be2166f0cc793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28e1fd7f91f94221884be2166f0cc793 already in progress: creating tablet
I20260617 07:53:06.942392 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 307) took 1161 ms. Trace:
I20260617 07:53:06.942919 1170 rpcz_store.cc:276] 0617 07:53:05.781051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.781114 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:06.942195 (+1161081us) ts_tablet_manager.cc:1151] Deleting tablet df705c2300064db680bec1fefab08d2f
0617 07:53:06.942207 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.942333 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1160783}
W20260617 07:53:06.943679 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet df705c2300064db680bec1fefab08d2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df705c2300064db680bec1fefab08d2f already in progress: creating tablet
I20260617 07:53:06.944195 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 306) took 1163 ms. Trace:
I20260617 07:53:06.943899 1175 raft_consensus.cc:2243] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:06.944680 1170 rpcz_store.cc:276] 0617 07:53:05.780882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.809230 (+ 28348us) service_pool.cc:224] Handling call
0617 07:53:06.944027 (+1134797us) ts_tablet_manager.cc:1151] Deleting tablet de030009192748118b388eec555d90da
0617 07:53:06.944039 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.944136 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1134497}
W20260617 07:53:06.945178 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet de030009192748118b388eec555d90da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de030009192748118b388eec555d90da already in progress: creating tablet
I20260617 07:53:06.945818 1170 tablet_replica.cc:333] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:06.946206 1175 raft_consensus.cc:2272] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.952771 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 5203534569bd4da18bc06751f094735f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:06.954052 750 tablet_service.cc:1511] Processing CreateTablet for tablet 630e540a77374c11895ab5a0e394b3bb (DEFAULT_TABLE table=default.Table_3feac2a6e61848588a7739fe7f28171b [id=5000dc26300c4d94a567bd56e0d8599c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.954200 757 tablet_service.cc:1511] Processing CreateTablet for tablet 68b448c65e684f49bf142ce2b5084d33 (DEFAULT_TABLE table=default.Table_d3c466258c0b40f09368d392be11d6dc [id=eb9a1f29372d468bb9449eb1b84c87ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.954548 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630e540a77374c11895ab5a0e394b3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.955093 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b448c65e684f49bf142ce2b5084d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.957736 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 262a34e120f34689ba0b598d7a2999fd (table default.Table_6f686d428f8c4d9bacafed83c2a72029 [id=bc72e8ae07954b5d9f55178f136a72bc]) successfully deleted
I20260617 07:53:06.958958 1170 raft_consensus.cc:2243] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:06.963749 1175 ts_tablet_manager.cc:1916] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:06.970546 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_ffd2c46b97334436a592c497f3a8fa2a" } modify_external_catalogs: true
I20260617 07:53:06.970889 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 006b71a3287240a5b15bfd489f514f4c from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:06.970760 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5b88147f546b4b2c8ae67da7ca3ecce8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.971402 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b88147f546b4b2c8ae67da7ca3ecce8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.972404 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_8d97f61ab92d44008502cff52c36b89d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:06.972905 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d97f61ab92d44008502cff52c36b89d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.972836 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_1f40cdfe73f54202b6223af377958372"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:06.972903 753 tablet_service.cc:1511] Processing CreateTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (DEFAULT_TABLE table=default.Table_ff5da22e90ab459a82b09212016eeb52 [id=cd211da523fd4c43a9915b8f98dddae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.973289 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58bbdbf59c7426c8adbbbe3f0aafaed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:06.973357 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f40cdfe73f54202b6223af377958372 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.973978 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_00d654600a8a474d84c1678c529d4489"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:06.974074 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c99ee356fa09454c8761e05cdd2b4295" } new_table_name: "default.Table_1dc0449b6b954c8c9b7bb09011250560" modify_external_catalogs: true
W20260617 07:53:06.974480 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00d654600a8a474d84c1678c529d4489 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:06.975283 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_f4f0f22885f3419fac4d346d06c53b8d" } new_table_name: "default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12" modify_external_catalogs: true
I20260617 07:53:06.976414 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_ae520dc945884caea49e68d2586a9da4" } new_table_name: "default.Table_92c8821eb1ef48fcb303b919f55c6b58" modify_external_catalogs: true
I20260617 07:53:06.977968 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_e2dd4c72e519463587685ed8940d442e" } new_table_name: "default.Table_18615792e6cb4a0480280818c51fef6d" modify_external_catalogs: true
I20260617 07:53:06.970785 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_ffd2c46b97334436a592c497f3a8fa2a" } modify_external_catalogs: true
I20260617 07:53:06.980098 750 tablet_service.cc:1511] Processing CreateTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 (DEFAULT_TABLE table=default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa [id=4d565f22e74c4c9d97a5b367e2b016b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.980486 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c3bf1860c34ee3821bf273234cb0a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.985637 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 006b71a3287240a5b15bfd489f514f4c
I20260617 07:53:06.986399 1170 pending_rounds.cc:70] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:06.986487 1170 pending_rounds.cc:77] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7297772691310706688 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "452f7d2bceb5447290370f72ec788608" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_4d28d190e4ca42dc96c1b61c33672c61" dest_uuid: "dc3bec007846459a9da0c7b8211e477b" new_extra_config { } }
W20260617 07:53:06.986872 1170 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45978: Aborted: Op aborted
I20260617 07:53:06.987035 531 catalog_manager.cc:6784] ReplaceTablet: tablet 006b71a3287240a5b15bfd489f514f4c deleted and replaced by tablet 11794aa70824476e9751a41ab305cc80
I20260617 07:53:06.987066 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:45978 (request call id 320) took 1023 ms. Trace:
I20260617 07:53:06.987167 1170 rpcz_store.cc:276] 0617 07:53:05.964015 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.964069 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:06.987031 (+1022962us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:05.964446 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0617 07:53:05.964538 (+ 92us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0617 07:53:05.964553 (+ 15us) alter_schema_op.cc:66] Acquired schema lock
0617 07:53:05.964561 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0617 07:53:05.964623 (+ 62us) alter_schema_op.cc:128] START. Timestamp: 1781682785964528
0617 07:53:05.964628 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 07:53:05.964813 (+ 185us) log.cc:844] Serialized 173 byte log entry
0617 07:53:06.986764 (+1021951us) op_driver.cc:464] REPLICATION: finished
0617 07:53:06.986794 (+ 30us) op_driver.cc:389] HandleFailure(Aborted: Op aborted)
0617 07:53:06.986801 (+ 7us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":48,"prepare.run_cpu_time_us":485,"prepare.run_wall_time_us":485,"raft.queue_time_us":1557,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":255,"replication_time_us":1022085}]]}
I20260617 07:53:06.987833 1170 raft_consensus.cc:2272] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:06.988682 1272 raft_consensus.cc:493] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:06.836190 885 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 (DEFAULT_TABLE table=default.Table_119ecdf0aa5343da9cee836dd150a21a [id=ec04f28d4a6e4fa18078aacb6b6f0bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.990572 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f0f68dcef34228a1b2a018e8aa329e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.835536 881 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca402543247461aa5384abb65fff364 (DEFAULT_TABLE table=default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.815824 880 tablet_service.cc:1511] Processing CreateTablet for tablet eb75a965740344c2bd0b68a8dda28be5 (DEFAULT_TABLE table=default.Table_a97317a462514e6384cb34f5fa00851f [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.992632 778 raft_consensus.cc:3060] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:06.993050 1272 raft_consensus.cc:515] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:06.993326 1172 tablet_bootstrap.cc:492] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:06.993508 1172 ts_tablet_manager.cc:1403] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.096s user 0.007s sys 0.004s
I20260617 07:53:06.993791 1272 leader_election.cc:290] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:06.994710 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d (DEFAULT_TABLE table=default.Table_5db1eb601069498e990dbb8635e0aa1d [id=c1fbbdf211d24d72bc0673e2ab662d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.994910 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 006b71a3287240a5b15bfd489f514f4c with delete_type TABLET_DATA_DELETED (replaced by tablet 11794aa70824476e9751a41ab305cc80) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:06.995123 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.995280 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7582d201bc5843949d4be08ee7586f9d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:06.995865 986 leader_election.cc:343] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:06.996938 1024 tablet_service.cc:1511] Processing CreateTablet for tablet ad2e04c81f964fe1895219311eebdee4 (DEFAULT_TABLE table=default.Table_8bcbcd3e54fe45879e296d390920d3b3 [id=f150a1142b4e4c7e85533806c596f529]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:06.997305 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2e04c81f964fe1895219311eebdee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:06.998875 1170 ts_tablet_manager.cc:1916] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:07.000406 1272 consensus_queue.cc:1048] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260617 07:53:07.000684 1172 raft_consensus.cc:359] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.002593 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_3e98977b52da4e3d825559a506774b17" } modify_external_catalogs: true
I20260617 07:53:07.002779 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_3e98977b52da4e3d825559a506774b17" } modify_external_catalogs: true
W20260617 07:53:07.003212 716 leader_election.cc:343] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 4d9d9ed003c64b1abed6bd3bb14456cd
I20260617 07:53:07.004272 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fcf87953dc14bf190ac74101547e52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.004972 1598 raft_consensus.cc:697] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:07.005347 1598 consensus_queue.cc:237] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.006644 1172 raft_consensus.cc:385] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:07.006762 1172 raft_consensus.cc:740] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:07.007000 1272 raft_consensus.cc:493] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.007068 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_45a2812670d9436a960744648a856ec8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:07.007501 1366 leader_election.cc:290] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:07.007612 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45a2812670d9436a960744648a856ec8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.008845 1341 leader_election.cc:290] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.009624 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9ace137c4e496fafac4e729718577f (DEFAULT_TABLE table=default.Table_b4b3342eed21433e8924f22e9a41989b [id=7738095992784d1e80554f9f554fb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.011219 1341 raft_consensus.cc:493] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.011374 1341 raft_consensus.cc:515] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.011996 1341 leader_election.cc:290] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:07.015249 1171 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.522s user 0.020s sys 0.017s
I20260617 07:53:07.016212 1366 raft_consensus.cc:493] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.016377 1169 pending_rounds.cc:77] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772693089869824 op_type: NO_OP noop_request { }
I20260617 07:53:07.017124 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca402543247461aa5384abb65fff364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.019112 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_ddca8eb1aba6417a8cb8a723dd38551b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.019696 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddca8eb1aba6417a8cb8a723dd38551b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.021165 1169 raft_consensus.cc:2889] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:07.022595 1366 raft_consensus.cc:515] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.023264 1366 leader_election.cc:290] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.023962 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9ace137c4e496fafac4e729718577f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.025010 1272 raft_consensus.cc:515] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.025668 1272 leader_election.cc:290] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.026280 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2cb23911614f9dab0767b1f6af3d00" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:07.026343 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa23bb0929440b1820afdce4b9e8d8c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:07.026516 1052 raft_consensus.cc:2468] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:07.026567 1051 raft_consensus.cc:2468] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:07.028991 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fd8cedb539748dc917128511325bbcc consensus state has no leader
W20260617 07:53:07.030419 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 234233us
I20260617 07:53:07.034047 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_77163a83bea3432b8b2ea745bef42ce8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.034636 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77163a83bea3432b8b2ea745bef42ce8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.009665 1172 consensus_queue.cc:260] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.040578 1169 raft_consensus.cc:2272] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:07.043339 1171 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.533s user 0.021s sys 0.017s
I20260617 07:53:07.045727 1169 ts_tablet_manager.cc:1916] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:07.046279 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb75a965740344c2bd0b68a8dda28be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.043989 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (DEFAULT_TABLE table=default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.053615 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_95bb54209dbf45bb9b38c213a85eb101"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.054314 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95bb54209dbf45bb9b38c213a85eb101 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.055908 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a460aee4eb514a87b272c4fc858335e7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:07.056613 1051 raft_consensus.cc:2468] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:07.057830 1172 ts_tablet_manager.cc:1434] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20260617 07:53:07.058581 851 leader_election.cc:304] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:07.058197 988 leader_election.cc:304] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:07.063666 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2735f7dd40e54aec9004b9b38702607c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.065910 1272 raft_consensus.cc:2804] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:07.066027 1272 raft_consensus.cc:493] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:07.066051 1299 raft_consensus.cc:2804] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:07.066314 1272 raft_consensus.cc:3060] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.066601 1299 raft_consensus.cc:493] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:07.066706 1299 raft_consensus.cc:3060] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.067194 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bf5384ec244d36ba3d4e781c5eb8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.070123 1272 raft_consensus.cc:515] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.071580 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa23bb0929440b1820afdce4b9e8d8c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:07.089658 893 tablet_service.cc:1511] Processing CreateTablet for tablet 596ef68705c84791b54f07e03b219b4c (DEFAULT_TABLE table=default.Table_0a73e0c5eead4482b2f6747fec27846f [id=3cda30618acd40f08728b0ccb01bb973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.090276 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:07.093392 1171 tablet_bootstrap.cc:492] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:07.094254 986 leader_election.cc:343] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.094913 1272 leader_election.cc:290] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.095839 1172 tablet_bootstrap.cc:492] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:07.097621 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8f144d04af4ea18f99aee3b82f4a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.097859 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4681e8e3f1174b299d89ec541ca8e6b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:07.100450 519 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 5203534569bd4da18bc06751f094735f (table default.Table_9e10117b19d649668289e1ad8374ff7d [id=77f9a3f7e2e441b888caf756936d7ee5], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5203534569bd4da18bc06751f094735f consensus state has no leader
I20260617 07:53:07.100955 1172 tablet_bootstrap.cc:654] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:07.105858 879 tablet_service.cc:1511] Processing CreateTablet for tablet 68b448c65e684f49bf142ce2b5084d33 (DEFAULT_TABLE table=default.Table_d3c466258c0b40f09368d392be11d6dc [id=eb9a1f29372d468bb9449eb1b84c87ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.107769 889 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6264adc3994c22864ea73106ba2320 (DEFAULT_TABLE table=default.Table_0ed7b7e3b00f4ef7bc09698697e20931 [id=ddf79f1c39544fabb0b412114c2f0e21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.109112 883 tablet_service.cc:1511] Processing CreateTablet for tablet 18f9bace06e34602acc7fcd7501b3671 (DEFAULT_TABLE table=default.Table_494d237d1c1a4ab8b4939b39873d9793 [id=ac5919d00ecb484db9c6428a472f080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.110070 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:07.112277 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 5203534569bd4da18bc06751f094735f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:07.113224 891 tablet_service.cc:1511] Processing CreateTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 (DEFAULT_TABLE table=default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa [id=4d565f22e74c4c9d97a5b367e2b016b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.113579 884 tablet_service.cc:1511] Processing CreateTablet for tablet 630e540a77374c11895ab5a0e394b3bb (DEFAULT_TABLE table=default.Table_3feac2a6e61848588a7739fe7f28171b [id=5000dc26300c4d94a567bd56e0d8599c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.117285 882 tablet_service.cc:1511] Processing CreateTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad (DEFAULT_TABLE table=default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.117745 892 tablet_service.cc:1511] Processing CreateTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (DEFAULT_TABLE table=default.Table_ff5da22e90ab459a82b09212016eeb52 [id=cd211da523fd4c43a9915b8f98dddae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.119942 894 tablet_service.cc:1511] Processing CreateTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 (DEFAULT_TABLE table=default.Table_9e163236fd4f4a23b074e860f9688936 [id=bfdf05bf71594f8a9eb9d4c4898c2e23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.121287 1172 tablet_bootstrap.cc:492] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:07.122385 1172 ts_tablet_manager.cc:1403] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.006s
I20260617 07:53:07.125608 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc0676db18c42259efb1ad7dbd140c8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:07.071735 851 leader_election.cc:304] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:07.129443 1172 raft_consensus.cc:359] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.130743 1172 raft_consensus.cc:385] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:07.131353 1172 raft_consensus.cc:740] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:07.138500 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a900aecf46e4430cb7ccdecd54376193 has no consensus state
I20260617 07:53:07.143314 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 with delete_type TABLET_DATA_DELETED (replaced by tablet 58ba8963530d49a89fe4eb626225377d) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.133210 1172 consensus_queue.cc:260] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.145287 1364 raft_consensus.cc:493] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.145452 1364 raft_consensus.cc:515] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.146400 1364 leader_election.cc:290] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.147444 1172 ts_tablet_manager.cc:1434] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.024s user 0.001s sys 0.002s
I20260617 07:53:07.147845 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddfb822b5af4bb6b664936c769d9625" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:07.148594 986 leader_election.cc:343] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.149233 1172 tablet_bootstrap.cc:492] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:07.143474 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7392ca4ba6a140e19c57e962a26162af" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:07.156919 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 64473.7us
I20260617 07:53:07.157579 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596ef68705c84791b54f07e03b219b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.158172 1633 raft_consensus.cc:2804] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:07.158138 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa23bb0929440b1820afdce4b9e8d8c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:07.158311 1633 raft_consensus.cc:493] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:07.158452 1633 raft_consensus.cc:3060] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.158517 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a882ae04eeb94276bb78ded81fbea708" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:07.159010 988 leader_election.cc:343] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.159162 988 leader_election.cc:304] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:07.159631 988 leader_election.cc:343] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.159759 988 leader_election.cc:304] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:07.160158 988 leader_election.cc:343] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.160266 988 leader_election.cc:304] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:07.160630 1400 raft_consensus.cc:2749] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:07.160825 1400 raft_consensus.cc:2749] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:07.160975 1400 raft_consensus.cc:2749] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:07.158457 914 raft_consensus.cc:3060] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.162776 1172 tablet_bootstrap.cc:654] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:07.163048 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddfb822b5af4bb6b664936c769d9625" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:07.163846 988 leader_election.cc:343] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.163992 988 leader_election.cc:304] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:07.164424 1272 raft_consensus.cc:2749] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:07.165424 1272 consensus_queue.cc:1048] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:07.166128 1633 raft_consensus.cc:515] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.168318 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf4025a0f784cc6868950e51a45da2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.169901 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7582d201bc5843949d4be08ee7586f9d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:07.170928 988 leader_election.cc:343] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.171044 988 leader_election.cc:304] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:07.171459 1272 raft_consensus.cc:2749] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:07.172232 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba5976fcadd4add9c671300b431617b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.170943 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c9a032007a412e95bbd2b229edd50b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:07.183480 988 leader_election.cc:343] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.182220 851 leader_election.cc:304] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:07.184597 851 leader_election.cc:343] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: f345910256784d2085cb81473534dcaf
I20260617 07:53:07.189055 1299 raft_consensus.cc:515] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.191051 1633 leader_election.cc:290] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.192703 1299 leader_election.cc:290] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.196952 526 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 875962c2e27a4ee1b9889769d53022cc (table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a]). Expected version 1 got 0
I20260617 07:53:07.197191 1171 ts_tablet_manager.cc:1403] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.616s user 0.023s sys 0.019s
W20260617 07:53:07.200788 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56c70f5c41e04ad0b913c15aa315353f consensus state has no leader
I20260617 07:53:07.209722 1299 raft_consensus.cc:493] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.209914 1299 raft_consensus.cc:515] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.210597 1299 leader_election.cc:290] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.210736 1299 raft_consensus.cc:493] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.210884 1299 raft_consensus.cc:515] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.211441 1299 leader_election.cc:290] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:07.213480 1172 tablet_bootstrap.cc:492] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:07.213821 1172 ts_tablet_manager.cc:1403] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.012s
I20260617 07:53:07.215963 1172 raft_consensus.cc:359] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.216395 1172 raft_consensus.cc:385] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:07.216566 1172 raft_consensus.cc:740] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:07.217293 1172 consensus_queue.cc:260] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.219677 1172 ts_tablet_manager.cc:1434] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260617 07:53:07.220825 1172 tablet_bootstrap.cc:492] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:07.229305 1171 raft_consensus.cc:359] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.194274 890 tablet_service.cc:1511] Processing CreateTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d (DEFAULT_TABLE table=default.Table_5db1eb601069498e990dbb8635e0aa1d [id=c1fbbdf211d24d72bc0673e2ab662d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.230872 1171 raft_consensus.cc:385] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:07.231072 1171 raft_consensus.cc:740] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:07.237537 1178 tablet_bootstrap.cc:492] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:07.240337 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c9a032007a412e95bbd2b229edd50b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.241963 1171 consensus_queue.cc:260] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.251623 1178 ts_tablet_manager.cc:1403] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.503s user 0.006s sys 0.015s
I20260617 07:53:07.252549 1178 raft_consensus.cc:359] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:07.254650 986 leader_election.cc:343] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.254957 986 leader_election.cc:304] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:07.256330 1172 tablet_bootstrap.cc:654] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:07.251080 851 leader_election.cc:304] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:07.252867 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630e540a77374c11895ab5a0e394b3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.252956 914 raft_consensus.cc:2468] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:07.260697 1366 raft_consensus.cc:2764] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260617 07:53:07.261369 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d94915d96694d6f9a86063640e5fe18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.265040 1272 raft_consensus.cc:2749] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:07.266487 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c019792d23484fb789378bf377547415 consensus state has no leader
I20260617 07:53:07.268019 1170 ts_tablet_manager.cc:1929] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:07.268628 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet d7309d2b22c849ce980fd263a29ac77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.269151 884 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:07.269701 988 leader_election.cc:304] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:07.270932 1272 raft_consensus.cc:2804] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:07.272279 1364 raft_consensus.cc:493] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.272570 1178 raft_consensus.cc:385] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:07.273363 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f8525046964950884b0f9aa515ec81" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.275205 523 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_b7a457c62ae64ddbb5d85988bd2992bc [id=9726df7d693441359861876ae1179b4d]). Expected version 1 got 0
I20260617 07:53:07.278228 1272 raft_consensus.cc:697] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:07.278522 1272 consensus_queue.cc:237] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.279661 1364 raft_consensus.cc:515] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.280303 1364 leader_election.cc:290] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.281425 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet d03d6dc473fc4be1a436fd71a06f403e
I20260617 07:53:07.282547 1178 raft_consensus.cc:740] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:07.283459 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.287335 1170 log.cc:1199] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/452f7d2bceb5447290370f72ec788608
I20260617 07:53:07.287921 1170 ts_tablet_manager.cc:1950] T 452f7d2bceb5447290370f72ec788608 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:07.289451 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 309) took 1435 ms. Trace:
I20260617 07:53:07.289558 1170 rpcz_store.cc:276] 0617 07:53:05.853611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.853663 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:06.945706 (+1092043us) ts_tablet_manager.cc:1151] Deleting tablet 452f7d2bceb5447290370f72ec788608
0617 07:53:06.945738 (+ 32us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:07.084438 (+138700us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:07.254868 (+170430us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:07.289392 (+ 34524us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1090728}
I20260617 07:53:07.290371 1170 tablet_replica.cc:333] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:07.300688 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
I20260617 07:53:07.304330 1170 raft_consensus.cc:2243] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:07.304574 1170 raft_consensus.cc:2272] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:07.305123 1170 ts_tablet_manager.cc:1916] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:07.317885 755 tablet_service.cc:1511] Processing CreateTablet for tablet e9488e8a501e404f85540fb045d8916f (DEFAULT_TABLE table=default.Table_bd56bbbe6c6146e0aed7c57090a64d9a [id=5a246dffaba54437a4400032419c5354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.320586 1364 raft_consensus.cc:493] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.320739 1364 raft_consensus.cc:515] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.321274 773 raft_consensus.cc:3060] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.321357 758 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.321416 1364 leader_election.cc:290] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.322721 1178 consensus_queue.cc:260] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.333678 1170 ts_tablet_manager.cc:1929] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:07.353891 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.348268 1172 tablet_bootstrap.cc:492] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:07.379580 1172 ts_tablet_manager.cc:1403] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.159s user 0.002s sys 0.018s
I20260617 07:53:07.380517 1172 raft_consensus.cc:359] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.381489 1172 raft_consensus.cc:385] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:07.380923 1170 log.cc:1199] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/787467c65f68442aad071df16d4492f3
I20260617 07:53:07.382175 1170 ts_tablet_manager.cc:1950] T 787467c65f68442aad071df16d4492f3 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:07.382966 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 361845f7627b4b9f8481b4a66bc53e9c (DEFAULT_TABLE table=default.Table_b12221b517d346f3adec5874b70f1eb6 [id=f00addaaab9440a3a70bf54d62a94cd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.383422 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361845f7627b4b9f8481b4a66bc53e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.386492 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 037539021d1743bb9a66403b8a01662f (DEFAULT_TABLE table=default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.386847 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037539021d1743bb9a66403b8a01662f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.388585 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2cb23911614f9dab0767b1f6af3d00" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:07.388846 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7343400555f447b8a1721ba36d7766d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.389338 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a460aee4eb514a87b272c4fc858335e7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.389993 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 (DEFAULT_TABLE table=default.Table_665c19b8c9d14ccc9f5beb633b690e13 [id=3ab32aa970c24c1bbde1768b3defee07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.390357 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5364dfe28b8d4042941c8d8d4d1cf503. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:07.391000 986 leader_election.cc:343] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.394326 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 006b71a3287240a5b15bfd489f514f4c with delete_type TABLET_DATA_DELETED (replaced by tablet 11794aa70824476e9751a41ab305cc80) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.251484 756 tablet_service.cc:1511] Processing CreateTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad (DEFAULT_TABLE table=default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.395530 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7309d2b22c849ce980fd263a29ac77f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.395843 1026 tablet_service.cc:1511] Processing CreateTablet for tablet a02dbb70eec84932917ef282fdae0bd7 (DEFAULT_TABLE table=default.Table_fceae19017b24062acf8baff4d043ec9 [id=1a61bbe203b44d6d89dbc71a84fc3917]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:07.396041 986 leader_election.cc:343] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.396243 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02dbb70eec84932917ef282fdae0bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.398228 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 5f8602b87a20455884c16196a901d335 (DEFAULT_TABLE table=default.Table_e01c4bf739194d638e2a3988702d4cfb [id=87e7c45adff04a7eb2c6edf0b75a047c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.398555 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f8602b87a20455884c16196a901d335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.269434 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5578fd5cb3724ed5b92b313bd52889ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.402345 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe290e33b5145b6a2831de3d37599b9 (DEFAULT_TABLE table=default.Table_66c2a830c5a94c0c9f70f12f18100bd5 [id=4f545023638349f686a11acaade9abfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.402995 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe290e33b5145b6a2831de3d37599b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.405328 1017 tablet_service.cc:1511] Processing CreateTablet for tablet e55d63a25a2845dbbcce20e560361007 (DEFAULT_TABLE table=default.Table_5b88147f546b4b2c8ae67da7ca3ecce8 [id=65758195b79f43a2954a2c3371d757c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.271993 1171 ts_tablet_manager.cc:1434] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.075s user 0.003s sys 0.000s
W20260617 07:53:07.274001 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 88928us
I20260617 07:53:07.407588 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55d63a25a2845dbbcce20e560361007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.408917 1172 raft_consensus.cc:740] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:07.274093 1634 raft_consensus.cc:2804] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:07.281975 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7343400555f447b8a1721ba36d7766d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:07.413635 1634 raft_consensus.cc:493] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:07.414075 1634 raft_consensus.cc:3060] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.418530 1634 raft_consensus.cc:515] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.434243 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9488e8a501e404f85540fb045d8916f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.435751 1641 tablet.cc:1724] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:07.282730 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2cb23911614f9dab0767b1f6af3d00" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.437659 1178 ts_tablet_manager.cc:1434] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.140s user 0.002s sys 0.000s
I20260617 07:53:07.438393 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69996eb4ab6e40f9b2d97e00d766822a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.389271 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f8525046964950884b0f9aa515ec81" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:07.443603 1023 tablet_service.cc:1511] Processing CreateTablet for tablet a900aecf46e4430cb7ccdecd54376193 (DEFAULT_TABLE table=default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.444474 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 11794aa70824476e9751a41ab305cc80 (DEFAULT_TABLE table=default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.444972 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11794aa70824476e9751a41ab305cc80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.446647 758 tablet_service.cc:1511] Processing CreateTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d (DEFAULT_TABLE table=default.Table_5db1eb601069498e990dbb8635e0aa1d [id=c1fbbdf211d24d72bc0673e2ab662d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.446923 753 tablet_service.cc:1511] Processing CreateTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 (DEFAULT_TABLE table=default.Table_9e163236fd4f4a23b074e860f9688936 [id=bfdf05bf71594f8a9eb9d4c4898c2e23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.446365 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2cb23911614f9dab0767b1f6af3d00" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:07.447126 780 raft_consensus.cc:3060] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.447144 1048 raft_consensus.cc:3060] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:07.449978 988 leader_election.cc:343] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.449958 749 tablet_service.cc:1511] Processing CreateTablet for tablet ad2e04c81f964fe1895219311eebdee4 (DEFAULT_TABLE table=default.Table_8bcbcd3e54fe45879e296d390920d3b3 [id=f150a1142b4e4c7e85533806c596f529]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.450203 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:38066
W20260617 07:53:07.450399 1642 log.cc:927] Time spent T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Append to log took a long time: real 0.172s user 0.000s sys 0.000s
I20260617 07:53:07.449820 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f8525046964950884b0f9aa515ec81" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:07.450852 1047 raft_consensus.cc:3060] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.451683 780 raft_consensus.cc:2468] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:07.454213 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f67a6c1dcf4a69842452c371a9c078" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.453815 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69996eb4ab6e40f9b2d97e00d766822a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:07.457199 1046 raft_consensus.cc:2468] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:07.457410 752 tablet_service.cc:1511] Processing CreateTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (DEFAULT_TABLE table=default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.459187 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5fdacd3c9f8f443bac56aa55916c3575" } new_table_name: "default.Table_a419ba4ac7ca4fb583f6da5781f87dba" modify_external_catalogs: true
I20260617 07:53:07.459929 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a900aecf46e4430cb7ccdecd54376193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.459872 1030 tablet_service.cc:1511] Processing CreateTablet for tablet e9f8492f127243eca07b2ffbabddded5 (DEFAULT_TABLE table=default.Table_77163a83bea3432b8b2ea745bef42ce8 [id=2cd57d521b8b4434b456c086f0e36de8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.460284 988 leader_election.cc:304] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:07.455111 751 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9ace137c4e496fafac4e729718577f (DEFAULT_TABLE table=default.Table_b4b3342eed21433e8924f22e9a41989b [id=7738095992784d1e80554f9f554fb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.460855 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_c918313039f74feabcd522092350ffa1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.461396 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c918313039f74feabcd522092350ffa1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.463310 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f8492f127243eca07b2ffbabddded5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.464653 1019 tablet_service.cc:1511] Processing CreateTablet for tablet f14a3cb5e50b42b18ffda6f38cdfdd73 (DEFAULT_TABLE table=default.Table_95bb54209dbf45bb9b38c213a85eb101 [id=be8b1cef0a134635b8eac9b44b5bf75f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.465035 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14a3cb5e50b42b18ffda6f38cdfdd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.466881 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_fceae19017b24062acf8baff4d043ec9" } modify_external_catalogs: true
I20260617 07:53:07.467092 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_fceae19017b24062acf8baff4d043ec9" } modify_external_catalogs: true
I20260617 07:53:07.467152 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bd56bbbe6c6146e0aed7c57090a64d9a" } modify_external_catalogs: true
I20260617 07:53:07.467339 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_bd56bbbe6c6146e0aed7c57090a64d9a" } modify_external_catalogs: true
W20260617 07:53:07.468852 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3aa1c1fdede041d28570b85e63c401b7 consensus state has no leader
W20260617 07:53:07.469368 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 44617.8us
I20260617 07:53:07.457533 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f67a6c1dcf4a69842452c371a9c078" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:07.470121 1045 raft_consensus.cc:2468] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:07.470144 754 tablet_service.cc:1511] Processing CreateTablet for tablet 361845f7627b4b9f8481b4a66bc53e9c (DEFAULT_TABLE table=default.Table_b12221b517d346f3adec5874b70f1eb6 [id=f00addaaab9440a3a70bf54d62a94cd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.393359 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f345910256784d2085cb81473534dcaf" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.470597 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.474355 1028 tablet_service.cc:1511] Processing CreateTablet for tablet cb0ff0f0426440fba477a3dc4d1644e0 (DEFAULT_TABLE table=default.Table_45a2812670d9436a960744648a856ec8 [id=cb04083073d5491a9866d8c59d51a5e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.474733 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 369442b72f754ee08dc6a484d51f2e99 (DEFAULT_TABLE table=default.Table_8d97f61ab92d44008502cff52c36b89d [id=f0165435692349baa81584520f068a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.475013 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 (DEFAULT_TABLE table=default.Table_1f40cdfe73f54202b6223af377958372 [id=347683dc11c24e8e9f2e9eff1d671045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.475716 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb0ff0f0426440fba477a3dc4d1644e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.485193 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369442b72f754ee08dc6a484d51f2e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.490056 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_8e5edb393db8438abed9a541c820e07a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.490886 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e5edb393db8438abed9a541c820e07a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.498664 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet a02dbb70eec84932917ef282fdae0bd7
I20260617 07:53:07.500079 1272 raft_consensus.cc:2749] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:07.500427 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9618a5c0c9dd4c368f5763c434f70da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.503669 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_494d237d1c1a4ab8b4939b39873d9793" } modify_external_catalogs: true
I20260617 07:53:07.503880 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_494d237d1c1a4ab8b4939b39873d9793" } modify_external_catalogs: true
I20260617 07:53:07.506102 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 (DEFAULT_TABLE table=default.Table_00d654600a8a474d84c1678c529d4489 [id=9776f24641614e23a1ea878c6aad0efa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.506168 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet e9488e8a501e404f85540fb045d8916f
I20260617 07:53:07.508648 1047 raft_consensus.cc:2468] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:07.509083 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 (DEFAULT_TABLE table=default.Table_ddca8eb1aba6417a8cb8a723dd38551b [id=ab7b996d094f49df9532f308d8615d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.509584 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488cc3a082b14dee8f70153e6f2925a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.510663 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.511029 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.513805 1048 raft_consensus.cc:2468] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:07.514649 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be19ece3a0a4a51abad7b8e2f3b2420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.515942 1272 raft_consensus.cc:493] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.516146 1272 raft_consensus.cc:515] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.517319 1272 leader_election.cc:290] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.449795 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa23bb0929440b1820afdce4b9e8d8c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.519335 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.517478 1598 raft_consensus.cc:493] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.523110 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 18f9bace06e34602acc7fcd7501b3671
I20260617 07:53:07.526008 1178 tablet_bootstrap.cc:492] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:07.527951 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 452f7d2bceb5447290370f72ec788608 with delete_type TABLET_DATA_DELETED (replaced by tablet 440e57c1cf07484ab1a4ba721aae1ed7) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.532732 1272 raft_consensus.cc:493] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.532904 1272 raft_consensus.cc:515] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.535027 1272 leader_election.cc:290] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.536099 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_071d2b97455544f48ec96587c227de07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.536762 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_071d2b97455544f48ec96587c227de07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.538678 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_69167a2936fa47a08d1f53dfec14f52b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.539561 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69167a2936fa47a08d1f53dfec14f52b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.544708 760 tablet_service.cc:1511] Processing CreateTablet for tablet a02dbb70eec84932917ef282fdae0bd7 (DEFAULT_TABLE table=default.Table_fceae19017b24062acf8baff4d043ec9 [id=1a61bbe203b44d6d89dbc71a84fc3917]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.545621 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361845f7627b4b9f8481b4a66bc53e9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:07.551757 1640 log.cc:927] Time spent T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260617 07:53:07.556783 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.556903 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 310) took 1688 ms. Trace:
I20260617 07:53:07.555796 1172 consensus_queue.cc:260] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.557587 1170 rpcz_store.cc:276] 0617 07:53:05.863789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.864055 (+ 266us) service_pool.cc:224] Handling call
0617 07:53:07.289891 (+1425836us) ts_tablet_manager.cc:1151] Deleting tablet 787467c65f68442aad071df16d4492f3
0617 07:53:07.289903 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:07.330541 (+ 40638us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:07.333586 (+ 3045us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:07.552242 (+218656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1398286}
I20260617 07:53:07.562055 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 787467c65f68442aad071df16d4492f3 (table default.Table_860af7cb625c496bb781b7c1b478d606 [id=61342c668451423aafa602607f19a1db]) successfully deleted
I20260617 07:53:07.563421 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 308) took 1725 ms. Trace:
I20260617 07:53:07.568367 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_09a7839ef9df4c6cb77cf0a55a133446" } new_table_name: "default.Table_91f0347cdea645c393589810a50ca778" modify_external_catalogs: true
I20260617 07:53:07.570778 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_af1642a493c54650937216698b190b90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.571349 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af1642a493c54650937216698b190b90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.571821 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0ed7b7e3b00f4ef7bc09698697e20931" } new_table_name: "default.Table_b4e56877f98d44cf897d768d1058f5d5" modify_external_catalogs: true
I20260617 07:53:07.571866 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_2e08b8585e3744a486d5d2c7c227a6c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:07.294277 888 tablet_service.cc:1511] Processing CreateTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (DEFAULT_TABLE table=default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:07.572340 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e08b8585e3744a486d5d2c7c227a6c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.305317 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 006b71a3287240a5b15bfd489f514f4c with delete_type TABLET_DATA_DELETED (replaced by tablet 11794aa70824476e9751a41ab305cc80) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:07.322144 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7309d2b22c849ce980fd263a29ac77f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:07.371989 881 tablet_service.cc:1511] Processing CreateTablet for tablet ad2e04c81f964fe1895219311eebdee4 (DEFAULT_TABLE table=default.Table_8bcbcd3e54fe45879e296d390920d3b3 [id=f150a1142b4e4c7e85533806c596f529]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.573218 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_833d659ea3034141bb454daaea8a3d8a" } modify_external_catalogs: true
I20260617 07:53:07.254262 886 tablet_service.cc:1511] Processing CreateTablet for tablet e9488e8a501e404f85540fb045d8916f (DEFAULT_TABLE table=default.Table_bd56bbbe6c6146e0aed7c57090a64d9a [id=5a246dffaba54437a4400032419c5354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.573401 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_833d659ea3034141bb454daaea8a3d8a" } modify_external_catalogs: true
I20260617 07:53:07.422966 1171 tablet_bootstrap.cc:492] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:07.423133 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c3bf1860c34ee3821bf273234cb0a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.573947 893 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:07.573971 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_63ca0f0334524b60a193ce1677ca2ee1" } modify_external_catalogs: true
W20260617 07:53:07.459656 852 leader_election.cc:343] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.574120 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_63ca0f0334524b60a193ce1677ca2ee1" } modify_external_catalogs: true
W20260617 07:53:07.574395 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 114774us
W20260617 07:53:07.574854 852 leader_election.cc:343] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.424608 884 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9ace137c4e496fafac4e729718577f (DEFAULT_TABLE table=default.Table_b4b3342eed21433e8924f22e9a41989b [id=7738095992784d1e80554f9f554fb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.575203 1598 raft_consensus.cc:515] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.471158 851 leader_election.cc:304] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:07.575553 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 104462us
I20260617 07:53:07.575657 1631 raft_consensus.cc:2804] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:07.575766 1631 raft_consensus.cc:493] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:07.575912 1631 raft_consensus.cc:3060] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.575825 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_4dd323be87d94043a38bea68d8437107" } new_table_name: "default.Table_073280306a2740119a28c4682671d83f" modify_external_catalogs: true
I20260617 07:53:07.576005 851 leader_election.cc:304] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:07.576375 851 leader_election.cc:304] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:07.576681 851 leader_election.cc:304] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:07.479182 1655 tablet.cc:1724] T 875962c2e27a4ee1b9889769d53022cc P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:07.574097 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b448c65e684f49bf142ce2b5084d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.577257 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c7ced951c34afa8dff243d275bfb36" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.578024 1633 raft_consensus.cc:2804] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 07:53:07.577986 852 leader_election.cc:343] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.573617 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_39e76c41c1f84fd1ab2024365c1cd5a1" } new_table_name: "default.Table_27991162221746b7a1f8513217cc15e8" modify_external_catalogs: true
I20260617 07:53:07.577987 1632 raft_consensus.cc:2804] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:07.578651 1633 raft_consensus.cc:493] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:07.578768 1633 raft_consensus.cc:3060] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.579224 1299 raft_consensus.cc:2804] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
W20260617 07:53:07.579360 852 leader_election.cc:343] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.579423 1299 raft_consensus.cc:697] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:07.579772 1299 consensus_queue.cc:237] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.580176 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4681e8e3f1174b299d89ec541ca8e6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.581514 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9ace137c4e496fafac4e729718577f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.582355 744 tablet_service.cc:1511] Processing CreateTablet for tablet 5f8602b87a20455884c16196a901d335 (DEFAULT_TABLE table=default.Table_e01c4bf739194d638e2a3988702d4cfb [id=87e7c45adff04a7eb2c6edf0b75a047c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.583297 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02dbb70eec84932917ef282fdae0bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.583882 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5578fd5cb3724ed5b92b313bd52889ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.593568 1598 leader_election.cc:290] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.574913 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:07.601275 1272 raft_consensus.cc:493] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.601640 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a460aee4eb514a87b272c4fc858335e7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
W20260617 07:53:07.603571 757 consensus_meta.cc:287] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent flushing consensus metadata: real 0.591s user 0.003s sys 0.001s
I20260617 07:53:07.589807 747 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe290e33b5145b6a2831de3d37599b9 (DEFAULT_TABLE table=default.Table_66c2a830c5a94c0c9f70f12f18100bd5 [id=4f545023638349f686a11acaade9abfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.604939 746 tablet_service.cc:1511] Processing CreateTablet for tablet a900aecf46e4430cb7ccdecd54376193 (DEFAULT_TABLE table=default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:07.609097 986 leader_election.cc:343] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.609120 1170 rpcz_store.cc:276] 0617 07:53:05.838275 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.879719 (+ 41444us) service_pool.cc:224] Handling call
0617 07:53:07.560545 (+1680826us) ts_tablet_manager.cc:1151] Deleting tablet df4f9101deaa4e6ebddacbce14f32810
0617 07:53:07.562791 (+ 2246us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:07.563354 (+ 563us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1668707}
W20260617 07:53:07.610004 516 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet df4f9101deaa4e6ebddacbce14f32810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df4f9101deaa4e6ebddacbce14f32810 already in progress: creating tablet
I20260617 07:53:07.610657 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074a3e08cc9a4be891016ce197a993be" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:07.605836 745 tablet_service.cc:1511] Processing CreateTablet for tablet 11794aa70824476e9751a41ab305cc80 (DEFAULT_TABLE table=default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:07.613266 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7934f5fa0287427cb45fe568f0de8758 consensus state has no leader
I20260617 07:53:07.613940 1641 tablet.cc:1724] T ccf7f07441954d35916890efbfa4d836 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:07.610316 1170 tablet_replica.cc:333] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:07.617949 1047 raft_consensus.cc:3060] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.619619 1046 raft_consensus.cc:2393] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6438857e0a7741ceaadf84cb9dc979e7 in current term 1: Already voted for candidate 8b7080d37ca245fe914d3dc90f17e3ba in this term.
I20260617 07:53:07.610713 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdf8f714539449d8862cd2a2336fbe9 (DEFAULT_TABLE table=default.Table_c918313039f74feabcd522092350ffa1 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.608002 743 tablet_service.cc:1511] Processing CreateTablet for tablet e55d63a25a2845dbbcce20e560361007 (DEFAULT_TABLE table=default.Table_5b88147f546b4b2c8ae67da7ca3ecce8 [id=65758195b79f43a2954a2c3371d757c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.631901 755 tablet_service.cc:1511] Processing CreateTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 (DEFAULT_TABLE table=default.Table_1f40cdfe73f54202b6223af377958372 [id=347683dc11c24e8e9f2e9eff1d671045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.632743 1172 ts_tablet_manager.cc:1434] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.242s user 0.002s sys 0.000s
I20260617 07:53:07.637694 1170 raft_consensus.cc:2243] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:07.638273 1272 raft_consensus.cc:515] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.639802 1172 tablet_bootstrap.cc:492] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:07.639817 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4996cde4d1514aa081257c802339abe6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.639930 1170 raft_consensus.cc:2272] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:07.640410 986 leader_election.cc:343] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.639840 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdf8f714539449d8862cd2a2336fbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.650058 1400 raft_consensus.cc:493] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.652858 1400 raft_consensus.cc:515] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.660435 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2e04c81f964fe1895219311eebdee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.663048 1178 tablet_bootstrap.cc:654] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:07.663561 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9488e8a501e404f85540fb045d8916f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.664621 1272 leader_election.cc:290] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.669176 1170 ts_tablet_manager.cc:1916] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:07.672106 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e90ad53742c6427a87f6e2dfad5f9e54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:07.672374 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_7c71fb4276494d539fb7ccb468f0e300"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.672683 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e90ad53742c6427a87f6e2dfad5f9e54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:07.672945 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c71fb4276494d539fb7ccb468f0e300 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.674077 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_7922639f29994091bdceabbc831c9a02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:07.674443 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a324b6c42b014d8c97cc1dec8d9d8ca6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.674842 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a324b6c42b014d8c97cc1dec8d9d8ca6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:07.676388 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7922639f29994091bdceabbc831c9a02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.679085 1364 raft_consensus.cc:493] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.681782 1175 ts_tablet_manager.cc:1929] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:07.681972 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 (DEFAULT_TABLE table=default.Table_665c19b8c9d14ccc9f5beb633b690e13 [id=3ab32aa970c24c1bbde1768b3defee07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.683406 1272 raft_consensus.cc:493] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.683570 1272 raft_consensus.cc:515] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.684322 1272 leader_election.cc:290] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.684725 1400 leader_election.cc:290] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.685657 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2e04c81f964fe1895219311eebdee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.682957 1364 raft_consensus.cc:515] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.684855 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.688485 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f030d59f4e124f64bb62d05f0bb0f560" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.690696 750 tablet_service.cc:1511] Processing CreateTablet for tablet 037539021d1743bb9a66403b8a01662f (DEFAULT_TABLE table=default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.690547 742 tablet_service.cc:1511] Processing CreateTablet for tablet f14a3cb5e50b42b18ffda6f38cdfdd73 (DEFAULT_TABLE table=default.Table_95bb54209dbf45bb9b38c213a85eb101 [id=be8b1cef0a134635b8eac9b44b5bf75f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.691361 748 tablet_service.cc:1511] Processing CreateTablet for tablet e9f8492f127243eca07b2ffbabddded5 (DEFAULT_TABLE table=default.Table_77163a83bea3432b8b2ea745bef42ce8 [id=2cd57d521b8b4434b456c086f0e36de8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.693157 1175 log.cc:1199] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/c3a29aeb0a224cabb642f4100c44b8f3
I20260617 07:53:07.693279 757 tablet_service.cc:1511] Processing CreateTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 (DEFAULT_TABLE table=default.Table_00d654600a8a474d84c1678c529d4489 [id=9776f24641614e23a1ea878c6aad0efa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:07.695317 986 leader_election.cc:343] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:07.699931 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 120123us
I20260617 07:53:07.702200 1631 raft_consensus.cc:515] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.704797 893 tablet_service.cc:1511] Processing CreateTablet for tablet 361845f7627b4b9f8481b4a66bc53e9c (DEFAULT_TABLE table=default.Table_b12221b517d346f3adec5874b70f1eb6 [id=f00addaaab9440a3a70bf54d62a94cd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.704879 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8388648475499db50cc16a7c36775a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:07.705557 986 leader_election.cc:343] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.707826 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9ace137c4e496fafac4e729718577f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.709702 1364 leader_election.cc:290] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.711707 1400 raft_consensus.cc:493] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.711877 1400 raft_consensus.cc:515] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.712486 1047 raft_consensus.cc:2468] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:07.712942 754 tablet_service.cc:1511] Processing CreateTablet for tablet 369442b72f754ee08dc6a484d51f2e99 (DEFAULT_TABLE table=default.Table_8d97f61ab92d44008502cff52c36b89d [id=f0165435692349baa81584520f068a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.714229 1400 leader_election.cc:290] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:07.714495 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69996eb4ab6e40f9b2d97e00d766822a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:07.715210 1048 raft_consensus.cc:3060] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.707331 1632 raft_consensus.cc:697] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:07.715764 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4681e8e3f1174b299d89ec541ca8e6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.717964 1172 tablet_bootstrap.cc:654] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:07.724159 1048 raft_consensus.cc:2468] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:07.727391 1170 ts_tablet_manager.cc:1929] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:07.727810 1170 log.cc:1199] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/4d9d9ed003c64b1abed6bd3bb14456cd
I20260617 07:53:07.728693 1170 ts_tablet_manager.cc:1950] T 4d9d9ed003c64b1abed6bd3bb14456cd P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:07.735075 1634 leader_election.cc:290] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.735554 1661 tablet.cc:1724] T 875962c2e27a4ee1b9889769d53022cc P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 07:53:07.737089 852 leader_election.cc:343] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:07.738931 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f6264adc3994c22864ea73106ba2320 consensus state has no leader
I20260617 07:53:07.740445 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 7f7611958cf143438497c93f5f2bc098
W20260617 07:53:07.741521 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 121339ab4842432e9fb7bc357750f8ad consensus state has no leader
I20260617 07:53:07.742399 882 tablet_service.cc:1511] Processing CreateTablet for tablet 037539021d1743bb9a66403b8a01662f (DEFAULT_TABLE table=default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.745121 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.736729 851 leader_election.cc:304] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:07.746143 1631 leader_election.cc:290] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:07.735420 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 311) took 1871 ms. Trace:
I20260617 07:53:07.754451 1170 rpcz_store.cc:276] 0617 07:53:05.863923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.864051 (+ 128us) service_pool.cc:224] Handling call
0617 07:53:07.609867 (+1745816us) ts_tablet_manager.cc:1151] Deleting tablet 4d9d9ed003c64b1abed6bd3bb14456cd
0617 07:53:07.609878 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:07.714471 (+104593us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:07.727172 (+ 12701us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:07.735289 (+ 8117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1717578}
I20260617 07:53:07.755527 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 4d9d9ed003c64b1abed6bd3bb14456cd (table default.Table_b80fd4d4286241409493bc531eb7fef8 [id=778d846ba4124b08a28bb83a2777841e]) successfully deleted
I20260617 07:53:07.755679 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_9061fb221e90420b87825b0ea482cf1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:07.755787 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_34fb38a5ef96468bbf08872ea10e8a5f" } modify_external_catalogs: true
I20260617 07:53:07.755990 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_34fb38a5ef96468bbf08872ea10e8a5f" } modify_external_catalogs: true
W20260617 07:53:07.756369 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9061fb221e90420b87825b0ea482cf1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.756609 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0b705f18dfe34487821e76d515b4a2be" } modify_external_catalogs: true
I20260617 07:53:07.756815 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_0b705f18dfe34487821e76d515b4a2be" } modify_external_catalogs: true
I20260617 07:53:07.757030 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f8602b87a20455884c16196a901d335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.704761 741 tablet_service.cc:1511] Processing CreateTablet for tablet cb0ff0f0426440fba477a3dc4d1644e0 (DEFAULT_TABLE table=default.Table_45a2812670d9436a960744648a856ec8 [id=cb04083073d5491a9866d8c59d51a5e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.758605 1172 tablet_bootstrap.cc:492] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:07.758977 1172 ts_tablet_manager.cc:1403] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.120s user 0.006s sys 0.003s
I20260617 07:53:07.759169 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_43006192468f4543a9781c8787493737" } new_table_name: "default.Table_35ca50ee926746e499128390bf83c078" modify_external_catalogs: true
I20260617 07:53:07.760950 1172 raft_consensus.cc:359] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.763182 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 074a3e08cc9a4be891016ce197a993be with delete_type TABLET_DATA_DELETED (replaced by tablet cc4d21f9ad9543b0b90fc66f1a6e3b13) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.763226 1172 raft_consensus.cc:385] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:07.764226 1172 raft_consensus.cc:740] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:07.766724 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f51c76d93674a91b5ada7821393020a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.764851 752 tablet_service.cc:1511] Processing CreateTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 (DEFAULT_TABLE table=default.Table_ddca8eb1aba6417a8cb8a723dd38551b [id=ab7b996d094f49df9532f308d8615d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.768896 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11794aa70824476e9751a41ab305cc80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.769397 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3b5cb887da4d86bdc3d69f350fdb40" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:07.770205 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9618a5c0c9dd4c368f5763c434f70da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.770655 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d682ae37d74b4b967da0f8e2de6301" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:07.770993 852 leader_election.cc:343] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.775089 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55d63a25a2845dbbcce20e560361007. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:07.778429 986 leader_election.cc:343] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:07.778748 986 leader_election.cc:343] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:07.778966 986 leader_election.cc:343] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.780871 1170 tablet_replica.cc:333] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:07.779253 1172 consensus_queue.cc:260] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:07.791915 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee5ddac997834e97a2d6c9b1855ee4e8 consensus state has no leader
I20260617 07:53:07.792785 1584 catalog_manager.cc:1294] Loaded cluster ID: 6a36b51fde3b4c70a9a0683607c17859
I20260617 07:53:07.792870 1584 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: loading cluster ID for follower catalog manager: success
I20260617 07:53:07.793917 530 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ccf7f07441954d35916890efbfa4d836 (table default.Table_d7a2cf493ddd427c9087f6b6b1971450 [id=8b962c8429894c52a1ba7296a6f02205]). Expected version 2 got 0
I20260617 07:53:07.794212 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_be503ca177d549f6a02bc394edcc4fe7" } modify_external_catalogs: true
I20260617 07:53:07.794409 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_be503ca177d549f6a02bc394edcc4fe7" } modify_external_catalogs: true
I20260617 07:53:07.794363 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_2eb65c0d123846f1804e668fde8d23f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.794968 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2eb65c0d123846f1804e668fde8d23f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.795411 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_67181344e3b04622865d4584952c600e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.795899 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67181344e3b04622865d4584952c600e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:07.796281 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a2f21861cb6f481eae968edc733e6e6f consensus state has no leader
I20260617 07:53:07.797005 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_664d31b291bf448b98ad89d939ce5477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.797452 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_664d31b291bf448b98ad89d939ce5477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.803778 1631 raft_consensus.cc:2804] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:07.803785 851 leader_election.cc:304] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:07.804477 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc3d13d519843a9bc38e97dc85b67c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:07.806980 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 57760.7us
I20260617 07:53:07.811245 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 11794aa70824476e9751a41ab305cc80
I20260617 07:53:07.811548 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 5dcfb101cf51487692ef9a6a17f40804
I20260617 07:53:07.815326 1634 raft_consensus.cc:2804] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:07.816262 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 65bf5384ec244d36ba3d4e781c5eb8a3
I20260617 07:53:07.817410 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_ff5da22e90ab459a82b09212016eeb52" } new_table_name: "default.Table_f4b27f0c168e4788986ff63a8dbca936" modify_external_catalogs: true
I20260617 07:53:07.818594 760 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.819499 760 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.819520 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_bfa59190ca144c4d9d0cbab7a39eef9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.820133 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfa59190ca144c4d9d0cbab7a39eef9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.820315 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.821593 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 74ab8e93e3fe475ba9c7b5fce390a8ab
I20260617 07:53:07.821772 1175 ts_tablet_manager.cc:1950] T c3a29aeb0a224cabb642f4100c44b8f3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:07.822291 760 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdf8f714539449d8862cd2a2336fbe9 (DEFAULT_TABLE table=default.Table_c918313039f74feabcd522092350ffa1 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.823392 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361845f7627b4b9f8481b4a66bc53e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.825390 852 leader_election.cc:304] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:07.815461 1657 raft_consensus.cc:493] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:07.829873 1299 raft_consensus.cc:2749] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:07.829965 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 92475.3us
W20260617 07:53:07.831691 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c58bbdbf59c7426c8adbbbe3f0aafaed consensus state has no leader
I20260617 07:53:07.834280 1634 raft_consensus.cc:697] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:07.836057 1631 raft_consensus.cc:697] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:07.838737 1633 raft_consensus.cc:515] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.815410 1632 consensus_queue.cc:237] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.840612 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe290e33b5145b6a2831de3d37599b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.848188 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 305) took 1896 ms. Trace:
I20260617 07:53:07.853464 1175 rpcz_store.cc:276] 0617 07:53:05.951359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.951555 (+ 196us) service_pool.cc:224] Handling call
0617 07:53:06.937525 (+985970us) ts_tablet_manager.cc:1151] Deleting tablet c3a29aeb0a224cabb642f4100c44b8f3
0617 07:53:06.937649 (+ 124us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:06.967086 (+ 29437us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:07.528589 (+561503us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:07.848093 (+319504us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":985543}
I20260617 07:53:07.855037 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet c3a29aeb0a224cabb642f4100c44b8f3 (table default.Table_8fa833038123494b9119b22687fe004a [id=c94c06472dc34885962dd964aa186105]) successfully deleted
I20260617 07:53:07.856460 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb0ff0f0426440fba477a3dc4d1644e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:07.861073 852 leader_election.cc:343] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.862735 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f67a6c1dcf4a69842452c371a9c078" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:07.862972 1048 raft_consensus.cc:3060] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:07.867751 988 leader_election.cc:343] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:07.868464 988 leader_election.cc:304] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:07.868925 1400 raft_consensus.cc:2749] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:07.870764 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.870921 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.871008 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.872717 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:07.841046 1634 consensus_queue.cc:237] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:07.876926 713 consensus_peers.cc:597] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d9d9ed003c64b1abed6bd3bb14456cd. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:07.877458 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69996eb4ab6e40f9b2d97e00d766822a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:07.878472 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f67a6c1dcf4a69842452c371a9c078" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:07.877235 529 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet b7d9354c81df42fb9756045e659be26d (table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c]). Expected version 2 got 0
I20260617 07:53:07.882443 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14a3cb5e50b42b18ffda6f38cdfdd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.883538 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037539021d1743bb9a66403b8a01662f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.885149 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 770a5216299842b890d483ca37b0ee86 (DEFAULT_TABLE table=default.Table_8e5edb393db8438abed9a541c820e07a [id=dd897f18c75c4eb3a3e593672b437bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.886639 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488cc3a082b14dee8f70153e6f2925a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.861807 1631 consensus_queue.cc:237] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.887989 1048 raft_consensus.cc:2468] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:07.888590 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770a5216299842b890d483ca37b0ee86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.889921 1633 leader_election.cc:290] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:07.891222 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be19ece3a0a4a51abad7b8e2f3b2420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.891445 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f8492f127243eca07b2ffbabddded5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.904417 1172 ts_tablet_manager.cc:1434] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.145s user 0.001s sys 0.004s
I20260617 07:53:07.905906 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a460aee4eb514a87b272c4fc858335e7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:07.906272 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a900aecf46e4430cb7ccdecd54376193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.907897 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5364dfe28b8d4042941c8d8d4d1cf503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.908010 1178 tablet_bootstrap.cc:492] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:07.908953 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369442b72f754ee08dc6a484d51f2e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.909065 1178 ts_tablet_manager.cc:1403] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.445s user 0.010s sys 0.007s
I20260617 07:53:07.910610 851 leader_election.cc:304] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:07.910637 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f030d59f4e124f64bb62d05f0bb0f560" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:07.910549 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c7ced951c34afa8dff243d275bfb36" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:07.911098 1633 raft_consensus.cc:2804] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:07.911237 1633 raft_consensus.cc:697] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:07.911545 1633 consensus_queue.cc:237] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:07.912968 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.913524 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdf8f714539449d8862cd2a2336fbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.916278 1170 raft_consensus.cc:2243] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:07.916607 1170 raft_consensus.cc:2272] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:07.917433 1170 ts_tablet_manager.cc:1916] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:07.910526 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6264adc3994c22864ea73106ba2320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.920148 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f9bace06e34602acc7fcd7501b3671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.929185 524 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet b7d9354c81df42fb9756045e659be26d (table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c]). Expected version 2 got 0
I20260617 07:53:07.929304 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037539021d1743bb9a66403b8a01662f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.930035 1172 tablet_bootstrap.cc:492] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:07.931684 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.931733 1172 tablet_bootstrap.cc:654] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:07.931746 1171 tablet_bootstrap.cc:654] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:07.934340 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074a3e08cc9a4be891016ce197a993be" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:07.941357 716 leader_election.cc:343] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:07.941319 751 tablet_service.cc:1511] Processing CreateTablet for tablet 770a5216299842b890d483ca37b0ee86 (DEFAULT_TABLE table=default.Table_8e5edb393db8438abed9a541c820e07a [id=dd897f18c75c4eb3a3e593672b437bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:07.941622 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 309) took 1714 ms. Trace:
I20260617 07:53:07.942853 716 leader_election.cc:304] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:07.943742 1598 raft_consensus.cc:3060] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:07.943846 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_3feac2a6e61848588a7739fe7f28171b" } new_table_name: "default.Table_09ed725f843f4ae09d3c74af68112a46" modify_external_catalogs: true
I20260617 07:53:07.945266 1175 rpcz_store.cc:276] 0617 07:53:06.205328 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.205406 (+ 78us) service_pool.cc:224] Handling call
0617 07:53:07.855246 (+1649840us) ts_tablet_manager.cc:1151] Deleting tablet 245cff69d83b43e98b1c72b8d3011347
0617 07:53:07.855350 (+ 104us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:07.919274 (+ 63924us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1649493}
W20260617 07:53:07.945873 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 245cff69d83b43e98b1c72b8d3011347 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 245cff69d83b43e98b1c72b8d3011347 already in progress: creating tablet
I20260617 07:53:07.947568 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a9de59c0e19946de8df23f1869eab317" } modify_external_catalogs: true
I20260617 07:53:07.947611 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_5b88147f546b4b2c8ae67da7ca3ecce8" } new_table_name: "default.Table_d175a3c6daf849a68772a50df0940f7e" modify_external_catalogs: true
I20260617 07:53:07.947804 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a9de59c0e19946de8df23f1869eab317" } modify_external_catalogs: true
I20260617 07:53:07.948117 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_971d911bece54aee98e3b98f349f0aad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.948791 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_971d911bece54aee98e3b98f349f0aad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:07.834518 1657 raft_consensus.cc:515] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:07.953418 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 630e540a77374c11895ab5a0e394b3bb consensus state has no leader
I20260617 07:53:07.956483 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770a5216299842b890d483ca37b0ee86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.956658 1175 tablet_replica.cc:333] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:07.956974 1175 raft_consensus.cc:2243] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:07.957161 1175 raft_consensus.cc:2272] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:07.957759 1175 ts_tablet_manager.cc:1916] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:07.957845 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e55d63a25a2845dbbcce20e560361007 consensus state has no leader
I20260617 07:53:07.958730 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.958843 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58bbdbf59c7426c8adbbbe3f0aafaed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.959228 1657 leader_election.cc:290] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:07.959872 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc3d13d519843a9bc38e97dc85b67c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:07.960107 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.960368 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.960388 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd63aa802164f25aca72bea45ea3b96" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:07.960625 1048 raft_consensus.cc:2468] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:07.967721 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4996cde4d1514aa081257c802339abe6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:07.971822 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:07.976595 1584 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: acquiring CA information for follower catalog manager: success
I20260617 07:53:07.976681 1598 raft_consensus.cc:2749] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:07.961774 1178 raft_consensus.cc:359] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:07.983794 1178 raft_consensus.cc:385] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:07.985491 1178 raft_consensus.cc:740] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:07.986977 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a] alter complete (version 1)
I20260617 07:53:07.997906 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_30348a000daf4ff5b621f97ed5766bd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:07.998020 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_241a0fade3d14d01ae5af76abbb7480b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:07.998559 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30348a000daf4ff5b621f97ed5766bd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:07.998721 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_241a0fade3d14d01ae5af76abbb7480b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.000407 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d682ae37d74b4b967da0f8e2de6301" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.001137 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8388648475499db50cc16a7c36775a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.001932 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f51c76d93674a91b5ada7821393020a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.002185 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3b5cb887da4d86bdc3d69f350fdb40" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.002400 879 tablet_service.cc:1511] Processing CreateTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 (DEFAULT_TABLE table=default.Table_665c19b8c9d14ccc9f5beb633b690e13 [id=3ab32aa970c24c1bbde1768b3defee07]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:08.003973 988 leader_election.cc:343] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.004138 988 leader_election.cc:304] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:08.004266 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_ee7079d18a5b466aacf7a9c709ae6dc8" } new_table_name: "default.Table_7c3a47f37c184835aa2758f4f5f69c6d" modify_external_catalogs: true
W20260617 07:53:08.004563 988 leader_election.cc:343] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.004700 988 leader_election.cc:304] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:08.004832 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_872caaea54e048e697337c5c43b80a92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.005033 988 leader_election.cc:343] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.005143 988 leader_election.cc:304] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:08.005355 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_872caaea54e048e697337c5c43b80a92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.006002 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_29487528287c44c0bdddf8d719e80f08" } new_table_name: "default.Table_010f16ad25e74ae9a880163fe9e08de8" modify_external_catalogs: true
I20260617 07:53:08.007086 1400 raft_consensus.cc:2749] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.007118 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_3c03bf27d19849b7a595ecc26c80f3ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:08.007273 1400 raft_consensus.cc:2749] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.007447 1400 raft_consensus.cc:2749] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:08.007625 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c03bf27d19849b7a595ecc26c80f3ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.008584 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5939ce898cc14175961237f56bde80ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.009068 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5939ce898cc14175961237f56bde80ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.009011 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_9f97b99a0ab74a3782a8dfa84db280cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.009433 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f97b99a0ab74a3782a8dfa84db280cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.010572 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_f8e68ee7c0bf43b08f9c84454484121d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.011034 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8e68ee7c0bf43b08f9c84454484121d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.012563 1584 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260617 07:53:08.016698 1641 tablet.cc:1724] T 875962c2e27a4ee1b9889769d53022cc P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:08.018187 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_23ed3b6c37b74f85b9c3318bce131332"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.018725 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23ed3b6c37b74f85b9c3318bce131332 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.019105 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd63aa802164f25aca72bea45ea3b96" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:08.019776 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1dc0449b6b954c8c9b7bb09011250560" } modify_external_catalogs: true
I20260617 07:53:08.019971 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_1dc0449b6b954c8c9b7bb09011250560" } modify_external_catalogs: true
I20260617 07:53:08.023387 1178 consensus_queue.cc:260] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.036404 1178 ts_tablet_manager.cc:1434] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.127s user 0.000s sys 0.002s
I20260617 07:53:08.036707 1178 tablet_bootstrap.cc:492] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:08.037760 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98f7c3f6260c4db690de1a5081bb2493 consensus state has no leader
I20260617 07:53:08.038133 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_36ea1c171ce8494897cb86719e457f33" } modify_external_catalogs: true
I20260617 07:53:08.038313 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_36ea1c171ce8494897cb86719e457f33" } modify_external_catalogs: true
I20260617 07:53:08.038998 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_57d8a7f4af774adeb25c6a592b0c0800" } modify_external_catalogs: true
I20260617 07:53:08.039233 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c618c8ab0c5b498eb1aebd26c42d9c10" } modify_external_catalogs: true
I20260617 07:53:08.039294 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_57d8a7f4af774adeb25c6a592b0c0800" } modify_external_catalogs: true
I20260617 07:53:08.039404 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c618c8ab0c5b498eb1aebd26c42d9c10" } modify_external_catalogs: true
I20260617 07:53:08.040015 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_756b170c14cc49d98931f11bde48bfc6" } new_table_name: "default.Table_187d6ce1f72947bead15cb026aa308cb" modify_external_catalogs: true
I20260617 07:53:08.041201 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_2f40c198682e49768bee2d6a87292d46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.041780 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f40c198682e49768bee2d6a87292d46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:08.041848 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbc79cfa11e342bd87da1aa03847c3cb consensus state has no leader
I20260617 07:53:08.056557 889 tablet_service.cc:1511] Processing CreateTablet for tablet 5f8602b87a20455884c16196a901d335 (DEFAULT_TABLE table=default.Table_e01c4bf739194d638e2a3988702d4cfb [id=87e7c45adff04a7eb2c6edf0b75a047c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:08.057962 716 consensus_peers.cc:597] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d9d9ed003c64b1abed6bd3bb14456cd. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:08.058203 851 leader_election.cc:304] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:08.061571 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 97420.8us
I20260617 07:53:08.062065 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f8602b87a20455884c16196a901d335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.062405 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5364dfe28b8d4042941c8d8d4d1cf503. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:08.064639 852 leader_election.cc:343] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:08.067828 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 63186us
W20260617 07:53:08.068264 852 leader_election.cc:343] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.071538 1657 raft_consensus.cc:2804] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 07:53:08.076108 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84f498f551ff4767bd16628b03f55ae2 consensus state has no leader
I20260617 07:53:08.076565 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet ddc0439f992048358f1de4381516e543
I20260617 07:53:08.080328 749 tablet_service.cc:1558] Processing DeleteTablet for tablet ddc0439f992048358f1de4381516e543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.080585 894 tablet_service.cc:1511] Processing CreateTablet for tablet a02dbb70eec84932917ef282fdae0bd7 (DEFAULT_TABLE table=default.Table_fceae19017b24062acf8baff4d043ec9 [id=1a61bbe203b44d6d89dbc71a84fc3917]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:08.082201 852 leader_election.cc:343] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.088406 1657 raft_consensus.cc:493] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:08.088673 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet ddc0439f992048358f1de4381516e543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.088896 1170 ts_tablet_manager.cc:1929] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:08.089051 1170 log.cc:1199] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a460aee4eb514a87b272c4fc858335e7
W20260617 07:53:08.089326 852 leader_election.cc:343] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:08.091013 988 leader_election.cc:343] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.091167 988 leader_election.cc:304] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:08.091604 988 leader_election.cc:343] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.091740 988 leader_election.cc:304] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:08.092105 988 leader_election.cc:343] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.092232 988 leader_election.cc:304] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:08.092555 988 leader_election.cc:343] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.092686 988 leader_election.cc:304] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:08.093006 1272 raft_consensus.cc:2749] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.093214 1272 raft_consensus.cc:2749] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.093438 1272 raft_consensus.cc:2749] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.093624 1272 raft_consensus.cc:2749] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.095140 881 tablet_service.cc:1511] Processing CreateTablet for tablet e55d63a25a2845dbbcce20e560361007 (DEFAULT_TABLE table=default.Table_5b88147f546b4b2c8ae67da7ca3ecce8 [id=65758195b79f43a2954a2c3371d757c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.096698 1657 raft_consensus.cc:3060] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:08.102015 882 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe290e33b5145b6a2831de3d37599b9 (DEFAULT_TABLE table=default.Table_66c2a830c5a94c0c9f70f12f18100bd5 [id=4f545023638349f686a11acaade9abfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.099133 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02dbb70eec84932917ef282fdae0bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.103434 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55d63a25a2845dbbcce20e560361007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.103791 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe290e33b5145b6a2831de3d37599b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.104549 1170 ts_tablet_manager.cc:1950] T a460aee4eb514a87b272c4fc858335e7 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:08.104981 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3aa1c1fdede041d28570b85e63c401b7 consensus state has no leader
I20260617 07:53:08.105435 1178 tablet_bootstrap.cc:654] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.110777 1172 tablet_bootstrap.cc:492] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:08.110941 1172 ts_tablet_manager.cc:1403] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.181s user 0.002s sys 0.007s
W20260617 07:53:08.113435 986 consensus_peers.cc:597] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:08.111711 1172 raft_consensus.cc:359] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.113878 1172 raft_consensus.cc:385] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.113986 1172 raft_consensus.cc:740] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.114217 1172 consensus_queue.cc:260] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.114763 1172 ts_tablet_manager.cc:1434] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:08.116950 1172 tablet_bootstrap.cc:492] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:08.131105 1178 tablet_bootstrap.cc:492] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:08.132769 1178 ts_tablet_manager.cc:1403] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.000s
I20260617 07:53:08.134887 1178 raft_consensus.cc:359] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.135118 1178 raft_consensus.cc:385] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.135198 1178 raft_consensus.cc:740] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.135469 1178 consensus_queue.cc:260] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.152235 880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 359) took 1355 ms. Trace:
I20260617 07:53:08.152696 743 tablet_service.cc:1511] Processing CreateTablet for tablet 804126f8451e42748b26c43e31a2a1c4 (DEFAULT_TABLE table=default.Table_9061fb221e90420b87825b0ea482cf1a [id=d8f0c133a75845159f82ac3ea8322ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.153134 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804126f8451e42748b26c43e31a2a1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.156741 1178 ts_tablet_manager.cc:1434] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260617 07:53:08.157783 751 tablet_service.cc:1511] Processing CreateTablet for tablet b7d4fc81456445518c1158f912dd2f8f (DEFAULT_TABLE table=default.Table_7c71fb4276494d539fb7ccb468f0e300 [id=18b40cd6665e42f793ddb27a1dacbe73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.157920 759 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4f81daf583464e988521e189ca39b6 (DEFAULT_TABLE table=default.Table_7922639f29994091bdceabbc831c9a02 [id=04c31437a9c64c26bcd92c5749a6937a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.158242 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d4fc81456445518c1158f912dd2f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.158914 760 tablet_service.cc:1511] Processing CreateTablet for tablet f5053b7c24964dee880890fbb803ce7b (DEFAULT_TABLE table=default.Table_a324b6c42b014d8c97cc1dec8d9d8ca6 [id=7a56001e416e4428ae182d851d149550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.159334 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5053b7c24964dee880890fbb803ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.159484 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 570ae1e189a64da6bad10156b401ec46
I20260617 07:53:08.160471 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 570ae1e189a64da6bad10156b401ec46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.163435 748 tablet_service.cc:1558] Processing DeleteTablet for tablet f345910256784d2085cb81473534dcaf with delete_type TABLET_DATA_DELETED (replaced by tablet 570ae1e189a64da6bad10156b401ec46) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.164296 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_363a5452c7af426995b20c5f3786760e" } new_table_name: "default.Table_849fe4b41f7c48b8a8619a4f5f78e368" modify_external_catalogs: true
I20260617 07:53:08.164343 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5cf044f7f8984fdc9c0ea0f028992063"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:08.164482 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4f81daf583464e988521e189ca39b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:08.164964 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cf044f7f8984fdc9c0ea0f028992063 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.171986 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 787467c65f68442aad071df16d4492f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.175676 890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 379) took 1058 ms. Trace:
I20260617 07:53:08.166862 880 rpcz_store.cc:276] 0617 07:53:06.769050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.769113 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:07.004288 (+235175us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:07.004324 (+ 36us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.052755 (+1048431us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.124574 (+ 71819us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.124726 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816}
I20260617 07:53:08.188828 1178 tablet_bootstrap.cc:492] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:08.190726 1670 log.cc:927] Time spent T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260617 07:53:08.191148 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 350) took 1657 ms. Trace:
I20260617 07:53:08.191274 897 rpcz_store.cc:276] 0617 07:53:06.517867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.517923 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:06.771431 (+253508us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:06.771461 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:07.901873 (+1130412us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.152728 (+250855us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.175559 (+ 22831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.193099 890 rpcz_store.cc:276] 0617 07:53:07.117461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.170970 (+ 53509us) service_pool.cc:224] Handling call
0617 07:53:07.229979 (+ 59009us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:07.230010 (+ 31us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:07.948943 (+718933us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.163203 (+214260us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.175638 (+ 12435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.193356 1171 tablet_bootstrap.cc:492] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:08.197320 1175 ts_tablet_manager.cc:1929] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:08.198648 760 tablet_service.cc:1511] Processing CreateTablet for tablet 4e700810cd024dacbadd9ab109d0d87c (DEFAULT_TABLE table=default.Table_2e08b8585e3744a486d5d2c7c227a6c5 [id=a5edc6ed0cb14a0ca2714894a6852ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.205214 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e700810cd024dacbadd9ab109d0d87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.200690 745 tablet_service.cc:1511] Processing CreateTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e (DEFAULT_TABLE table=default.Table_69167a2936fa47a08d1f53dfec14f52b [id=8738ee5e888742f9a7c0aa0c9085dc75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.204581 759 tablet_service.cc:1511] Processing CreateTablet for tablet e03a26e301e747febc4d5bafdc1a49c6 (DEFAULT_TABLE table=default.Table_e90ad53742c6427a87f6e2dfad5f9e54 [id=30f9fa100b704eb9bbc9a42cd664a4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.209215 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 95865af94c04410386d23cb369180611
I20260617 07:53:08.209546 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03a26e301e747febc4d5bafdc1a49c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.209769 1169 ts_tablet_manager.cc:1929] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:08.209903 1169 log.cc:1199] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/074a3e08cc9a4be891016ce197a993be
I20260617 07:53:08.210070 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 0fd8cedb539748dc917128511325bbcc
I20260617 07:53:08.211046 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet df37ed81b17d4178adeb6057491b4cc9
I20260617 07:53:08.213186 1171 ts_tablet_manager.cc:1403] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.771s user 0.000s sys 0.023s
I20260617 07:53:08.214704 890 tablet_service.cc:1511] Processing CreateTablet for tablet f14a3cb5e50b42b18ffda6f38cdfdd73 (DEFAULT_TABLE table=default.Table_95bb54209dbf45bb9b38c213a85eb101 [id=be8b1cef0a134635b8eac9b44b5bf75f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.215026 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.215327 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.216955 753 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.197057 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b7a457c62ae64ddbb5d85988bd2992bc" } new_table_name: "default.Table_528f3acf30374a4d83a514a59fda209b" modify_external_catalogs: true
I20260617 07:53:08.219583 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e757e6f4ce4c6eb8223c4b6955245e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.221855 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_7ef78d5066e74ed18eb032a94d98e708"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.222373 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ef78d5066e74ed18eb032a94d98e708 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.223807 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_85c6acc2e0744783bfa3d2f6f6162552"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.224287 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85c6acc2e0744783bfa3d2f6f6162552 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.224328 1175 log.cc:1199] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a5b7b95327604ef8b43944c4821d4ed7
I20260617 07:53:08.224784 1175 ts_tablet_manager.cc:1950] T a5b7b95327604ef8b43944c4821d4ed7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:08.225607 880 tablet_service.cc:1511] Processing CreateTablet for tablet 11794aa70824476e9751a41ab305cc80 (DEFAULT_TABLE table=default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.226878 897 tablet_service.cc:1511] Processing CreateTablet for tablet a900aecf46e4430cb7ccdecd54376193 (DEFAULT_TABLE table=default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.227808 896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 347) took 1671 ms. Trace:
I20260617 07:53:08.228615 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 352) took 1673 ms. Trace:
I20260617 07:53:08.226341 1178 tablet_bootstrap.cc:654] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.228719 887 rpcz_store.cc:276] 0617 07:53:06.535984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.536086 (+ 102us) service_pool.cc:224] Handling call
0617 07:53:06.771554 (+235468us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:06.771583 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:07.880705 (+1109122us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.207521 (+326816us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.207684 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4096}
I20260617 07:53:08.230499 887 tablet_service.cc:1511] Processing CreateTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 (DEFAULT_TABLE table=default.Table_00d654600a8a474d84c1678c529d4489 [id=9776f24641614e23a1ea878c6aad0efa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:08.230706 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2777cf575a914f59b3459f3ce96f5d9a consensus state has no leader
I20260617 07:53:08.231980 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 376) took 1070 ms. Trace:
I20260617 07:53:08.233665 896 rpcz_store.cc:276] 0617 07:53:06.506846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.537138 (+ 30292us) service_pool.cc:224] Handling call
0617 07:53:06.771717 (+234579us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:06.771744 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:07.964354 (+1192610us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.163657 (+199303us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.178692 (+ 15035us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11008}
I20260617 07:53:08.236068 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 804126f8451e42748b26c43e31a2a1c4 (DEFAULT_TABLE table=default.Table_9061fb221e90420b87825b0ea482cf1a [id=d8f0c133a75845159f82ac3ea8322ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.235960 886 rpcz_store.cc:276] 0617 07:53:07.114622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.253946 (+139324us) service_pool.cc:224] Handling call
0617 07:53:07.573537 (+319591us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:07.573560 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:07.839807 (+266247us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.184561 (+344754us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.184730 (+ 169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.237744 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 315) took 1995 ms. Trace:
I20260617 07:53:08.238296 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14a3cb5e50b42b18ffda6f38cdfdd73. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:08.238957 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 84574.2us
I20260617 07:53:08.239816 1175 rpcz_store.cc:276] 0617 07:53:06.242239 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.242299 (+ 60us) service_pool.cc:224] Handling call
0617 07:53:07.945896 (+1703597us) ts_tablet_manager.cc:1151] Deleting tablet a5b7b95327604ef8b43944c4821d4ed7
0617 07:53:07.949500 (+ 3604us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.099620 (+150120us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.197240 (+ 97620us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.237661 (+ 40421us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1703354}
I20260617 07:53:08.240118 1169 ts_tablet_manager.cc:1950] T 074a3e08cc9a4be891016ce197a993be P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:08.240176 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4f81daf583464e988521e189ca39b6 (DEFAULT_TABLE table=default.Table_7922639f29994091bdceabbc831c9a02 [id=04c31437a9c64c26bcd92c5749a6937a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.241753 1025 tablet_service.cc:1511] Processing CreateTablet for tablet f5053b7c24964dee880890fbb803ce7b (DEFAULT_TABLE table=default.Table_a324b6c42b014d8c97cc1dec8d9d8ca6 [id=7a56001e416e4428ae182d851d149550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.242229 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 570ae1e189a64da6bad10156b401ec46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.243283 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804126f8451e42748b26c43e31a2a1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.243789 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a5b7b95327604ef8b43944c4821d4ed7 (table default.Table_5fcf50bba845478aa1765c2ac162b1c1 [id=0d961292ee114171bd682606f6df393d]) successfully deleted
I20260617 07:53:08.243963 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 with delete_type TABLET_DATA_DELETED (replaced by tablet 36ce60b466f7420992ef194d72b5718d) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.246579 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 342) took 1703 ms. Trace:
I20260617 07:53:08.246580 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_a25f1398f97f4c2b99ec71d2ce42f295"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:08.246688 895 rpcz_store.cc:276] 0617 07:53:06.506311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.515079 (+ 8768us) service_pool.cc:224] Handling call
0617 07:53:06.771954 (+256875us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:06.772006 (+ 52us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.087307 (+1315301us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.209431 (+122124us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.209571 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.246774 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_5df0947db0104ef6bb9e41fdb647e50c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.247417 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5df0947db0104ef6bb9e41fdb647e50c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.247613 895 tablet_service.cc:1511] Processing CreateTablet for tablet 369442b72f754ee08dc6a484d51f2e99 (DEFAULT_TABLE table=default.Table_8d97f61ab92d44008502cff52c36b89d [id=f0165435692349baa81584520f068a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.247967 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369442b72f754ee08dc6a484d51f2e99. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:08.248474 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a25f1398f97f4c2b99ec71d2ce42f295 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.248931 896 tablet_service.cc:1511] Processing CreateTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 (DEFAULT_TABLE table=default.Table_1f40cdfe73f54202b6223af377958372 [id=347683dc11c24e8e9f2e9eff1d671045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.249289 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_e0a022b4ea4c4845bfea835c7373a969"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:08.250641 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_ad19666d956d43a7979b4226f9645fef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.251075 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad19666d956d43a7979b4226f9645fef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.244172 1175 tablet_replica.cc:333] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:08.253468 1175 raft_consensus.cc:2243] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.253690 1175 raft_consensus.cc:2272] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.254199 1171 raft_consensus.cc:359] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.254413 1171 raft_consensus.cc:385] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.254431 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_b4b3342eed21433e8924f22e9a41989b" } new_table_name: "default.Table_688e63c9bbf3476c8925bd08ca801213" modify_external_catalogs: true
I20260617 07:53:08.254603 888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 378) took 1131 ms. Trace:
W20260617 07:53:08.255555 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0a022b4ea4c4845bfea835c7373a969 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.255606 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9618a5c0c9dd4c368f5763c434f70da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.249667 1178 tablet_bootstrap.cc:492] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:08.256359 1178 ts_tablet_manager.cc:1403] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.001s
I20260617 07:53:08.256971 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_d863711c4bc44037a3f8927442a50d68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:08.248319 751 tablet_service.cc:1511] Processing CreateTablet for tablet 7de5420edefc47ed9dcdf1eea02a22fa (DEFAULT_TABLE table=default.Table_af1642a493c54650937216698b190b90 [id=fc0975321cab41358afa6fd3d3abc1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.257540 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de5420edefc47ed9dcdf1eea02a22fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.257947 1171 raft_consensus.cc:740] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.258210 1171 consensus_queue.cc:260] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:08.260115 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d863711c4bc44037a3f8927442a50d68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.260372 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 318) took 2087 ms. Trace:
I20260617 07:53:08.261521 879 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.261770 888 rpcz_store.cc:276] 0617 07:53:07.116791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.282630 (+165839us) service_pool.cc:224] Handling call
0617 07:53:07.572457 (+289827us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:07.572486 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.123311 (+550825us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.247869 (+124558us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.248033 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.262372 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a900aecf46e4430cb7ccdecd54376193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.265540 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e (DEFAULT_TABLE table=default.Table_69167a2936fa47a08d1f53dfec14f52b [id=8738ee5e888742f9a7c0aa0c9085dc75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.265957 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5053b7c24964dee880890fbb803ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.265985 1175 ts_tablet_manager.cc:1916] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.267107 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_aed7483cd2e248e2915c153c409f86b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:08.267409 1178 raft_consensus.cc:359] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.267566 1178 raft_consensus.cc:385] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.267653 1178 raft_consensus.cc:740] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
W20260617 07:53:08.267673 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aed7483cd2e248e2915c153c409f86b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.267900 1178 consensus_queue.cc:260] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
W20260617 07:53:08.269299 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1c7ced951c34afa8dff243d275bfb36 consensus state has no leader
I20260617 07:53:08.270759 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 373) took 1160 ms. Trace:
I20260617 07:53:08.270946 1657 raft_consensus.cc:515] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.271238 760 tablet_service.cc:1511] Processing CreateTablet for tablet f1b93b31475c4f29a7fdc387ffbff0cd (DEFAULT_TABLE table=default.Table_071d2b97455544f48ec96587c227de07 [id=c271a8b75d0e471db316e09706cde9ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.271656 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b93b31475c4f29a7fdc387ffbff0cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.271684 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11794aa70824476e9751a41ab305cc80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.271595 1657 leader_election.cc:290] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:08.272683 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd63aa802164f25aca72bea45ea3b96" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:08.272856 1171 ts_tablet_manager.cc:1434] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.045s user 0.000s sys 0.002s
I20260617 07:53:08.273334 1030 tablet_service.cc:1511] Processing CreateTablet for tablet b7d4fc81456445518c1158f912dd2f8f (DEFAULT_TABLE table=default.Table_7c71fb4276494d539fb7ccb468f0e300 [id=18b40cd6665e42f793ddb27a1dacbe73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.273876 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.274953 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e757e6f4ce4c6eb8223c4b6955245e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.275159 898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 341) took 1745 ms. Trace:
I20260617 07:53:08.275256 898 rpcz_store.cc:276] 0617 07:53:06.506172 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.537116 (+ 30944us) service_pool.cc:224] Handling call
0617 07:53:06.771823 (+234707us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:06.771847 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:07.893668 (+1121821us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.251047 (+357379us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.251168 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.276458 1172 tablet_bootstrap.cc:654] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.278038 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.279490 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 4e700810cd024dacbadd9ab109d0d87c (DEFAULT_TABLE table=default.Table_2e08b8585e3744a486d5d2c7c227a6c5 [id=a5edc6ed0cb14a0ca2714894a6852ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.280439 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4f81daf583464e988521e189ca39b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.281409 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e700810cd024dacbadd9ab109d0d87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.285413 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d4fc81456445518c1158f912dd2f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.289254 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 7de5420edefc47ed9dcdf1eea02a22fa (DEFAULT_TABLE table=default.Table_af1642a493c54650937216698b190b90 [id=fc0975321cab41358afa6fd3d3abc1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.290864 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de5420edefc47ed9dcdf1eea02a22fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.290887 1023 tablet_service.cc:1511] Processing CreateTablet for tablet f1b93b31475c4f29a7fdc387ffbff0cd (DEFAULT_TABLE table=default.Table_071d2b97455544f48ec96587c227de07 [id=c271a8b75d0e471db316e09706cde9ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.293828 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b93b31475c4f29a7fdc387ffbff0cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.294020 898 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdf8f714539449d8862cd2a2336fbe9 (DEFAULT_TABLE table=default.Table_c918313039f74feabcd522092350ffa1 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.294323 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e03a26e301e747febc4d5bafdc1a49c6 (DEFAULT_TABLE table=default.Table_e90ad53742c6427a87f6e2dfad5f9e54 [id=30f9fa100b704eb9bbc9a42cd664a4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.296864 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be19ece3a0a4a51abad7b8e2f3b2420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.298413 883 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 368) took 1156 ms. Trace:
I20260617 07:53:08.298542 883 rpcz_store.cc:276] 0617 07:53:07.090813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.090979 (+ 166us) service_pool.cc:224] Handling call
0617 07:53:07.109689 (+ 18710us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:07.110536 (+ 847us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:07.923853 (+813317us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.216129 (+292276us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.247223 (+ 31094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.298967 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03a26e301e747febc4d5bafdc1a49c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.303907 1171 tablet_bootstrap.cc:492] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:08.303892 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.309525 1175 ts_tablet_manager.cc:1929] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:08.321024 1175 log.cc:1199] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/52ae3c99bec7426caac18a6e3880bf51
I20260617 07:53:08.317202 1178 ts_tablet_manager.cc:1434] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.061s user 0.000s sys 0.002s
I20260617 07:53:08.321807 1175 ts_tablet_manager.cc:1950] T 52ae3c99bec7426caac18a6e3880bf51 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:08.322391 1178 tablet_bootstrap.cc:492] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:08.326498 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 316) took 2084 ms. Trace:
I20260617 07:53:08.326679 1175 rpcz_store.cc:276] 0617 07:53:06.242344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.242576 (+ 232us) service_pool.cc:224] Handling call
0617 07:53:08.244087 (+2001511us) ts_tablet_manager.cc:1151] Deleting tablet 52ae3c99bec7426caac18a6e3880bf51
0617 07:53:08.244098 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.300370 (+ 56272us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.309435 (+ 9065us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.326456 (+ 17021us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2001306}
I20260617 07:53:08.327140 1175 tablet_replica.cc:333] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:08.327409 1175 raft_consensus.cc:2243] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.327653 1175 raft_consensus.cc:2272] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.328337 1175 ts_tablet_manager.cc:1916] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.329020 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 52ae3c99bec7426caac18a6e3880bf51 (table default.Table_549f28edd3154174b8b8bca2e1ab902e [id=2268c0662b4b43d9a38b906debf4e223]) successfully deleted
I20260617 07:53:08.330910 1178 tablet_bootstrap.cc:654] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.332005 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdf8f714539449d8862cd2a2336fbe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.334710 1169 rpcz_store.cc:276] 0617 07:53:06.164831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.165491 (+ 660us) service_pool.cc:224] Handling call
0617 07:53:06.517390 (+351899us) ts_tablet_manager.cc:1151] Deleting tablet 074a3e08cc9a4be891016ce197a993be
0617 07:53:06.517400 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:07.944176 (+1426776us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.178505 (+234329us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.252054 (+ 73549us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98069,"tablet-delete.queue_time_us":351683}
I20260617 07:53:08.335139 1169 tablet_replica.cc:333] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:08.335227 879 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.335361 1169 raft_consensus.cc:2243] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.335552 1169 raft_consensus.cc:2272] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.335860 879 tablet_service.cc:1511] Processing CreateTablet for tablet 770a5216299842b890d483ca37b0ee86 (DEFAULT_TABLE table=default.Table_8e5edb393db8438abed9a541c820e07a [id=dd897f18c75c4eb3a3e593672b437bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.336270 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770a5216299842b890d483ca37b0ee86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.339000 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.339212 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.343767 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.347571 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 360) took 1561 ms. Trace:
W20260617 07:53:08.350502 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:41615, user_credentials={real_user=slave}} blocked reactor thread for 49169.9us
I20260617 07:53:08.351323 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.352432 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.360335 877 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43894 (request call id 89) took 1869 ms. Trace:
I20260617 07:53:08.364761 888 tablet_service.cc:1558] Processing DeleteTablet for tablet ddc0439f992048358f1de4381516e543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.365362 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd63aa802164f25aca72bea45ea3b96" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:08.365794 882 tablet_service.cc:1511] Processing CreateTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 (DEFAULT_TABLE table=default.Table_ddca8eb1aba6417a8cb8a723dd38551b [id=ab7b996d094f49df9532f308d8615d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.366446 1048 raft_consensus.cc:3060] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:08.369381 891 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 372) took 1142 ms. Trace:
I20260617 07:53:08.369504 891 rpcz_store.cc:276] 0617 07:53:07.109679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.109760 (+ 81us) service_pool.cc:224] Handling call
0617 07:53:07.113443 (+ 3683us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:07.113473 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.065480 (+952007us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.235509 (+170029us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.251936 (+ 16427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.370035 891 tablet_service.cc:1511] Processing CreateTablet for tablet f5053b7c24964dee880890fbb803ce7b (DEFAULT_TABLE table=default.Table_a324b6c42b014d8c97cc1dec8d9d8ca6 [id=7a56001e416e4428ae182d851d149550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.370431 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5053b7c24964dee880890fbb803ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.371461 1048 raft_consensus.cc:2468] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:08.373819 852 leader_election.cc:343] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.373848 886 tablet_service.cc:1511] Processing CreateTablet for tablet cb0ff0f0426440fba477a3dc4d1644e0 (DEFAULT_TABLE table=default.Table_45a2812670d9436a960744648a856ec8 [id=cb04083073d5491a9866d8c59d51a5e6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:08.373984 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 97825.2us
I20260617 07:53:08.374253 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb0ff0f0426440fba477a3dc4d1644e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.374991 1169 ts_tablet_manager.cc:1916] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.375201 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 074a3e08cc9a4be891016ce197a993be (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]) successfully deleted
I20260617 07:53:08.376566 892 rpcz_store.cc:276] 0617 07:53:07.111301 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.111563 (+ 262us) service_pool.cc:224] Handling call
0617 07:53:07.126107 (+ 14544us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:07.126136 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.156477 (+1030341us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.270591 (+114114us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.270724 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.376909 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 570ae1e189a64da6bad10156b401ec46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.377306 892 tablet_service.cc:1511] Processing CreateTablet for tablet b7d4fc81456445518c1158f912dd2f8f (DEFAULT_TABLE table=default.Table_7c71fb4276494d539fb7ccb468f0e300 [id=18b40cd6665e42f793ddb27a1dacbe73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.377671 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d4fc81456445518c1158f912dd2f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.377902 885 rpcz_store.cc:276] 0617 07:53:06.778208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.778323 (+ 115us) service_pool.cc:224] Handling call
0617 07:53:06.990407 (+212084us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:06.990447 (+ 40us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.181944 (+1191497us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.339720 (+157776us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.339856 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.380017 1675 raft_consensus.cc:493] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:08.380108 885 tablet_service.cc:1511] Processing CreateTablet for tablet 4e700810cd024dacbadd9ab109d0d87c (DEFAULT_TABLE table=default.Table_2e08b8585e3744a486d5d2c7c227a6c5 [id=a5edc6ed0cb14a0ca2714894a6852ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.380467 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e700810cd024dacbadd9ab109d0d87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.383617 875 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43894 (request call id 93) took 1341 ms. Trace:
I20260617 07:53:08.380228 1675 raft_consensus.cc:515] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.385547 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488cc3a082b14dee8f70153e6f2925a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.383737 875 rpcz_store.cc:276] 0617 07:53:07.042402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.042530 (+ 128us) service_pool.cc:224] Handling call
0617 07:53:08.090357 (+1047827us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x6160000e3e54. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1a6218c0 00007f2f1e4d2f1f 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138 0000000000aa681c
0617 07:53:08.294311 (+203954us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x616000112054. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1a6218c0 00007f2f1e4d2f1f 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138 0000000000aa681c
0617 07:53:08.365471 (+ 71160us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x61800002388c. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1bbae4be 00007f2f1b9a890c 00007f2f1e4d2d28 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138
0617 07:53:08.383565 (+ 18094us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592185344}
I20260617 07:53:08.387193 893 tablet_service.cc:1511] Processing CreateTablet for tablet e9f8492f127243eca07b2ffbabddded5 (DEFAULT_TABLE table=default.Table_77163a83bea3432b8b2ea745bef42ce8 [id=2cd57d521b8b4434b456c086f0e36de8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.388175 878 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43894 (request call id 91) took 1882 ms. Trace:
I20260617 07:53:08.388135 894 tablet_service.cc:1511] Processing CreateTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e (DEFAULT_TABLE table=default.Table_69167a2936fa47a08d1f53dfec14f52b [id=8738ee5e888742f9a7c0aa0c9085dc75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.388347 876 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43894 (request call id 92) took 1323 ms. Trace:
I20260617 07:53:08.388422 876 rpcz_store.cc:276] 0617 07:53:07.041207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.041773 (+ 566us) service_pool.cc:224] Handling call
0617 07:53:07.933540 (+891767us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x6180000c188c. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1bbae4be 00007f2f1b9a890c 00007f2f1e4d2d28 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138
0617 07:53:08.101645 (+168105us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x616000182e54. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1a6218c0 00007f2f1e4d2f1f 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138 0000000000aa681c
0617 07:53:08.294013 (+192368us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x616000112054. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1a6218c0 00007f2f1e4d2f1f 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138 0000000000aa681c
0617 07:53:08.364415 (+ 70402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298643072}
I20260617 07:53:08.390242 1675 leader_election.cc:290] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:08.392264 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d9354c81df42fb9756045e659be26d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:08.393754 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.393962 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_455c6e0722f34230977add184efbf379" } new_table_name: "default.Table_fe582a04705248b1bb25e1cc9bc1e653" modify_external_catalogs: true
W20260617 07:53:08.397231 986 leader_election.cc:343] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.398743 1675 consensus_queue.cc:1048] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:08.400406 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f8492f127243eca07b2ffbabddded5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.402105 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_d9199c2565854964a10bba9e6474732f" } new_table_name: "default.Table_836c7fa9740f4820976c85223f980368" modify_external_catalogs: true
I20260617 07:53:08.402166 760 tablet_service.cc:1558] Processing DeleteTablet for tablet a460aee4eb514a87b272c4fc858335e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:01 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.403041 883 tablet_service.cc:1511] Processing CreateTablet for tablet 804126f8451e42748b26c43e31a2a1c4 (DEFAULT_TABLE table=default.Table_9061fb221e90420b87825b0ea482cf1a [id=d8f0c133a75845159f82ac3ea8322ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.403867 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_09ed725f843f4ae09d3c74af68112a46" } modify_external_catalogs: true
I20260617 07:53:08.403949 851 leader_election.cc:304] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:08.404158 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_09ed725f843f4ae09d3c74af68112a46" } modify_external_catalogs: true
W20260617 07:53:08.404785 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d9ace137c4e496fafac4e729718577f consensus state has no leader
I20260617 07:53:08.405740 888 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4f81daf583464e988521e189ca39b6 (DEFAULT_TABLE table=default.Table_7922639f29994091bdceabbc831c9a02 [id=04c31437a9c64c26bcd92c5749a6937a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.406226 1171 tablet_bootstrap.cc:654] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.406330 1633 raft_consensus.cc:2804] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:08.406610 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_eea666288e104386986507e494503cad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.407127 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eea666288e104386986507e494503cad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.408092 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.408202 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_187d6ce1f72947bead15cb026aa308cb" } modify_external_catalogs: true
I20260617 07:53:08.386132 877 rpcz_store.cc:276] 0617 07:53:06.490506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.490722 (+ 216us) service_pool.cc:224] Handling call
0617 07:53:08.101635 (+1610913us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x616000182e54. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1a6218c0 00007f2f1e4d2f1f 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138 0000000000aa681c
0617 07:53:08.294493 (+192858us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x616000112054. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1a6218c0 00007f2f1e4d2f1f 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138 0000000000aa681c
0617 07:53:08.343727 (+ 49234us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x61800006588c. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1bbae4be 00007f2f1b9a890c 00007f2f1e4d2d28 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138
0617 07:53:08.360281 (+ 16554us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543887744}
I20260617 07:53:08.408458 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_187d6ce1f72947bead15cb026aa308cb" } modify_external_catalogs: true
I20260617 07:53:08.410149 878 rpcz_store.cc:276] 0617 07:53:06.506013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.507616 (+ 1603us) service_pool.cc:224] Handling call
0617 07:53:07.412170 (+904554us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x6160000e3e54. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1a6218c0 00007f2f1e4d2f1f 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138 0000000000aa681c
0617 07:53:07.932762 (+520592us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x6180000c188c. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1bbae4be 00007f2f1b9a890c 00007f2f1e4d2d28 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138
0617 07:53:08.098052 (+165290us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x616000182e54. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1a6218c0 00007f2f1e4d2f1f 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138 0000000000aa681c
0617 07:53:08.294555 (+196503us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x616000112054. stack: 00007f2f0e61e086 00007f2f0e61de40 00007f2f0d5d73ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f2f1a6218c0 00007f2f1e4d2f1f 00007f2f188f4c36 00007f2f188f4965 00007f2f156b688e 00007f2f156b576e 00007f2f156bb9a8 00007f2f156bc30f 00007f2f156bc138 0000000000aa681c
0617 07:53:08.388135 (+ 93580us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1985230208}
I20260617 07:53:08.410416 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 92e55be5f28740fba65c1199a571d97a from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:08.410866 1633 raft_consensus.cc:697] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:08.414258 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.415904 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c3ea195c67814080b1221735affcde43" } modify_external_catalogs: true
I20260617 07:53:08.416164 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_c3ea195c67814080b1221735affcde43" } modify_external_catalogs: true
I20260617 07:53:08.416213 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d9354c81df42fb9756045e659be26d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.416970 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_7922639f29994091bdceabbc831c9a02" } modify_external_catalogs: true
I20260617 07:53:08.417243 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_7922639f29994091bdceabbc831c9a02" } modify_external_catalogs: true
I20260617 07:53:08.417824 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_23ed3b6c37b74f85b9c3318bce131332" } modify_external_catalogs: true
I20260617 07:53:08.418033 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_23ed3b6c37b74f85b9c3318bce131332" } modify_external_catalogs: true
I20260617 07:53:08.419735 1633 consensus_queue.cc:237] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:08.424876 988 leader_election.cc:343] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.428483 525 master_service.cc:960] ReplaceTablet: received request to replace tablet 84f498f551ff4767bd16628b03f55ae2 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:08.429021 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 393) took 1033 ms. Trace:
I20260617 07:53:08.429123 897 rpcz_store.cc:276] 0617 07:53:07.394661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.191522 (+796861us) service_pool.cc:224] Handling call
0617 07:53:08.251670 (+ 60148us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.251700 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.296087 (+ 44387us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.427782 (+131695us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.427945 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.429656 897 tablet_service.cc:1511] Processing CreateTablet for tablet 7de5420edefc47ed9dcdf1eea02a22fa (DEFAULT_TABLE table=default.Table_af1642a493c54650937216698b190b90 [id=fc0975321cab41358afa6fd3d3abc1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.428474 889 tablet_service.cc:1511] Processing CreateTablet for tablet e03a26e301e747febc4d5bafdc1a49c6 (DEFAULT_TABLE table=default.Table_e90ad53742c6427a87f6e2dfad5f9e54 [id=30f9fa100b704eb9bbc9a42cd664a4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.435029 881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 391) took 1038 ms. Trace:
I20260617 07:53:08.435148 881 rpcz_store.cc:276] 0617 07:53:07.394458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.094846 (+700388us) service_pool.cc:224] Handling call
0617 07:53:08.095361 (+ 515us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.101921 (+ 6560us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.275527 (+173606us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.432455 (+156928us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.432613 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.436151 751 tablet_service.cc:1511] Processing CreateTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c (DEFAULT_TABLE table=default.Table_5cf044f7f8984fdc9c0ea0f028992063 [id=f4ba254355924d909ef34a0453ea4823]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.436633 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d965aa4e8dc244cdb93dd15cdee9070c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.437589 759 tablet_service.cc:1511] Processing CreateTablet for tablet beb8fbb44e6147be8c9605be886a8aea (DEFAULT_TABLE table=default.Table_f8e68ee7c0bf43b08f9c84454484121d [id=2ce20b981b024427aca662385456a101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.438052 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb8fbb44e6147be8c9605be886a8aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.438416 760 tablet_service.cc:1511] Processing CreateTablet for tablet 216614d066e9446f91e53d2a382b5f6e (DEFAULT_TABLE table=default.Table_7ef78d5066e74ed18eb032a94d98e708 [id=d01892eee8954a04bf0e207993e6f950]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.438814 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216614d066e9446f91e53d2a382b5f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.441874 988 leader_election.cc:304] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:08.441898 1598 raft_consensus.cc:493] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:08.425248 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 312) took 2533 ms. Trace:
I20260617 07:53:08.442024 753 tablet_service.cc:1511] Processing CreateTablet for tablet f2d846e5951d400ebc4ba6552406c63c (DEFAULT_TABLE table=default.Table_241a0fade3d14d01ae5af76abbb7480b [id=db98d137d4034f478394697f912bd3ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.442054 1598 raft_consensus.cc:515] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.442131 1170 rpcz_store.cc:276] 0617 07:53:05.892095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.893430 (+ 1335us) service_pool.cc:224] Handling call
0617 07:53:07.756538 (+1863108us) ts_tablet_manager.cc:1151] Deleting tablet a460aee4eb514a87b272c4fc858335e7
0617 07:53:07.756595 (+ 57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:07.979132 (+222537us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.063627 (+ 84495us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.425179 (+361552us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1861699}
I20260617 07:53:08.442373 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d846e5951d400ebc4ba6552406c63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.442516 1170 tablet_replica.cc:333] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:08.442732 1170 raft_consensus.cc:2243] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.436136 1026 tablet_service.cc:1511] Processing CreateTablet for tablet f2d846e5951d400ebc4ba6552406c63c (DEFAULT_TABLE table=default.Table_241a0fade3d14d01ae5af76abbb7480b [id=db98d137d4034f478394697f912bd3ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.436339 1027 tablet_service.cc:1511] Processing CreateTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c (DEFAULT_TABLE table=default.Table_5cf044f7f8984fdc9c0ea0f028992063 [id=f4ba254355924d909ef34a0453ea4823]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.442847 1598 leader_election.cc:290] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:08.443100 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d965aa4e8dc244cdb93dd15cdee9070c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.443696 1657 consensus_queue.cc:1048] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260617 07:53:08.436640 1028 tablet_service.cc:1511] Processing CreateTablet for tablet cd9777d3619743cf8df19cf93f97f50a (DEFAULT_TABLE table=default.Table_872caaea54e048e697337c5c43b80a92 [id=af0c8ea1c1d94ba1a847371952858f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.446007 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9777d3619743cf8df19cf93f97f50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.445991 748 tablet_service.cc:1511] Processing CreateTablet for tablet 1382fc75785e4b07bf1688fa5385500a (DEFAULT_TABLE table=default.Table_30348a000daf4ff5b621f97ed5766bd6 [id=52357c6af1e04f2c82768cb39fe1be8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.446332 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1382fc75785e4b07bf1688fa5385500a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.438050 745 tablet_service.cc:1511] Processing CreateTablet for tablet cd9777d3619743cf8df19cf93f97f50a (DEFAULT_TABLE table=default.Table_872caaea54e048e697337c5c43b80a92 [id=af0c8ea1c1d94ba1a847371952858f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.449666 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9777d3619743cf8df19cf93f97f50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.436985 1017 tablet_service.cc:1511] Processing CreateTablet for tablet beb8fbb44e6147be8c9605be886a8aea (DEFAULT_TABLE table=default.Table_f8e68ee7c0bf43b08f9c84454484121d [id=2ce20b981b024427aca662385456a101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.451556 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb8fbb44e6147be8c9605be886a8aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.453830 879 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.454058 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f345910256784d2085cb81473534dcaf" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.454239 879 tablet_service.cc:1511] Processing CreateTablet for tablet 216614d066e9446f91e53d2a382b5f6e (DEFAULT_TABLE table=default.Table_7ef78d5066e74ed18eb032a94d98e708 [id=d01892eee8954a04bf0e207993e6f950]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.454284 914 raft_consensus.cc:2468] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:08.456797 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d846e5951d400ebc4ba6552406c63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.458117 884 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 382) took 1301 ms. Trace:
I20260617 07:53:08.458243 884 rpcz_store.cc:276] 0617 07:53:07.125166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.424334 (+299168us) service_pool.cc:224] Handling call
0617 07:53:07.575266 (+150932us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:07.575327 (+ 61us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.239912 (+664585us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.419041 (+179129us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.426204 (+ 7163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.461314 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a460aee4eb514a87b272c4fc858335e7 (table default.Table_01592b03d24e492a9fb22885a4195c7f [id=325e591e926743a9ab92d48a1e73bf8b]) successfully deleted
I20260617 07:53:08.461876 1675 raft_consensus.cc:2749] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.465057 743 tablet_service.cc:1511] Processing CreateTablet for tablet cc1d9ce2ab5b428893719d9acd272d88 (DEFAULT_TABLE table=default.Table_971d911bece54aee98e3b98f349f0aad [id=912e818e8697427a8ce7dc146b9a428f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.465440 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc1d9ce2ab5b428893719d9acd272d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.466001 716 leader_election.cc:304] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
W20260617 07:53:08.466811 713 leader_election.cc:343] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: f345910256784d2085cb81473534dcaf
I20260617 07:53:08.467527 1598 raft_consensus.cc:2804] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:08.467806 1598 raft_consensus.cc:493] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:08.467908 1598 raft_consensus.cc:3060] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:08.470033 1170 raft_consensus.cc:2272] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.470647 1170 ts_tablet_manager.cc:1916] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.472498 1598 raft_consensus.cc:515] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.477483 1598 leader_election.cc:290] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:08.477891 1598 raft_consensus.cc:493] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:08.478123 1598 raft_consensus.cc:515] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.480013 881 tablet_service.cc:1511] Processing CreateTablet for tablet f1b93b31475c4f29a7fdc387ffbff0cd (DEFAULT_TABLE table=default.Table_071d2b97455544f48ec96587c227de07 [id=c271a8b75d0e471db316e09706cde9ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.480530 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e757e6f4ce4c6eb8223c4b6955245e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.481873 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b93b31475c4f29a7fdc387ffbff0cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.482929 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03a26e301e747febc4d5bafdc1a49c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.483510 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804126f8451e42748b26c43e31a2a1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.484112 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de5420edefc47ed9dcdf1eea02a22fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:08.485630 716 leader_election.cc:343] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 787467c65f68442aad071df16d4492f3
I20260617 07:53:08.486146 1598 leader_election.cc:290] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:08.487169 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f345910256784d2085cb81473534dcaf" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:08.487377 914 raft_consensus.cc:3060] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:08.489427 884 tablet_service.cc:1511] Processing CreateTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c (DEFAULT_TABLE table=default.Table_5cf044f7f8984fdc9c0ea0f028992063 [id=f4ba254355924d909ef34a0453ea4823]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.491026 745 tablet_service.cc:1511] Processing CreateTablet for tablet 24ba13170e864dfa96cddfb1a76b8c40 (DEFAULT_TABLE table=default.Table_bfa59190ca144c4d9d0cbab7a39eef9c [id=214df2f2d641469c91a78dfd5bb3aba8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:08.492193 713 leader_election.cc:343] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: f345910256784d2085cb81473534dcaf
W20260617 07:53:08.492439 713 leader_election.cc:343] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 787467c65f68442aad071df16d4492f3
I20260617 07:53:08.492651 895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 399) took 1049 ms. Trace:
I20260617 07:53:08.492753 895 rpcz_store.cc:276] 0617 07:53:07.440044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.246894 (+806850us) service_pool.cc:224] Handling call
0617 07:53:08.247788 (+ 894us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.247810 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.357382 (+109572us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.488917 (+131535us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.489099 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.493317 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4f81daf583464e988521e189ca39b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.496302 713 leader_election.cc:304] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:08.498121 743 tablet_service.cc:1511] Processing CreateTablet for tablet d06187aa09fd4776a992a07405a10876 (DEFAULT_TABLE table=default.Table_67181344e3b04622865d4584952c600e [id=c866e35886e44e30b9a235af0b9a18ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.497630 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 216614d066e9446f91e53d2a382b5f6e (DEFAULT_TABLE table=default.Table_7ef78d5066e74ed18eb032a94d98e708 [id=d01892eee8954a04bf0e207993e6f950]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.498857 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216614d066e9446f91e53d2a382b5f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.503562 1175 ts_tablet_manager.cc:1929] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:08.508647 753 tablet_service.cc:1511] Processing CreateTablet for tablet 8db4fdde370e4d30bbf14285923644a1 (DEFAULT_TABLE table=default.Table_9f97b99a0ab74a3782a8dfa84db280cc [id=813f40f457074561b406da3616edb14c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.510324 895 tablet_service.cc:1511] Processing CreateTablet for tablet cd9777d3619743cf8df19cf93f97f50a (DEFAULT_TABLE table=default.Table_872caaea54e048e697337c5c43b80a92 [id=af0c8ea1c1d94ba1a847371952858f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.510720 760 tablet_service.cc:1511] Processing CreateTablet for tablet 72f1051b9dd04db5a8f1245242d39376 (DEFAULT_TABLE table=default.Table_2eb65c0d123846f1804e668fde8d23f5 [id=d8d07e82f2854f639176622bac6035e9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:08.510830 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:41615, user_credentials={real_user=slave}} blocked reactor thread for 46664.4us
I20260617 07:53:08.510872 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ba13170e864dfa96cddfb1a76b8c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.511564 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f1051b9dd04db5a8f1245242d39376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.511639 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 1382fc75785e4b07bf1688fa5385500a (DEFAULT_TABLE table=default.Table_30348a000daf4ff5b621f97ed5766bd6 [id=52357c6af1e04f2c82768cb39fe1be8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.512010 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1382fc75785e4b07bf1688fa5385500a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.513228 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d965aa4e8dc244cdb93dd15cdee9070c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.513622 759 tablet_service.cc:1511] Processing CreateTablet for tablet 05de71ea02df48ffacb369caa7f7d3de (DEFAULT_TABLE table=default.Table_2f40c198682e49768bee2d6a87292d46 [id=c8eaf721ce2242fdac07849a8ec26e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.514024 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05de71ea02df48ffacb369caa7f7d3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.515229 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06187aa09fd4776a992a07405a10876. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:08.519013 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58ba8963530d49a89fe4eb626225377d consensus state has no leader
I20260617 07:53:08.519449 754 tablet_service.cc:1511] Processing CreateTablet for tablet 737e9344fc824714a2c2596170637158 (DEFAULT_TABLE table=default.Table_3c03bf27d19849b7a595ecc26c80f3ab [id=c36cef97efcd403ebda494e915ac280f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.519493 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_704289c2a96943cb8eefe02205ef161a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.519995 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_704289c2a96943cb8eefe02205ef161a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.520159 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737e9344fc824714a2c2596170637158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.522450 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db4fdde370e4d30bbf14285923644a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.523118 748 tablet_service.cc:1511] Processing CreateTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 (DEFAULT_TABLE table=default.Table_23ed3b6c37b74f85b9c3318bce131332 [id=b46a458d41d242fcb4abac74caf5c2a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.523695 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8cd6ff8fa44536acdd84a107ab1525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.524209 1028 tablet_service.cc:1511] Processing CreateTablet for tablet cc1d9ce2ab5b428893719d9acd272d88 (DEFAULT_TABLE table=default.Table_971d911bece54aee98e3b98f349f0aad [id=912e818e8697427a8ce7dc146b9a428f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.524632 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc1d9ce2ab5b428893719d9acd272d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.525748 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 24ba13170e864dfa96cddfb1a76b8c40 (DEFAULT_TABLE table=default.Table_bfa59190ca144c4d9d0cbab7a39eef9c [id=214df2f2d641469c91a78dfd5bb3aba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.526217 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ba13170e864dfa96cddfb1a76b8c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.527295 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 398) took 1086 ms. Trace:
I20260617 07:53:08.527418 886 rpcz_store.cc:276] 0617 07:53:07.439255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.236827 (+797572us) service_pool.cc:224] Handling call
0617 07:53:08.374041 (+137214us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.374087 (+ 46us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.427214 (+ 53127us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.522866 (+ 95652us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.525491 (+ 2625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.532936 1685 raft_consensus.cc:2749] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.534788 914 raft_consensus.cc:2468] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:08.537150 898 tablet_service.cc:1511] Processing CreateTablet for tablet f2d846e5951d400ebc4ba6552406c63c (DEFAULT_TABLE table=default.Table_241a0fade3d14d01ae5af76abbb7480b [id=db98d137d4034f478394697f912bd3ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.537248 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 72f1051b9dd04db5a8f1245242d39376 (DEFAULT_TABLE table=default.Table_2eb65c0d123846f1804e668fde8d23f5 [id=d8d07e82f2854f639176622bac6035e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.537680 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f1051b9dd04db5a8f1245242d39376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.538925 886 tablet_service.cc:1511] Processing CreateTablet for tablet beb8fbb44e6147be8c9605be886a8aea (DEFAULT_TABLE table=default.Table_f8e68ee7c0bf43b08f9c84454484121d [id=2ce20b981b024427aca662385456a101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.552793 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 (DEFAULT_TABLE table=default.Table_23ed3b6c37b74f85b9c3318bce131332 [id=b46a458d41d242fcb4abac74caf5c2a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.553444 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8cd6ff8fa44536acdd84a107ab1525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.557564 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 05de71ea02df48ffacb369caa7f7d3de (DEFAULT_TABLE table=default.Table_2f40c198682e49768bee2d6a87292d46 [id=c8eaf721ce2242fdac07849a8ec26e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.564931 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05de71ea02df48ffacb369caa7f7d3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.568607 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 8db4fdde370e4d30bbf14285923644a1 (DEFAULT_TABLE table=default.Table_9f97b99a0ab74a3782a8dfa84db280cc [id=813f40f457074561b406da3616edb14c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.569109 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db4fdde370e4d30bbf14285923644a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.537854 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216614d066e9446f91e53d2a382b5f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.574036 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d846e5951d400ebc4ba6552406c63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.574261 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9777d3619743cf8df19cf93f97f50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.575453 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb8fbb44e6147be8c9605be886a8aea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:08.576397 988 consensus_peers.cc:597] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:08.577111 1172 tablet_bootstrap.cc:492] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:08.577338 1172 ts_tablet_manager.cc:1403] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.460s user 0.000s sys 0.014s
I20260617 07:53:08.578141 1172 raft_consensus.cc:359] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.580945 896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 397) took 1111 ms. Trace:
I20260617 07:53:08.584015 885 tablet_service.cc:1511] Processing CreateTablet for tablet cc1d9ce2ab5b428893719d9acd272d88 (DEFAULT_TABLE table=default.Table_971d911bece54aee98e3b98f349f0aad [id=912e818e8697427a8ce7dc146b9a428f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.587560 896 rpcz_store.cc:276] 0617 07:53:07.439169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.235323 (+796154us) service_pool.cc:224] Handling call
0617 07:53:08.249119 (+ 13796us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.249139 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.461583 (+212444us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.550476 (+ 88893us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.550644 (+ 168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.604279 891 tablet_service.cc:1511] Processing CreateTablet for tablet 1382fc75785e4b07bf1688fa5385500a (DEFAULT_TABLE table=default.Table_30348a000daf4ff5b621f97ed5766bd6 [id=52357c6af1e04f2c82768cb39fe1be8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.609261 896 tablet_service.cc:1511] Processing CreateTablet for tablet 24ba13170e864dfa96cddfb1a76b8c40 (DEFAULT_TABLE table=default.Table_bfa59190ca144c4d9d0cbab7a39eef9c [id=214df2f2d641469c91a78dfd5bb3aba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.584966 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 25b1b128ce484d9ab371fa3c5edc6ea6 (DEFAULT_TABLE table=default.Table_664d31b291bf448b98ad89d939ce5477 [id=752bd629dc0a4345b59cc4536e2e95d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.585356 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 737e9344fc824714a2c2596170637158 (DEFAULT_TABLE table=default.Table_3c03bf27d19849b7a595ecc26c80f3ab [id=c36cef97efcd403ebda494e915ac280f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.610126 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc1d9ce2ab5b428893719d9acd272d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.610395 880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 392) took 1208 ms. Trace:
I20260617 07:53:08.610503 880 rpcz_store.cc:276] 0617 07:53:07.394554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.176156 (+781602us) service_pool.cc:224] Handling call
0617 07:53:08.251554 (+ 75398us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.251588 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.515185 (+263597us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.602872 (+ 87687us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.603036 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.611174 880 tablet_service.cc:1511] Processing CreateTablet for tablet 72f1051b9dd04db5a8f1245242d39376 (DEFAULT_TABLE table=default.Table_2eb65c0d123846f1804e668fde8d23f5 [id=d8d07e82f2854f639176622bac6035e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.611660 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1382fc75785e4b07bf1688fa5385500a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.618937 898 tablet_service.cc:1511] Processing CreateTablet for tablet d06187aa09fd4776a992a07405a10876 (DEFAULT_TABLE table=default.Table_67181344e3b04622865d4584952c600e [id=c866e35886e44e30b9a235af0b9a18ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.622059 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ba13170e864dfa96cddfb1a76b8c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.623098 882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 400) took 1165 ms. Trace:
I20260617 07:53:08.629050 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 396) took 1189 ms. Trace:
I20260617 07:53:08.631533 882 rpcz_store.cc:276] 0617 07:53:07.442719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.256103 (+813384us) service_pool.cc:224] Handling call
0617 07:53:08.366008 (+109905us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.366039 (+ 31us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.533668 (+167629us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.607263 (+ 73595us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.607687 (+ 424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.632208 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f1051b9dd04db5a8f1245242d39376. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:08.640245 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 301bd4d6faec429ba71ce354c23d0f75 consensus state has no leader
I20260617 07:53:08.620173 883 tablet_service.cc:1511] Processing CreateTablet for tablet 05de71ea02df48ffacb369caa7f7d3de (DEFAULT_TABLE table=default.Table_2f40c198682e49768bee2d6a87292d46 [id=c8eaf721ce2242fdac07849a8ec26e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.638128 887 rpcz_store.cc:276] 0617 07:53:07.439065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.229439 (+790374us) service_pool.cc:224] Handling call
0617 07:53:08.251780 (+ 22341us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.251813 (+ 33us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.512324 (+260511us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.627871 (+115547us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.628039 (+ 168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.643829 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06187aa09fd4776a992a07405a10876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.644552 751 tablet_service.cc:1511] Processing CreateTablet for tablet 25b1b128ce484d9ab371fa3c5edc6ea6 (DEFAULT_TABLE table=default.Table_664d31b291bf448b98ad89d939ce5477 [id=752bd629dc0a4345b59cc4536e2e95d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.644999 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b1b128ce484d9ab371fa3c5edc6ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.646735 882 tablet_service.cc:1511] Processing CreateTablet for tablet 25b1b128ce484d9ab371fa3c5edc6ea6 (DEFAULT_TABLE table=default.Table_664d31b291bf448b98ad89d939ce5477 [id=752bd629dc0a4345b59cc4536e2e95d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.649121 1169 ts_tablet_manager.cc:1929] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:08.650586 892 tablet_service.cc:1511] Processing CreateTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 (DEFAULT_TABLE table=default.Table_23ed3b6c37b74f85b9c3318bce131332 [id=b46a458d41d242fcb4abac74caf5c2a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.650648 749 tablet_service.cc:1511] Processing CreateTablet for tablet a1e064b5bc93442f83aeffa88861d818 (DEFAULT_TABLE table=default.Table_85c6acc2e0744783bfa3d2f6f6162552 [id=965c116ab3dc4e32ad0febae905610e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.651443 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05de71ea02df48ffacb369caa7f7d3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.651634 741 tablet_service.cc:1511] Processing CreateTablet for tablet e897b111e65c497591c7daaa81d783c7 (DEFAULT_TABLE table=default.Table_5939ce898cc14175961237f56bde80ba [id=5a3a690ecbb34b44a83b177bca7926aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.651947 716 leader_election.cc:304] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:08.652285 1685 raft_consensus.cc:2804] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:08.652580 1685 raft_consensus.cc:697] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
W20260617 07:53:08.652290 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 116125us
I20260617 07:53:08.653244 1175 log.cc:1199] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/f9e253dca6904dfb914ed4be554da4b5
I20260617 07:53:08.653376 886 tablet_service.cc:1511] Processing CreateTablet for tablet e897b111e65c497591c7daaa81d783c7 (DEFAULT_TABLE table=default.Table_5939ce898cc14175961237f56bde80ba [id=5a3a690ecbb34b44a83b177bca7926aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.657886 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_ec014388c38a4b7ebbbb7c1bccde17c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.658509 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec014388c38a4b7ebbbb7c1bccde17c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.660549 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.660662 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 84f498f551ff4767bd16628b03f55ae2
I20260617 07:53:08.660780 894 tablet_service.cc:1511] Processing CreateTablet for tablet 8db4fdde370e4d30bbf14285923644a1 (DEFAULT_TABLE table=default.Table_9f97b99a0ab74a3782a8dfa84db280cc [id=813f40f457074561b406da3616edb14c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.661198 525 catalog_manager.cc:6784] ReplaceTablet: tablet 84f498f551ff4767bd16628b03f55ae2 deleted and replaced by tablet 9436fb7fca094eaab925748e254b1a62
I20260617 07:53:08.661365 1169 log.cc:1199] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/06e0f2f9a75d4f9ba8702e4da75c042f
I20260617 07:53:08.661918 422 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu pid 500
I20260617 07:53:08.663178 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_a25f1398f97f4c2b99ec71d2ce42f295" } new_table_name: "default.Table_7be7b293324744f4b216a6aaf234a5b1" modify_external_catalogs: true
I20260617 07:53:08.665125 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 630e540a77374c11895ab5a0e394b3bb
I20260617 07:53:08.665786 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b1b128ce484d9ab371fa3c5edc6ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.665786 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 66140c5d364f453a8089f143cc96ede8 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:08.666275 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.666538 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.666517 887 tablet_service.cc:1511] Processing CreateTablet for tablet 737e9344fc824714a2c2596170637158 (DEFAULT_TABLE table=default.Table_3c03bf27d19849b7a595ecc26c80f3ab [id=c36cef97efcd403ebda494e915ac280f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.666694 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_b3c6dc341bb4497186428c46a5d6c0d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:08.667202 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3c6dc341bb4497186428c46a5d6c0d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.667443 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e064b5bc93442f83aeffa88861d818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.668709 531 master_service.cc:960] ReplaceTablet: received request to replace tablet a38bb8a140ef4bcab65aaa03bdb79040 from {username='slave'} at 127.0.0.1:42828
I20260617 07:53:08.669816 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_073280306a2740119a28c4682671d83f" } new_table_name: "default.Table_50c9e41224614d21a12eac5dea96559c" modify_external_catalogs: true
I20260617 07:53:08.670917 1169 ts_tablet_manager.cc:1950] T 06e0f2f9a75d4f9ba8702e4da75c042f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:08.672189 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 319) took 2506 ms. Trace:
I20260617 07:53:08.672374 1169 rpcz_store.cc:276] 0617 07:53:06.164986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.165761 (+ 775us) service_pool.cc:224] Handling call
0617 07:53:08.335067 (+2169306us) ts_tablet_manager.cc:1151] Deleting tablet 06e0f2f9a75d4f9ba8702e4da75c042f
0617 07:53:08.335078 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.453433 (+118355us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.643020 (+189587us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.671344 (+ 28324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2169136}
I20260617 07:53:08.673161 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8cd6ff8fa44536acdd84a107ab1525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.673518 1598 raft_consensus.cc:493] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:08.674522 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 06e0f2f9a75d4f9ba8702e4da75c042f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]) successfully deleted
I20260617 07:53:08.678653 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e897b111e65c497591c7daaa81d783c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.680842 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 8a4f81daf583464e988521e189ca39b6
I20260617 07:53:08.681450 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e897b111e65c497591c7daaa81d783c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.681658 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_c5f15ddabb8041ac80b9ac925dd9cacd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:08.682276 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737e9344fc824714a2c2596170637158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.682361 1169 tablet_replica.cc:333] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:08.682601 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5f15ddabb8041ac80b9ac925dd9cacd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:08.684432 1598 raft_consensus.cc:515] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.689469 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42828:
name: "default.Table_41ef34e21782488da51b458e095e7bcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:08.690097 562 generic_service.cc:196] Checking for leaks (request via RPC)
I20260617 07:53:08.691136 1175 ts_tablet_manager.cc:1950] T f9e253dca6904dfb914ed4be554da4b5 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:08.697429 1634 consensus_queue.cc:1048] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260617 07:53:08.681720 1685 consensus_queue.cc:237] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.702279 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Sending DeleteTablet for 3 replicas of tablet 2f8cd6ff8fa44536acdd84a107ab1525
I20260617 07:53:08.702318 1169 raft_consensus.cc:2243] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.704941 890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 394) took 1267 ms. Trace:
I20260617 07:53:08.705235 1598 leader_election.cc:290] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:08.704872 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db4fdde370e4d30bbf14285923644a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.675591 897 tablet_service.cc:1511] Processing CreateTablet for tablet a1e064b5bc93442f83aeffa88861d818 (DEFAULT_TABLE table=default.Table_85c6acc2e0744783bfa3d2f6f6162552 [id=965c116ab3dc4e32ad0febae905610e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.710762 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.711021 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.712178 1675 raft_consensus.cc:493] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:08.712879 1169 raft_consensus.cc:2272] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.714308 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.715632 1675 raft_consensus.cc:515] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.715688 890 rpcz_store.cc:276] 0617 07:53:07.435698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.193334 (+757636us) service_pool.cc:224] Handling call
0617 07:53:08.214909 (+ 21575us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.214940 (+ 31us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.357363 (+142423us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.684229 (+326866us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.703582 (+ 19353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.716267 1675 leader_election.cc:290] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:08.717097 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.718080 1172 raft_consensus.cc:385] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.718379 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b1b128ce484d9ab371fa3c5edc6ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.718362 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:43908
I20260617 07:53:08.718540 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e064b5bc93442f83aeffa88861d818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.718688 1028 tablet_service.cc:1511] Processing CreateTablet for tablet d06187aa09fd4776a992a07405a10876 (DEFAULT_TABLE table=default.Table_67181344e3b04622865d4584952c600e [id=c866e35886e44e30b9a235af0b9a18ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.718886 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a1e064b5bc93442f83aeffa88861d818 (DEFAULT_TABLE table=default.Table_85c6acc2e0744783bfa3d2f6f6162552 [id=965c116ab3dc4e32ad0febae905610e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.721264 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 314) took 2450 ms. Trace:
I20260617 07:53:08.722204 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.724826 1169 ts_tablet_manager.cc:1916] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.725165 893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43908 (request call id 395) took 1286 ms. Trace:
I20260617 07:53:08.725324 893 rpcz_store.cc:276] 0617 07:53:07.436943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.213507 (+776564us) service_pool.cc:224] Handling call
0617 07:53:08.387375 (+173868us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 07:53:08.387401 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0617 07:53:08.688897 (+301496us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.723617 (+ 34720us) tablet_replica.cc:206] Creating consensus instance
0617 07:53:08.723752 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:08.728119 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:38066
I20260617 07:53:08.733309 1633 raft_consensus.cc:493] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:08.735663 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.737325 1032 tablet_service.cc:1511] Processing CreateTablet for tablet e897b111e65c497591c7daaa81d783c7 (DEFAULT_TABLE table=default.Table_5939ce898cc14175961237f56bde80ba [id=5a3a690ecbb34b44a83b177bca7926aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:08.741513 1172 raft_consensus.cc:740] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.742853 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.743091 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737e9344fc824714a2c2596170637158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.745390 1633 raft_consensus.cc:515] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.752019 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:45978
I20260617 07:53:08.754769 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e43e1a3df54efe992a86dd0bd0c149" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.756356 1172 consensus_queue.cc:260] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.757944 1171 tablet_bootstrap.cc:492] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:08.758242 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e897b111e65c497591c7daaa81d783c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.759443 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06187aa09fd4776a992a07405a10876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:08.760850 1171 ts_tablet_manager.cc:1403] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.487s user 0.010s sys 0.007s
W20260617 07:53:08.761214 988 leader_election.cc:343] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.763221 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e064b5bc93442f83aeffa88861d818. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:08.764074 851 consensus_peers.cc:597] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a460aee4eb514a87b272c4fc858335e7. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:08.773494 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7582d201bc5843949d4be08ee7586f9d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:08.773684 1046 raft_consensus.cc:2468] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:08.775254 1170 ts_tablet_manager.cc:1929] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:08.775488 1170 log.cc:1199] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/69996eb4ab6e40f9b2d97e00d766822a
I20260617 07:53:08.725448 1175 rpcz_store.cc:276] 0617 07:53:06.242150 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.252019 (+ 9869us) service_pool.cc:224] Handling call
0617 07:53:08.327080 (+2075061us) ts_tablet_manager.cc:1151] Deleting tablet f9e253dca6904dfb914ed4be554da4b5
0617 07:53:08.327092 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.337673 (+ 10581us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.503253 (+165580us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.692177 (+188924us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2074863}
W20260617 07:53:08.775933 713 leader_election.cc:343] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a460aee4eb514a87b272c4fc858335e7
I20260617 07:53:08.778093 851 leader_election.cc:304] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:08.778422 1634 consensus_queue.cc:1048] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:08.781787 1175 tablet_replica.cc:333] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:08.782017 1175 raft_consensus.cc:2243] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.786973 1633 leader_election.cc:290] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:08.787555 1634 raft_consensus.cc:2804] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:08.787693 1634 raft_consensus.cc:493] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:08.787853 1634 raft_consensus.cc:3060] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:08.790962 1175 raft_consensus.cc:2272] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:08.792116 713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 44601.3us
I20260617 07:53:08.794333 1175 ts_tablet_manager.cc:1916] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.798408 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7582d201bc5843949d4be08ee7586f9d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:08.804975 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e43e1a3df54efe992a86dd0bd0c149" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:08.805415 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a460aee4eb514a87b272c4fc858335e7" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.807560 716 leader_election.cc:304] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:08.814105 1170 ts_tablet_manager.cc:1950] T 69996eb4ab6e40f9b2d97e00d766822a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:08.814175 852 leader_election.cc:343] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.814630 1598 raft_consensus.cc:2749] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.814988 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 314) took 2919 ms. Trace:
I20260617 07:53:08.815083 1170 rpcz_store.cc:276] 0617 07:53:05.895924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.896027 (+ 103us) service_pool.cc:224] Handling call
0617 07:53:08.442451 (+2546424us) ts_tablet_manager.cc:1151] Deleting tablet 69996eb4ab6e40f9b2d97e00d766822a
0617 07:53:08.442461 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.544627 (+102166us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.775187 (+230560us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.814936 (+ 39749us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27086,"tablet-delete.queue_time_us":2545084}
I20260617 07:53:08.815790 516 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 69996eb4ab6e40f9b2d97e00d766822a (table default.Table_0e8fe92eb0e14e9ea3e8b68b977f1690 [id=f7bea6866b9845f1a116293b182de7bc]) successfully deleted
I20260617 07:53:08.818758 1170 tablet_replica.cc:333] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:08.820114 1634 raft_consensus.cc:515] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.820976 1634 leader_election.cc:290] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:08.821519 1171 raft_consensus.cc:359] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.821871 1171 raft_consensus.cc:385] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.822016 1171 raft_consensus.cc:740] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.821760 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7582d201bc5843949d4be08ee7586f9d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:08.822346 1048 raft_consensus.cc:3060] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:08.822479 1171 consensus_queue.cc:260] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.823192 1171 ts_tablet_manager.cc:1434] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.062s user 0.001s sys 0.001s
I20260617 07:53:08.825184 1048 raft_consensus.cc:2468] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:08.826736 851 leader_election.cc:304] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:08.827502 1171 tablet_bootstrap.cc:492] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:08.828402 1634 raft_consensus.cc:2804] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:08.828686 1634 raft_consensus.cc:697] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:08.829221 1634 consensus_queue.cc:237] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.831164 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7582d201bc5843949d4be08ee7586f9d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:08.833551 852 leader_election.cc:343] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:08.837335 852 consensus_peers.cc:597] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:08.839178 1171 tablet_bootstrap.cc:654] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.841679 1172 ts_tablet_manager.cc:1434] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.264s user 0.007s sys 0.000s
I20260617 07:53:08.841825 1169 ts_tablet_manager.cc:1929] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:08.841943 1169 log.cc:1199] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/f345910256784d2085cb81473534dcaf
I20260617 07:53:08.842247 1172 tablet_bootstrap.cc:492] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:08.843783 1172 tablet_bootstrap.cc:654] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.848398 1169 ts_tablet_manager.cc:1950] T f345910256784d2085cb81473534dcaf P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:08.849208 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 320) took 2667 ms. Trace:
I20260617 07:53:08.849817 1169 rpcz_store.cc:276] 0617 07:53:06.181535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.181881 (+ 346us) service_pool.cc:224] Handling call
0617 07:53:08.672774 (+2490893us) ts_tablet_manager.cc:1151] Deleting tablet f345910256784d2085cb81473534dcaf
0617 07:53:08.672786 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.812165 (+139379us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.841740 (+ 29575us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.849172 (+ 7432us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2490656}
I20260617 07:53:08.852135 1169 tablet_replica.cc:333] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:08.852401 1169 raft_consensus.cc:2243] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:08.852684 1169 pending_rounds.cc:70] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:08.852771 1169 pending_rounds.cc:77] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772699186712576 op_type: NO_OP noop_request { }
I20260617 07:53:08.852900 1169 raft_consensus.cc:2889] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:08.853503 1169 raft_consensus.cc:2272] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.857635 1175 ts_tablet_manager.cc:1929] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:08.860641 1175 log.cc:1199] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/5b99b80966c94937baf7172b0c36af2a
I20260617 07:53:08.862392 1175 ts_tablet_manager.cc:1950] T 5b99b80966c94937baf7172b0c36af2a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:08.862658 852 consensus_peers.cc:597] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:08.864285 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 313) took 2622 ms. Trace:
I20260617 07:53:08.864470 1175 rpcz_store.cc:276] 0617 07:53:06.242024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.252251 (+ 10227us) service_pool.cc:224] Handling call
0617 07:53:08.776498 (+2524247us) ts_tablet_manager.cc:1151] Deleting tablet 5b99b80966c94937baf7172b0c36af2a
0617 07:53:08.776508 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.812573 (+ 36065us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.857463 (+ 44890us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.864246 (+ 6783us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2524052}
I20260617 07:53:08.865267 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 320) took 2568 ms. Trace:
I20260617 07:53:08.865465 1175 rpcz_store.cc:276] 0617 07:53:06.296736 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.296797 (+ 61us) service_pool.cc:224] Handling call
0617 07:53:08.865103 (+2568306us) ts_tablet_manager.cc:1151] Deleting tablet 63bf519b83c445798bddda3120b542ce
0617 07:53:08.865115 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.865227 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2568045}
I20260617 07:53:08.866173 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 319) took 2569 ms. Trace:
I20260617 07:53:08.866331 1175 rpcz_store.cc:276] 0617 07:53:06.296605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.301772 (+ 5167us) service_pool.cc:224] Handling call
0617 07:53:08.865999 (+2564227us) ts_tablet_manager.cc:1151] Deleting tablet 36ce60b466f7420992ef194d72b5718d
0617 07:53:08.866010 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.866139 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2563980}
I20260617 07:53:08.866832 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 321) took 2570 ms. Trace:
I20260617 07:53:08.866991 1175 rpcz_store.cc:276] 0617 07:53:06.296844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.302056 (+ 5212us) service_pool.cc:224] Handling call
0617 07:53:08.866706 (+2564650us) ts_tablet_manager.cc:1151] Deleting tablet 9cddb9e82c354f26b3abe56ebdefd008
0617 07:53:08.866714 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.866800 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2564470}
I20260617 07:53:08.870553 1172 tablet_bootstrap.cc:492] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:08.870755 1172 ts_tablet_manager.cc:1403] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260617 07:53:08.871591 1172 raft_consensus.cc:359] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:08.871986 986 leader_election.cc:343] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.875983 1172 raft_consensus.cc:385] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.876137 986 leader_election.cc:304] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:08.876402 1172 raft_consensus.cc:740] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.876847 1172 consensus_queue.cc:260] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.876510 1698 raft_consensus.cc:2749] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.878338 1172 ts_tablet_manager.cc:1434] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:08.879524 1634 consensus_queue.cc:1048] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:08.881436 1172 tablet_bootstrap.cc:492] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:08.887115 1172 tablet_bootstrap.cc:654] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.888198 1178 tablet_bootstrap.cc:492] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:08.888604 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 322) took 2572 ms. Trace:
I20260617 07:53:08.889319 1178 ts_tablet_manager.cc:1403] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.566s user 0.040s sys 0.048s
I20260617 07:53:08.890125 1170 raft_consensus.cc:2243] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.890506 1170 pending_rounds.cc:70] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:08.890568 1170 pending_rounds.cc:77] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772699068047360 op_type: NO_OP noop_request { }
I20260617 07:53:08.890686 1170 raft_consensus.cc:2889] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:08.890779 1170 raft_consensus.cc:2272] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.891618 1178 raft_consensus.cc:359] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.895334 1171 tablet_bootstrap.cc:492] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:08.895556 1171 ts_tablet_manager.cc:1403] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.068s user 0.005s sys 0.001s
I20260617 07:53:08.896495 1178 raft_consensus.cc:385] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.896620 1178 raft_consensus.cc:740] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.896876 1178 consensus_queue.cc:260] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.897775 1178 ts_tablet_manager.cc:1434] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:08.898062 1175 rpcz_store.cc:276] 0617 07:53:06.296955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.302274 (+ 5319us) service_pool.cc:224] Handling call
0617 07:53:08.867404 (+2565130us) ts_tablet_manager.cc:1151] Deleting tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
0617 07:53:08.867412 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.869087 (+ 1675us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2564977}
W20260617 07:53:08.908233 1703 consensus_queue.cc:1175] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dc3bec007846459a9da0c7b8211e477b" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260617 07:53:08.908941 1178 tablet_bootstrap.cc:492] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:08.909490 1175 tablet_replica.cc:333] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:08.910017 1170 ts_tablet_manager.cc:1916] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.911852 1172 tablet_bootstrap.cc:492] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:08.912041 1172 ts_tablet_manager.cc:1403] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260617 07:53:08.917392 1170 ts_tablet_manager.cc:1929] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 07:53:08.918224 851 consensus_peers.cc:597] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:08.918875 1175 raft_consensus.cc:2243] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:08.919358 1175 pending_rounds.cc:70] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Trying to abort 1 pending ops.
I20260617 07:53:08.920332 1171 raft_consensus.cc:359] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.920434 1170 log.cc:1199] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/19f8525046964950884b0f9aa515ec81
I20260617 07:53:08.920519 1171 raft_consensus.cc:385] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.920616 1171 raft_consensus.cc:740] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.921096 1175 pending_rounds.cc:77] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772695594020864 op_type: NO_OP noop_request { }
I20260617 07:53:08.921249 1175 raft_consensus.cc:2889] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:08.921219 1171 consensus_queue.cc:260] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.921674 1175 raft_consensus.cc:2272] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.922395 1175 ts_tablet_manager.cc:1916] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.924590 1169 ts_tablet_manager.cc:1916] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.925486 1178 tablet_bootstrap.cc:654] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.934209 1171 ts_tablet_manager.cc:1434] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260617 07:53:08.939168 1175 ts_tablet_manager.cc:1929] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:08.940848 1171 tablet_bootstrap.cc:492] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:08.946018 1698 raft_consensus.cc:493] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:08.946256 1698 raft_consensus.cc:515] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.946638 1171 tablet_bootstrap.cc:654] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.946898 1698 leader_election.cc:290] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:08.946050 1170 ts_tablet_manager.cc:1950] T 19f8525046964950884b0f9aa515ec81 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:08.939520 1172 raft_consensus.cc:359] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.948385 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21f61a35ca544568bcfca1a6230deca" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.948608 1172 raft_consensus.cc:385] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 07:53:08.948894 988 leader_election.cc:343] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.949157 1172 raft_consensus.cc:740] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.950448 1172 consensus_queue.cc:260] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.961758 1169 ts_tablet_manager.cc:1929] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:08.951053 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 315) took 3054 ms. Trace:
I20260617 07:53:08.961906 1169 log.cc:1199] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/69996eb4ab6e40f9b2d97e00d766822a
I20260617 07:53:08.962064 1170 rpcz_store.cc:276] 0617 07:53:05.897025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.897087 (+ 62us) service_pool.cc:224] Handling call
0617 07:53:08.818675 (+2921588us) ts_tablet_manager.cc:1151] Deleting tablet 19f8525046964950884b0f9aa515ec81
0617 07:53:08.818685 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.890401 (+ 71716us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x616000104e54. stack: 00007f0ee639d086 00007f0ee639ce40 00007f0ee53563ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f0ef23d17e0 00007f0ef371d933 00007f0ef62e0ae7 00007f0ef6313bb4 00007f0ef62f45d0 00007f0ef62f435d 0000000000aa681c 00007f0ee63e2f6f 00007f0ee63e628b 00007f0ee63e6108
0617 07:53:08.913476 (+ 23075us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.917309 (+ 3833us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.950982 (+ 33673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163623168,"tablet-delete.queue_time_us":2920411}
I20260617 07:53:08.962328 1169 ts_tablet_manager.cc:1950] T 69996eb4ab6e40f9b2d97e00d766822a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:08.962677 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 321) took 2781 ms. Trace:
I20260617 07:53:08.962800 1169 rpcz_store.cc:276] 0617 07:53:06.181684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.182155 (+ 471us) service_pool.cc:224] Handling call
0617 07:53:08.852069 (+2669914us) ts_tablet_manager.cc:1151] Deleting tablet 69996eb4ab6e40f9b2d97e00d766822a
0617 07:53:08.852079 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.927960 (+ 75881us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.961644 (+ 33684us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.962644 (+ 1000us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2669714}
I20260617 07:53:08.963258 1170 tablet_replica.cc:333] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:08.963587 1170 raft_consensus.cc:2243] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.964447 1170 raft_consensus.cc:2272] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.962622 1172 ts_tablet_manager.cc:1434] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.050s user 0.003s sys 0.000s
I20260617 07:53:08.966482 1698 raft_consensus.cc:493] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:08.966816 1698 raft_consensus.cc:515] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.967471 1698 leader_election.cc:290] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:08.968230 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80c2ffcf1b84df0bc6a468ea0929e80" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:08.968670 1170 ts_tablet_manager.cc:1916] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:08.970039 988 leader_election.cc:343] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.970479 1172 tablet_bootstrap.cc:492] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:08.947886 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21f61a35ca544568bcfca1a6230deca" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:08.948016 1178 tablet_bootstrap.cc:492] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:08.972321 1175 log.cc:1199] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/4d9d9ed003c64b1abed6bd3bb14456cd
I20260617 07:53:08.972434 1178 ts_tablet_manager.cc:1403] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.005s
I20260617 07:53:08.972836 1175 ts_tablet_manager.cc:1950] T 4d9d9ed003c64b1abed6bd3bb14456cd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:08.972892 986 leader_election.cc:343] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.973022 986 leader_election.cc:304] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:08.973287 1178 raft_consensus.cc:359] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.973459 1698 raft_consensus.cc:2749] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.973498 1178 raft_consensus.cc:385] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.973598 1178 raft_consensus.cc:740] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.968077 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80c2ffcf1b84df0bc6a468ea0929e80" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:08.973685 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 323) took 2670 ms. Trace:
I20260617 07:53:08.973820 1175 rpcz_store.cc:276] 0617 07:53:06.303577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.303687 (+ 110us) service_pool.cc:224] Handling call
0617 07:53:08.898608 (+2594921us) ts_tablet_manager.cc:1151] Deleting tablet 4d9d9ed003c64b1abed6bd3bb14456cd
0617 07:53:08.905159 (+ 6551us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.934914 (+ 29755us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.939047 (+ 4133us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.973642 (+ 34595us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111,"tablet-delete.queue_time_us":2594714}
W20260617 07:53:08.974100 986 leader_election.cc:343] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:08.974027 1178 consensus_queue.cc:260] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:08.974205 1175 tablet_replica.cc:333] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:08.974228 986 leader_election.cc:304] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:08.974535 1178 ts_tablet_manager.cc:1434] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:08.974786 1172 tablet_bootstrap.cc:654] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.974802 1178 tablet_bootstrap.cc:492] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:08.974994 1698 raft_consensus.cc:2749] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:08.976564 1178 tablet_bootstrap.cc:654] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.982153 1178 tablet_bootstrap.cc:492] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:08.982326 1178 ts_tablet_manager.cc:1403] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260617 07:53:08.983666 1171 tablet_bootstrap.cc:492] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:08.983845 1171 ts_tablet_manager.cc:1403] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260617 07:53:08.984534 1171 raft_consensus.cc:359] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.984737 1171 raft_consensus.cc:385] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.984812 1171 raft_consensus.cc:740] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.985059 1171 consensus_queue.cc:260] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.985971 1175 raft_consensus.cc:2243] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.986166 1175 raft_consensus.cc:2272] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.986852 1175 ts_tablet_manager.cc:1916] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.987018 1170 ts_tablet_manager.cc:1929] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:08.987182 1170 log.cc:1199] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/80f67a6c1dcf4a69842452c371a9c078
I20260617 07:53:08.987653 1170 ts_tablet_manager.cc:1950] T 80f67a6c1dcf4a69842452c371a9c078 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:08.987998 1171 ts_tablet_manager.cc:1434] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260617 07:53:08.988315 1171 tablet_bootstrap.cc:492] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:08.988171 1178 raft_consensus.cc:359] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.988517 1178 raft_consensus.cc:385] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:08.988633 1178 raft_consensus.cc:740] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:08.988914 1178 consensus_queue.cc:260] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:08.991842 1171 tablet_bootstrap.cc:654] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:08.992147 1178 ts_tablet_manager.cc:1434] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260617 07:53:08.992349 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 316) took 3092 ms. Trace:
I20260617 07:53:08.992533 1170 rpcz_store.cc:276] 0617 07:53:05.900216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.900289 (+ 73us) service_pool.cc:224] Handling call
0617 07:53:08.963142 (+3062853us) ts_tablet_manager.cc:1151] Deleting tablet 80f67a6c1dcf4a69842452c371a9c078
0617 07:53:08.963157 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:08.972064 (+ 8907us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.986174 (+ 14110us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:08.992309 (+ 6135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3057126}
I20260617 07:53:08.993434 1169 tablet_replica.cc:333] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:08.993440 1170 tablet_replica.cc:333] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:08.993652 1169 raft_consensus.cc:2243] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:08.993954 1169 pending_rounds.cc:70] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:08.993948 1170 raft_consensus.cc:2243] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:08.994047 1169 pending_rounds.cc:77] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772699202592768 op_type: NO_OP noop_request { }
I20260617 07:53:08.995143 1170 raft_consensus.cc:2272] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.995942 1170 ts_tablet_manager.cc:1916] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.994163 1169 raft_consensus.cc:2889] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:08.996459 1169 raft_consensus.cc:2272] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:08.996701 1178 tablet_bootstrap.cc:492] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:08.997231 1169 ts_tablet_manager.cc:1916] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:08.998381 778 raft_consensus.cc:3060] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.010871 1172 tablet_bootstrap.cc:492] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.011016 1171 tablet_bootstrap.cc:492] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.011044 1172 ts_tablet_manager.cc:1403] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.016s
I20260617 07:53:09.011188 1171 ts_tablet_manager.cc:1403] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.002s
I20260617 07:53:09.012006 1171 raft_consensus.cc:359] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.012187 1171 raft_consensus.cc:385] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.012279 1171 raft_consensus.cc:740] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.012463 1172 raft_consensus.cc:359] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.012548 1171 consensus_queue.cc:260] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.012648 1172 raft_consensus.cc:385] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.012735 1172 raft_consensus.cc:740] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.012957 1172 consensus_queue.cc:260] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.013513 1172 ts_tablet_manager.cc:1434] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:09.014848 1172 tablet_bootstrap.cc:492] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.016330 1171 ts_tablet_manager.cc:1434] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:09.016558 1172 tablet_bootstrap.cc:654] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.016626 1171 tablet_bootstrap.cc:492] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.022058 1685 raft_consensus.cc:493] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.022254 1685 raft_consensus.cc:515] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:09.024040 1171 tablet_bootstrap.cc:654] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.027115 1685 leader_election.cc:290] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:09.027299 713 leader_election.cc:343] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 19f8525046964950884b0f9aa515ec81
I20260617 07:53:09.027705 1172 tablet_bootstrap.cc:492] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.027853 1172 ts_tablet_manager.cc:1403] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260617 07:53:09.028657 1172 raft_consensus.cc:359] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.028859 1172 raft_consensus.cc:385] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.028926 1172 raft_consensus.cc:740] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.029146 1172 consensus_queue.cc:260] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.029654 1172 ts_tablet_manager.cc:1434] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:09.030095 1169 ts_tablet_manager.cc:1929] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.030263 1169 log.cc:1199] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a460aee4eb514a87b272c4fc858335e7
I20260617 07:53:09.030340 1172 tablet_bootstrap.cc:492] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.030560 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f8525046964950884b0f9aa515ec81" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.031461 1169 ts_tablet_manager.cc:1950] T a460aee4eb514a87b272c4fc858335e7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.031956 1172 tablet_bootstrap.cc:654] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.032239 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 322) took 2850 ms. Trace:
I20260617 07:53:09.032339 1169 rpcz_store.cc:276] 0617 07:53:06.181832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.182384 (+ 552us) service_pool.cc:224] Handling call
0617 07:53:08.993361 (+2810977us) ts_tablet_manager.cc:1151] Deleting tablet a460aee4eb514a87b272c4fc858335e7
0617 07:53:08.993372 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.008986 (+ 15614us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.029993 (+ 21007us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.032209 (+ 2216us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2810790}
I20260617 07:53:09.036330 1175 ts_tablet_manager.cc:1929] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.038002 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 323) took 2831 ms. Trace:
I20260617 07:53:09.038121 1169 rpcz_store.cc:276] 0617 07:53:06.206231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.206301 (+ 70us) service_pool.cc:224] Handling call
0617 07:53:09.037830 (+2831529us) ts_tablet_manager.cc:1151] Deleting tablet 245cff69d83b43e98b1c72b8d3011347
0617 07:53:09.037840 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.037962 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2831281}
I20260617 07:53:09.038647 1169 tablet_replica.cc:333] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:09.039438 1171 tablet_bootstrap.cc:492] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.039593 1171 ts_tablet_manager.cc:1403] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.002s
I20260617 07:53:09.040341 1171 raft_consensus.cc:359] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.040555 1171 raft_consensus.cc:385] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.040627 1171 raft_consensus.cc:740] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.040846 1171 consensus_queue.cc:260] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.042876 1171 ts_tablet_manager.cc:1434] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:09.043175 1171 tablet_bootstrap.cc:492] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.044709 1169 raft_consensus.cc:2243] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:09.045043 1169 raft_consensus.cc:2272] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.047479 1172 tablet_bootstrap.cc:492] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.047643 1172 ts_tablet_manager.cc:1403] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.001s
I20260617 07:53:09.048480 1172 raft_consensus.cc:359] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.048732 1172 raft_consensus.cc:385] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.048866 1172 raft_consensus.cc:740] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.048897 1170 ts_tablet_manager.cc:1929] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.049363 1170 log.cc:1199] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/074a3e08cc9a4be891016ce197a993be
I20260617 07:53:09.049916 1170 ts_tablet_manager.cc:1950] T 074a3e08cc9a4be891016ce197a993be P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.050112 1171 tablet_bootstrap.cc:654] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.050431 1169 ts_tablet_manager.cc:1916] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.051332 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 317) took 3149 ms. Trace:
I20260617 07:53:09.051493 1170 rpcz_store.cc:276] 0617 07:53:05.902113 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.902201 (+ 88us) service_pool.cc:224] Handling call
0617 07:53:08.993345 (+3091144us) ts_tablet_manager.cc:1151] Deleting tablet 074a3e08cc9a4be891016ce197a993be
0617 07:53:08.993361 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.010119 (+ 16758us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.048765 (+ 38646us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.051269 (+ 2504us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3086760}
I20260617 07:53:09.051834 1172 consensus_queue.cc:260] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.052318 1175 log.cc:1199] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/ddb71e5f65cd4b9e8dbe5ddf44e70340
I20260617 07:53:09.052408 1172 ts_tablet_manager.cc:1434] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:09.052686 1172 tablet_bootstrap.cc:492] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.052696 1175 ts_tablet_manager.cc:1950] T ddb71e5f65cd4b9e8dbe5ddf44e70340 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:09.054286 1172 tablet_bootstrap.cc:654] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.056510 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 324) took 2748 ms. Trace:
I20260617 07:53:09.059439 1170 tablet_replica.cc:333] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.059650 1170 raft_consensus.cc:2243] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:09.059971 1170 raft_consensus.cc:2272] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.060216 1698 raft_consensus.cc:493] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.060374 1698 raft_consensus.cc:515] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.060658 1170 ts_tablet_manager.cc:1916] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.060977 1698 leader_election.cc:290] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.062088 716 leader_election.cc:304] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:09.062960 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a547dabaeb742ba941690f4895955bd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.063560 1169 ts_tablet_manager.cc:1929] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.063701 1169 log.cc:1199] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/80f67a6c1dcf4a69842452c371a9c078
W20260617 07:53:09.063740 988 leader_election.cc:343] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.064088 1169 ts_tablet_manager.cc:1950] T 80f67a6c1dcf4a69842452c371a9c078 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.064931 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 328) took 2824 ms. Trace:
I20260617 07:53:09.065025 1169 rpcz_store.cc:276] 0617 07:53:06.240728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.240874 (+ 146us) service_pool.cc:224] Handling call
0617 07:53:09.038580 (+2797706us) ts_tablet_manager.cc:1151] Deleting tablet 80f67a6c1dcf4a69842452c371a9c078
0617 07:53:09.038589 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.055078 (+ 16489us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.063484 (+ 8406us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.064875 (+ 1391us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2797400}
I20260617 07:53:09.066610 1685 raft_consensus.cc:2749] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.066233 1175 rpcz_store.cc:276] 0617 07:53:06.304628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.305867 (+ 1239us) service_pool.cc:224] Handling call
0617 07:53:08.974139 (+2668272us) ts_tablet_manager.cc:1151] Deleting tablet ddb71e5f65cd4b9e8dbe5ddf44e70340
0617 07:53:08.974149 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.027644 (+ 53495us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.036243 (+ 8599us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.053437 (+ 17194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8696,"tablet-delete.queue_time_us":2668087}
I20260617 07:53:09.068272 1175 tablet_replica.cc:333] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:09.068485 1175 raft_consensus.cc:2243] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.068686 1175 raft_consensus.cc:2272] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.069599 1178 tablet_bootstrap.cc:654] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.070127 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a547dabaeb742ba941690f4895955bd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.071290 986 leader_election.cc:343] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.074112 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 332) took 2775 ms. Trace:
I20260617 07:53:09.074277 986 leader_election.cc:304] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:09.074213 1169 rpcz_store.cc:276] 0617 07:53:06.298410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.298876 (+ 466us) service_pool.cc:224] Handling call
0617 07:53:09.073924 (+2775048us) ts_tablet_manager.cc:1151] Deleting tablet 63bf519b83c445798bddda3120b542ce
0617 07:53:09.073938 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.074063 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2774862}
I20260617 07:53:09.075579 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 331) took 2777 ms. Trace:
I20260617 07:53:09.075675 1169 rpcz_store.cc:276] 0617 07:53:06.298298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.298526 (+ 228us) service_pool.cc:224] Handling call
0617 07:53:09.075406 (+2776880us) ts_tablet_manager.cc:1151] Deleting tablet 36ce60b466f7420992ef194d72b5718d
0617 07:53:09.075427 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.075522 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2776231}
I20260617 07:53:09.076571 1171 tablet_bootstrap.cc:492] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.076699 1171 ts_tablet_manager.cc:1403] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.003s
I20260617 07:53:09.077572 1171 raft_consensus.cc:359] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.077826 1171 raft_consensus.cc:385] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.077917 1171 raft_consensus.cc:740] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.078181 1171 consensus_queue.cc:260] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.078677 1698 raft_consensus.cc:2749] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.078961 1175 ts_tablet_manager.cc:1916] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.079622 1170 ts_tablet_manager.cc:1929] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.079742 1170 log.cc:1199] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/06e0f2f9a75d4f9ba8702e4da75c042f
I20260617 07:53:09.080129 1170 ts_tablet_manager.cc:1950] T 06e0f2f9a75d4f9ba8702e4da75c042f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.080885 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 313) took 3185 ms. Trace:
I20260617 07:53:09.080989 1170 rpcz_store.cc:276] 0617 07:53:05.894975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.896585 (+ 1610us) service_pool.cc:224] Handling call
0617 07:53:09.059341 (+3162756us) ts_tablet_manager.cc:1151] Deleting tablet 06e0f2f9a75d4f9ba8702e4da75c042f
0617 07:53:09.059350 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.063893 (+ 4543us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.079534 (+ 15641us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.080848 (+ 1314us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3151020}
I20260617 07:53:09.081408 1170 tablet_replica.cc:333] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.081601 1170 raft_consensus.cc:2243] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:09.081975 1171 ts_tablet_manager.cc:1434] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260617 07:53:09.082260 1171 tablet_bootstrap.cc:492] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.082609 1172 tablet_bootstrap.cc:492] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.082751 1172 ts_tablet_manager.cc:1403] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260617 07:53:09.083482 1172 raft_consensus.cc:359] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.083658 1172 raft_consensus.cc:385] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.083734 1172 raft_consensus.cc:740] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.083966 1172 consensus_queue.cc:260] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.084446 1172 ts_tablet_manager.cc:1434] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:09.084748 1172 tablet_bootstrap.cc:492] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.085099 1634 raft_consensus.cc:493] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.085276 1634 raft_consensus.cc:515] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.085986 1634 leader_election.cc:290] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.086642 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 333) took 2788 ms. Trace:
I20260617 07:53:09.086725 1169 rpcz_store.cc:276] 0617 07:53:06.298498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.299082 (+ 584us) service_pool.cc:224] Handling call
0617 07:53:09.086491 (+2787409us) ts_tablet_manager.cc:1151] Deleting tablet 9cddb9e82c354f26b3abe56ebdefd008
0617 07:53:09.086501 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.086593 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2787235}
I20260617 07:53:09.087213 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01721f68e3c41f4a2ffaf05bb180761" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.087934 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01721f68e3c41f4a2ffaf05bb180761" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.087990 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 334) took 2789 ms. Trace:
I20260617 07:53:09.088104 1046 raft_consensus.cc:2468] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.088074 1169 rpcz_store.cc:276] 0617 07:53:06.298570 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.299273 (+ 703us) service_pool.cc:224] Handling call
0617 07:53:09.087855 (+2788582us) ts_tablet_manager.cc:1151] Deleting tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
0617 07:53:09.087864 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.087942 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2788456}
W20260617 07:53:09.088580 852 leader_election.cc:343] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.088868 1171 tablet_bootstrap.cc:654] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.090750 851 leader_election.cc:304] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.091136 1634 raft_consensus.cc:2804] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.091218 1634 raft_consensus.cc:493] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.091308 1634 raft_consensus.cc:3060] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.094224 1634 raft_consensus.cc:515] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.094373 1170 raft_consensus.cc:2272] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.095216 1634 leader_election.cc:290] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.095352 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01721f68e3c41f4a2ffaf05bb180761" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:09.095499 1169 tablet_replica.cc:333] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:09.095544 1046 raft_consensus.cc:3060] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.095640 1634 raft_consensus.cc:493] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.095760 1634 raft_consensus.cc:515] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.096666 1634 leader_election.cc:290] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.097467 1169 raft_consensus.cc:2243] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:09.097788 1169 raft_consensus.cc:2272] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.097841 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01721f68e3c41f4a2ffaf05bb180761" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.098243 1046 raft_consensus.cc:2468] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:09.098490 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c1c44020a4586b3197f5f68a38963" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.098742 1048 raft_consensus.cc:2468] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.099066 1169 ts_tablet_manager.cc:1916] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.099436 1170 ts_tablet_manager.cc:1916] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:09.099574 852 leader_election.cc:343] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.099876 1698 raft_consensus.cc:493] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:09.100070 1698 raft_consensus.cc:515] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:09.100668 1698 leader_election.cc:290] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:09.101922 986 leader_election.cc:343] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: 262a34e120f34689ba0b598d7a2999fd
I20260617 07:53:09.102339 851 leader_election.cc:304] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.102780 851 leader_election.cc:304] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:09.103044 1633 raft_consensus.cc:2804] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.103174 1633 raft_consensus.cc:697] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:09.103235 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c1c44020a4586b3197f5f68a38963" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.103426 1633 consensus_queue.cc:237] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:09.103881 852 leader_election.cc:343] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.104249 1657 raft_consensus.cc:2804] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.104348 1657 raft_consensus.cc:493] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260617 07:53:09.104314 988 leader_election.cc:343] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 262a34e120f34689ba0b598d7a2999fd
I20260617 07:53:09.104429 1657 raft_consensus.cc:3060] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.105165 988 leader_election.cc:304] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:09.105616 1698 raft_consensus.cc:2749] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:09.106588 1172 tablet_bootstrap.cc:654] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.107080 1657 raft_consensus.cc:515] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.107661 1657 leader_election.cc:290] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.108511 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c1c44020a4586b3197f5f68a38963" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:09.108758 1048 raft_consensus.cc:3060] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.110344 1172 tablet_bootstrap.cc:492] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.110493 1172 ts_tablet_manager.cc:1403] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.003s
I20260617 07:53:09.111335 1172 raft_consensus.cc:359] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.111515 1172 raft_consensus.cc:385] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.111611 1172 raft_consensus.cc:740] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.111696 1048 raft_consensus.cc:2468] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:09.111829 1172 consensus_queue.cc:260] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.112324 1172 ts_tablet_manager.cc:1434] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:09.112439 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c1c44020a4586b3197f5f68a38963" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.112614 1172 tablet_bootstrap.cc:492] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:09.112967 852 leader_election.cc:343] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.113214 851 leader_election.cc:304] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.113606 1634 raft_consensus.cc:2804] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.113832 1634 raft_consensus.cc:697] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:09.114097 1634 consensus_queue.cc:237] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.118567 1172 tablet_bootstrap.cc:654] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.124846 1175 ts_tablet_manager.cc:1929] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.125003 1175 log.cc:1199] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/1f2cb23911614f9dab0767b1f6af3d00
I20260617 07:53:09.125414 1175 ts_tablet_manager.cc:1950] T 1f2cb23911614f9dab0767b1f6af3d00 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:09.134235 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 327) took 2726 ms. Trace:
I20260617 07:53:09.134370 1175 rpcz_store.cc:276] 0617 07:53:06.407795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.407860 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:09.068176 (+2660316us) ts_tablet_manager.cc:1151] Deleting tablet 1f2cb23911614f9dab0767b1f6af3d00
0617 07:53:09.068188 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.115427 (+ 47239us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.124745 (+ 9318us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.134197 (+ 9452us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2660086}
I20260617 07:53:09.134816 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 328) took 2714 ms. Trace:
I20260617 07:53:09.134924 1175 rpcz_store.cc:276] 0617 07:53:06.419883 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.420445 (+ 562us) service_pool.cc:224] Handling call
0617 07:53:09.134673 (+2714228us) ts_tablet_manager.cc:1151] Deleting tablet d21f61a35ca544568bcfca1a6230deca
0617 07:53:09.134685 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.134787 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2713979}
I20260617 07:53:09.135253 1175 tablet_replica.cc:333] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:09.135565 1175 raft_consensus.cc:2243] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.135793 1175 raft_consensus.cc:2272] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.136579 1175 ts_tablet_manager.cc:1916] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.145151 1169 ts_tablet_manager.cc:1929] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.146381 1171 tablet_bootstrap.cc:492] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.146624 1171 ts_tablet_manager.cc:1403] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.002s
I20260617 07:53:09.147469 1171 raft_consensus.cc:359] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.148049 1171 raft_consensus.cc:385] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.148172 1171 raft_consensus.cc:740] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.148531 1178 tablet_bootstrap.cc:492] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:09.148499 1171 consensus_queue.cc:260] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.148699 1178 ts_tablet_manager.cc:1403] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.156s user 0.009s sys 0.006s
I20260617 07:53:09.149145 1171 ts_tablet_manager.cc:1434] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:09.149500 1178 raft_consensus.cc:359] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:09.149688 1178 raft_consensus.cc:385] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.149806 1178 raft_consensus.cc:740] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.150094 1178 consensus_queue.cc:260] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:09.151928 1171 tablet_bootstrap.cc:492] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.153659 1171 tablet_bootstrap.cc:654] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.155350 1175 ts_tablet_manager.cc:1929] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.155175 1169 log.cc:1199] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/19f8525046964950884b0f9aa515ec81
I20260617 07:53:09.155503 1175 log.cc:1199] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/06e0f2f9a75d4f9ba8702e4da75c042f
I20260617 07:53:09.155913 1175 ts_tablet_manager.cc:1950] T 06e0f2f9a75d4f9ba8702e4da75c042f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:09.156634 1169 ts_tablet_manager.cc:1950] T 19f8525046964950884b0f9aa515ec81 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.156683 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 339) took 2633 ms. Trace:
I20260617 07:53:09.156788 1175 rpcz_store.cc:276] 0617 07:53:06.523098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.523231 (+ 133us) service_pool.cc:224] Handling call
0617 07:53:09.135191 (+2611960us) ts_tablet_manager.cc:1151] Deleting tablet 06e0f2f9a75d4f9ba8702e4da75c042f
0617 07:53:09.135199 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.147775 (+ 12576us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.155287 (+ 7512us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.156622 (+ 1335us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2610183}
I20260617 07:53:09.157219 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 344) took 2587 ms. Trace:
I20260617 07:53:09.157325 1175 rpcz_store.cc:276] 0617 07:53:06.570719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.570956 (+ 237us) service_pool.cc:224] Handling call
0617 07:53:09.157067 (+2586111us) ts_tablet_manager.cc:1151] Deleting tablet 6d8f144d04af4ea18f99aee3b82f4a28
0617 07:53:09.157077 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.157171 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2558594}
I20260617 07:53:09.157739 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 345) took 2584 ms. Trace:
I20260617 07:53:09.157831 1175 rpcz_store.cc:276] 0617 07:53:06.576200 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.576320 (+ 120us) service_pool.cc:224] Handling call
0617 07:53:09.157574 (+2581254us) ts_tablet_manager.cc:1151] Deleting tablet d80c2ffcf1b84df0bc6a468ea0929e80
0617 07:53:09.157583 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.157674 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2545789}
I20260617 07:53:09.158212 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 347) took 2575 ms. Trace:
I20260617 07:53:09.158304 1175 rpcz_store.cc:276] 0617 07:53:06.582365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.582431 (+ 66us) service_pool.cc:224] Handling call
0617 07:53:09.158067 (+2575636us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:09.158077 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.158166 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2545939}
I20260617 07:53:09.158659 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 343) took 2591 ms. Trace:
I20260617 07:53:09.158754 1175 rpcz_store.cc:276] 0617 07:53:06.567055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.567152 (+ 97us) service_pool.cc:224] Handling call
0617 07:53:09.158527 (+2591375us) ts_tablet_manager.cc:1151] Deleting tablet 0cfb98aecc4546c88371436fcfbf8e86
0617 07:53:09.158537 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.158608 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2528348}
I20260617 07:53:09.159143 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 350) took 2446 ms. Trace:
I20260617 07:53:09.159180 1178 ts_tablet_manager.cc:1434] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260617 07:53:09.159237 1175 rpcz_store.cc:276] 0617 07:53:06.713028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.713414 (+ 386us) service_pool.cc:224] Handling call
0617 07:53:09.158976 (+2445562us) ts_tablet_manager.cc:1151] Deleting tablet a882ae04eeb94276bb78ded81fbea708
0617 07:53:09.158986 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.159095 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2431687}
I20260617 07:53:09.159744 1170 ts_tablet_manager.cc:1929] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.159895 1178 tablet_bootstrap.cc:492] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:09.160267 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 336) took 2851 ms. Trace:
I20260617 07:53:09.160351 1172 tablet_bootstrap.cc:492] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.160593 1172 ts_tablet_manager.cc:1403] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.000s
I20260617 07:53:09.160728 1169 rpcz_store.cc:276] 0617 07:53:06.308333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.308601 (+ 268us) service_pool.cc:224] Handling call
0617 07:53:09.095426 (+2786825us) ts_tablet_manager.cc:1151] Deleting tablet 19f8525046964950884b0f9aa515ec81
0617 07:53:09.095436 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.141979 (+ 46543us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.145056 (+ 3077us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.160236 (+ 15180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2786606}
I20260617 07:53:09.161428 1172 raft_consensus.cc:359] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.161644 1172 raft_consensus.cc:385] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.161742 1172 raft_consensus.cc:740] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.161988 1172 consensus_queue.cc:260] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.162354 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 340) took 2750 ms. Trace:
I20260617 07:53:09.162513 1169 rpcz_store.cc:276] 0617 07:53:06.411631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.411681 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:09.162201 (+2750520us) ts_tablet_manager.cc:1151] Deleting tablet d21f61a35ca544568bcfca1a6230deca
0617 07:53:09.162211 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.162325 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2749914}
I20260617 07:53:09.162918 1172 ts_tablet_manager.cc:1434] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:09.163020 1170 log.cc:1199] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/8fa23bb0929440b1820afdce4b9e8d8c
I20260617 07:53:09.163491 1170 ts_tablet_manager.cc:1950] T 8fa23bb0929440b1820afdce4b9e8d8c P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.163769 1169 tablet_replica.cc:333] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:09.164011 1172 tablet_bootstrap.cc:492] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.164240 1169 raft_consensus.cc:2243] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:09.165730 1172 tablet_bootstrap.cc:654] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.166066 1169 raft_consensus.cc:2272] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.167490 1169 ts_tablet_manager.cc:1916] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.167587 1178 tablet_bootstrap.cc:654] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.177862 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 318) took 3259 ms. Trace:
I20260617 07:53:09.177995 1170 rpcz_store.cc:276] 0617 07:53:05.912407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.917501 (+ 5094us) service_pool.cc:224] Handling call
0617 07:53:09.081275 (+3163774us) ts_tablet_manager.cc:1151] Deleting tablet 8fa23bb0929440b1820afdce4b9e8d8c
0617 07:53:09.081284 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.102704 (+ 21420us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.154161 (+ 51457us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.171910 (+ 17749us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3163457}
I20260617 07:53:09.178524 1170 tablet_replica.cc:333] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.178725 1170 raft_consensus.cc:2243] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.179073 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 353) took 2256 ms. Trace:
I20260617 07:53:09.179189 1175 rpcz_store.cc:276] 0617 07:53:06.922256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.932058 (+ 9802us) service_pool.cc:224] Handling call
0617 07:53:09.159429 (+2227371us) ts_tablet_manager.cc:1151] Deleting tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
0617 07:53:09.178394 (+ 18965us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.179010 (+ 616us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2227164}
I20260617 07:53:09.180495 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 356) took 2227 ms. Trace:
I20260617 07:53:09.180603 1175 rpcz_store.cc:276] 0617 07:53:06.952630 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.952684 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:09.179463 (+2226779us) ts_tablet_manager.cc:1151] Deleting tablet 5203534569bd4da18bc06751f094735f
0617 07:53:09.180335 (+ 872us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.180424 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2226533}
I20260617 07:53:09.180698 1171 tablet_bootstrap.cc:492] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.180948 1171 ts_tablet_manager.cc:1403] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.003s
I20260617 07:53:09.180986 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 363) took 1865 ms. Trace:
I20260617 07:53:09.181082 1175 rpcz_store.cc:276] 0617 07:53:07.315306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.315418 (+ 112us) service_pool.cc:224] Handling call
0617 07:53:09.180825 (+1865407us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:09.180833 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.180912 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1859348}
I20260617 07:53:09.181370 1175 tablet_replica.cc:333] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:09.181578 1175 raft_consensus.cc:2243] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:09.181963 1175 raft_consensus.cc:2272] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.181998 1171 raft_consensus.cc:359] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.182284 1171 raft_consensus.cc:385] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.182426 1171 raft_consensus.cc:740] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.182546 1175 ts_tablet_manager.cc:1916] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.182751 1171 consensus_queue.cc:260] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.183934 1170 raft_consensus.cc:2272] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.184594 1170 ts_tablet_manager.cc:1916] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.185750 1171 ts_tablet_manager.cc:1434] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 07:53:09.186085 1171 tablet_bootstrap.cc:492] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.191684 1171 tablet_bootstrap.cc:654] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.193079 1178 tablet_bootstrap.cc:492] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:09.193274 1178 ts_tablet_manager.cc:1403] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.003s
I20260617 07:53:09.194312 1178 raft_consensus.cc:359] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.194552 1178 raft_consensus.cc:385] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.194646 1178 raft_consensus.cc:740] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.195075 1169 ts_tablet_manager.cc:1929] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.195000 1178 consensus_queue.cc:260] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.197395 1169 log.cc:1199] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/1f2cb23911614f9dab0767b1f6af3d00
I20260617 07:53:09.197926 1169 ts_tablet_manager.cc:1950] T 1f2cb23911614f9dab0767b1f6af3d00 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.199070 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 339) took 2787 ms. Trace:
I20260617 07:53:09.201373 1169 rpcz_store.cc:276] 0617 07:53:06.411481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.411954 (+ 473us) service_pool.cc:224] Handling call
0617 07:53:09.163715 (+2751761us) ts_tablet_manager.cc:1151] Deleting tablet 1f2cb23911614f9dab0767b1f6af3d00
0617 07:53:09.163723 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.170644 (+ 6921us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.194996 (+ 24352us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.199018 (+ 4022us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2751593}
I20260617 07:53:09.202082 1178 ts_tablet_manager.cc:1434] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260617 07:53:09.202450 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 354) took 2648 ms. Trace:
I20260617 07:53:09.202656 1172 tablet_bootstrap.cc:492] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.202814 1172 ts_tablet_manager.cc:1403] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20260617 07:53:09.202828 1169 rpcz_store.cc:276] 0617 07:53:06.553799 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.553876 (+ 77us) service_pool.cc:224] Handling call
0617 07:53:09.202113 (+2648237us) ts_tablet_manager.cc:1151] Deleting tablet 0cfb98aecc4546c88371436fcfbf8e86
0617 07:53:09.202122 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.202389 (+ 267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2429489}
I20260617 07:53:09.203610 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 355) took 2589 ms. Trace:
I20260617 07:53:09.203657 1172 raft_consensus.cc:359] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.203848 1172 raft_consensus.cc:385] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.203946 1172 raft_consensus.cc:740] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.204176 1172 consensus_queue.cc:260] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.204392 1169 rpcz_store.cc:276] 0617 07:53:06.613979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.614044 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:09.203479 (+2589435us) ts_tablet_manager.cc:1151] Deleting tablet 6d8f144d04af4ea18f99aee3b82f4a28
0617 07:53:09.203488 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.203566 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2411643}
I20260617 07:53:09.204726 1172 ts_tablet_manager.cc:1434] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:09.205027 1172 tablet_bootstrap.cc:492] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.206151 1171 tablet_bootstrap.cc:492] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.206478 1171 ts_tablet_manager.cc:1403] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.003s
I20260617 07:53:09.207284 1171 raft_consensus.cc:359] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.207545 1171 raft_consensus.cc:385] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.207661 1171 raft_consensus.cc:740] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.207962 1171 consensus_queue.cc:260] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.212399 1171 ts_tablet_manager.cc:1434] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 07:53:09.212755 1171 tablet_bootstrap.cc:492] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.208132 1172 tablet_bootstrap.cc:654] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.217126 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 357) took 2455 ms. Trace:
I20260617 07:53:09.217752 1169 rpcz_store.cc:276] 0617 07:53:06.761766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.761831 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:09.205196 (+2443365us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:09.205208 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.217059 (+ 11851us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2390863}
I20260617 07:53:09.219380 1170 ts_tablet_manager.cc:1929] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.219525 1170 log.cc:1199] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/262a34e120f34689ba0b598d7a2999fd
I20260617 07:53:09.219853 1169 tablet_replica.cc:333] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:09.219955 1170 ts_tablet_manager.cc:1950] T 262a34e120f34689ba0b598d7a2999fd P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.220762 1178 tablet_bootstrap.cc:492] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:09.220760 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 319) took 3268 ms. Trace:
I20260617 07:53:09.220870 1170 rpcz_store.cc:276] 0617 07:53:05.952525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:05.956231 (+ 3706us) service_pool.cc:224] Handling call
0617 07:53:09.178301 (+3222070us) ts_tablet_manager.cc:1151] Deleting tablet 262a34e120f34689ba0b598d7a2999fd
0617 07:53:09.178311 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.190425 (+ 12114us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.219286 (+ 28861us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.220722 (+ 1436us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3221773}
I20260617 07:53:09.221024 1169 raft_consensus.cc:2243] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.221202 1170 tablet_replica.cc:333] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.221413 1170 raft_consensus.cc:2243] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.221589 1170 raft_consensus.cc:2272] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.221951 1171 tablet_bootstrap.cc:654] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.221452 1169 raft_consensus.cc:2272] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.223088 1178 tablet_bootstrap.cc:654] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.223615 1169 ts_tablet_manager.cc:1916] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.232761 1175 ts_tablet_manager.cc:1929] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 07:53:09.232892 1175 log.cc:1199] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/006b71a3287240a5b15bfd489f514f4c
I20260617 07:53:09.234328 1728 raft_consensus.cc:493] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29a94ff9f875443ab6aeac00922cda0d)
I20260617 07:53:09.239234 1698 raft_consensus.cc:493] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.239423 1698 raft_consensus.cc:515] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.240178 1698 leader_election.cc:290] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.241032 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b291b1c9794faa9305f7d936604a44" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.241842 986 leader_election.cc:343] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.242018 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b291b1c9794faa9305f7d936604a44" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.242403 1172 tablet_bootstrap.cc:492] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
W20260617 07:53:09.242479 988 leader_election.cc:343] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.242604 1172 ts_tablet_manager.cc:1403] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.006s
I20260617 07:53:09.242668 988 leader_election.cc:304] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:09.243095 1698 raft_consensus.cc:2749] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.243443 1172 raft_consensus.cc:359] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.243628 1172 raft_consensus.cc:385] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.243695 1172 raft_consensus.cc:740] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.243906 1172 consensus_queue.cc:260] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.244431 1172 ts_tablet_manager.cc:1434] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:09.244462 1169 ts_tablet_manager.cc:1929] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.244575 1169 log.cc:1199] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a882ae04eeb94276bb78ded81fbea708
I20260617 07:53:09.244570 1728 raft_consensus.cc:515] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:09.244928 1169 ts_tablet_manager.cc:1950] T a882ae04eeb94276bb78ded81fbea708 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.245213 1170 ts_tablet_manager.cc:1916] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.245671 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 363) took 2463 ms. Trace:
I20260617 07:53:09.245674 1728 leader_election.cc:290] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505), 3b274c37ad4445ba8b41d6784b3cd336 (127.0.105.188:33087)
I20260617 07:53:09.245831 1169 rpcz_store.cc:276] 0617 07:53:06.782190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.784242 (+ 2052us) service_pool.cc:224] Handling call
0617 07:53:09.219779 (+2435537us) ts_tablet_manager.cc:1151] Deleting tablet a882ae04eeb94276bb78ded81fbea708
0617 07:53:09.219788 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.228321 (+ 8533us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.244368 (+ 16047us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.245632 (+ 1264us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2385836}
I20260617 07:53:09.247206 1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "becdd6b4fad846399c95f04697e01d0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 526 } } ignore_live_leader: false dest_uuid: "3b274c37ad4445ba8b41d6784b3cd336" is_pre_election: true
I20260617 07:53:09.247632 1171 tablet_bootstrap.cc:492] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.247681 1729 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29a94ff9f875443ab6aeac00922cda0d)
I20260617 07:53:09.247761 1171 ts_tablet_manager.cc:1403] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.001s
I20260617 07:53:09.247866 1729 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:09.248190 1452 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becdd6b4fad846399c95f04697e01d0f in term 1.
I20260617 07:53:09.248565 1171 raft_consensus.cc:359] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.248725 1171 raft_consensus.cc:385] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.248981 1171 raft_consensus.cc:740] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.249200 1171 consensus_queue.cc:260] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.251412 447 leader_election.cc:304] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b274c37ad4445ba8b41d6784b3cd336, becdd6b4fad846399c95f04697e01d0f; no voters:
I20260617 07:53:09.251714 1728 raft_consensus.cc:2804] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 07:53:09.252439 1728 raft_consensus.cc:493] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29a94ff9f875443ab6aeac00922cda0d)
I20260617 07:53:09.252563 1728 raft_consensus.cc:3060] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:09.252707 1171 ts_tablet_manager.cc:1434] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:09.252985 1171 tablet_bootstrap.cc:492] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.255227 1728 raft_consensus.cc:515] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:09.257237 1728 leader_election.cc:290] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [CANDIDATE]: Term 2 election: Requested vote from peers 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505), 3b274c37ad4445ba8b41d6784b3cd336 (127.0.105.188:33087)
I20260617 07:53:09.257514 1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "becdd6b4fad846399c95f04697e01d0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 526 } } ignore_live_leader: false dest_uuid: "3b274c37ad4445ba8b41d6784b3cd336"
I20260617 07:53:09.257745 1452 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:09.260092 1171 tablet_bootstrap.cc:654] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.260705 1172 tablet_bootstrap.cc:492] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.262916 1452 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becdd6b4fad846399c95f04697e01d0f in term 2.
I20260617 07:53:09.264600 447 leader_election.cc:304] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b274c37ad4445ba8b41d6784b3cd336, becdd6b4fad846399c95f04697e01d0f; no voters:
I20260617 07:53:09.264849 1729 leader_election.cc:290] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becdd6b4fad846399c95f04697e01d0f (127.0.105.190:41615), 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505)
I20260617 07:53:09.264957 1728 raft_consensus.cc:2804] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 2 FOLLOWER]: Leader election won for term 2
I20260617 07:53:09.265192 469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b274c37ad4445ba8b41d6784b3cd336" candidate_term: 2 candidate_status { last_received { term: 1 index: 526 } } ignore_live_leader: false dest_uuid: "becdd6b4fad846399c95f04697e01d0f" is_pre_election: true
I20260617 07:53:09.265292 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 356) took 2516 ms. Trace:
I20260617 07:53:09.265401 1169 rpcz_store.cc:276] 0617 07:53:06.754564 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.754974 (+ 410us) service_pool.cc:224] Handling call
0617 07:53:09.265133 (+2510159us) ts_tablet_manager.cc:1151] Deleting tablet d80c2ffcf1b84df0bc6a468ea0929e80
0617 07:53:09.265145 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.265257 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2431012}
I20260617 07:53:09.265928 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 367) took 2176 ms. Trace:
I20260617 07:53:09.266040 1169 rpcz_store.cc:276] 0617 07:53:07.090024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.090192 (+ 168us) service_pool.cc:224] Handling call
0617 07:53:09.265807 (+2175615us) ts_tablet_manager.cc:1151] Deleting tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
0617 07:53:09.265817 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.265899 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2175400}
I20260617 07:53:09.266480 1169 tablet_replica.cc:333] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:09.266706 1169 raft_consensus.cc:2243] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.266893 1169 raft_consensus.cc:2272] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.267103 1178 tablet_bootstrap.cc:492] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:09.267336 1178 ts_tablet_manager.cc:1403] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.003s
I20260617 07:53:09.267813 1169 ts_tablet_manager.cc:1916] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.268187 1178 raft_consensus.cc:359] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.268468 1178 raft_consensus.cc:385] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.268595 1178 raft_consensus.cc:740] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.268936 1178 consensus_queue.cc:260] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.270166 1175 ts_tablet_manager.cc:1950] T 006b71a3287240a5b15bfd489f514f4c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:09.273710 1178 ts_tablet_manager.cc:1434] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:09.274377 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 366) took 1896 ms. Trace:
I20260617 07:53:09.277806 1175 rpcz_store.cc:276] 0617 07:53:07.377895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.378132 (+ 237us) service_pool.cc:224] Handling call
0617 07:53:09.181290 (+1803158us) ts_tablet_manager.cc:1151] Deleting tablet 006b71a3287240a5b15bfd489f514f4c
0617 07:53:09.181298 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.228858 (+ 47560us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.232670 (+ 3812us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.274334 (+ 41664us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1786825}
I20260617 07:53:09.278429 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 370) took 1838 ms. Trace:
I20260617 07:53:09.278545 1175 rpcz_store.cc:276] 0617 07:53:07.440141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.440187 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:09.278248 (+1838061us) ts_tablet_manager.cc:1151] Deleting tablet d03d6dc473fc4be1a436fd71a06f403e
0617 07:53:09.278257 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.278383 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1827908}
I20260617 07:53:09.278825 1178 tablet_bootstrap.cc:492] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:09.280180 1171 tablet_bootstrap.cc:492] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.280351 1171 ts_tablet_manager.cc:1403] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260617 07:53:09.281071 1172 tablet_bootstrap.cc:654] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.281124 1171 raft_consensus.cc:359] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.281329 1171 raft_consensus.cc:385] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.281405 1171 raft_consensus.cc:740] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.281817 1728 raft_consensus.cc:697] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [term 2 LEADER]: Becoming Leader. State: Replica: becdd6b4fad846399c95f04697e01d0f, State: Running, Role: LEADER
I20260617 07:53:09.281759 1171 consensus_queue.cc:260] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.282370 1178 tablet_bootstrap.cc:654] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.282351 1728 consensus_queue.cc:237] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 526, Committed index: 526, Last appended: 1.526, Last appended by leader: 526, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:09.285039 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 371) took 1831 ms. Trace:
I20260617 07:53:09.285156 1175 rpcz_store.cc:276] 0617 07:53:07.453847 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.454168 (+ 321us) service_pool.cc:224] Handling call
0617 07:53:09.284862 (+1830694us) ts_tablet_manager.cc:1151] Deleting tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
0617 07:53:09.284871 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.285009 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1814136}
I20260617 07:53:09.285641 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 369) took 1848 ms. Trace:
I20260617 07:53:09.286201 1175 rpcz_store.cc:276] 0617 07:53:07.437361 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.457875 (+ 20514us) service_pool.cc:224] Handling call
0617 07:53:09.285520 (+1827645us) ts_tablet_manager.cc:1151] Deleting tablet 452f7d2bceb5447290370f72ec788608
0617 07:53:09.285530 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.285611 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1756474}
I20260617 07:53:09.286376 1171 ts_tablet_manager.cc:1434] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260617 07:53:09.286602 1175 tablet_replica.cc:333] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:09.286805 1175 raft_consensus.cc:2243] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.286991 1175 raft_consensus.cc:2272] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.287056 1698 raft_consensus.cc:493] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.287216 1698 raft_consensus.cc:515] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.287529 1175 ts_tablet_manager.cc:1916] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.287935 1698 leader_election.cc:290] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.289228 1171 tablet_bootstrap.cc:492] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.289963 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9db8a986b344548e435b77edc14cb6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.289963 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9db8a986b344548e435b77edc14cb6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.290510 988 leader_election.cc:343] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:09.290931 986 leader_election.cc:343] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.291079 986 leader_election.cc:304] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:09.291182 1170 ts_tablet_manager.cc:1929] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.291303 1170 log.cc:1199] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0dc0676db18c42259efb1ad7dbd140c8
I20260617 07:53:09.291716 1170 ts_tablet_manager.cc:1950] T 0dc0676db18c42259efb1ad7dbd140c8 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.291759 1698 raft_consensus.cc:2749] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.292549 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 324) took 3118 ms. Trace:
I20260617 07:53:09.292655 1170 rpcz_store.cc:276] 0617 07:53:06.174244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.174315 (+ 71us) service_pool.cc:224] Handling call
0617 07:53:09.221137 (+3046822us) ts_tablet_manager.cc:1151] Deleting tablet 0dc0676db18c42259efb1ad7dbd140c8
0617 07:53:09.221147 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.251552 (+ 30405us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.291108 (+ 39556us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.292496 (+ 1388us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3046570}
I20260617 07:53:09.293011 1170 tablet_replica.cc:333] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.293207 1170 raft_consensus.cc:2243] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.293241 1734 sys_catalog.cc:455] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader becdd6b4fad846399c95f04697e01d0f. Latest consensus state: current_term: 2 leader_uuid: "becdd6b4fad846399c95f04697e01d0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:09.293387 1170 raft_consensus.cc:2272] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.293392 1685 raft_consensus.cc:493] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.293464 1734 sys_catalog.cc:458] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: This master's current role is: LEADER
I20260617 07:53:09.293521 1685 raft_consensus.cc:515] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:09.293756 1171 tablet_bootstrap.cc:654] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.294673 1685 leader_election.cc:290] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:09.295876 716 leader_election.cc:343] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 69996eb4ab6e40f9b2d97e00d766822a
W20260617 07:53:09.296808 713 leader_election.cc:343] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 69996eb4ab6e40f9b2d97e00d766822a
I20260617 07:53:09.296940 713 leader_election.cc:304] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:09.297416 1685 raft_consensus.cc:2749] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.297545 1169 ts_tablet_manager.cc:1929] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.297659 1169 log.cc:1199] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/8fa23bb0929440b1820afdce4b9e8d8c
I20260617 07:53:09.298056 1169 ts_tablet_manager.cc:1950] T 8fa23bb0929440b1820afdce4b9e8d8c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.298740 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 364) took 2213 ms. Trace:
I20260617 07:53:09.298825 1169 rpcz_store.cc:276] 0617 07:53:07.086810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.091807 (+ 4997us) service_pool.cc:224] Handling call
0617 07:53:09.266423 (+2174616us) ts_tablet_manager.cc:1151] Deleting tablet 8fa23bb0929440b1820afdce4b9e8d8c
0617 07:53:09.266433 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.271221 (+ 4788us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.297478 (+ 26257us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.298690 (+ 1212us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2156167}
I20260617 07:53:09.302040 1170 ts_tablet_manager.cc:1916] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.308714 1169 tablet_replica.cc:333] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:09.308928 1169 raft_consensus.cc:2243] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.309118 1169 raft_consensus.cc:2272] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.309944 1737 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260617 07:53:09.310778 1175 ts_tablet_manager.cc:1929] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.310945 1175 log.cc:1199] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/074a3e08cc9a4be891016ce197a993be
I20260617 07:53:09.311353 1175 ts_tablet_manager.cc:1950] T 074a3e08cc9a4be891016ce197a993be P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:09.312368 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 388) took 1699 ms. Trace:
I20260617 07:53:09.312484 1175 rpcz_store.cc:276] 0617 07:53:07.612442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.700687 (+ 88245us) service_pool.cc:224] Handling call
0617 07:53:09.286533 (+1585846us) ts_tablet_manager.cc:1151] Deleting tablet 074a3e08cc9a4be891016ce197a993be
0617 07:53:09.286544 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.307001 (+ 20457us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.310700 (+ 3699us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.312299 (+ 1599us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1523139}
I20260617 07:53:09.314364 1169 ts_tablet_manager.cc:1916] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.315371 1171 tablet_bootstrap.cc:492] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.315532 1171 ts_tablet_manager.cc:1403] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.000s
I20260617 07:53:09.316329 1171 raft_consensus.cc:359] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.316531 1171 raft_consensus.cc:385] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.316639 1171 raft_consensus.cc:740] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.317353 1171 consensus_queue.cc:260] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.322244 1171 ts_tablet_manager.cc:1434] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260617 07:53:09.322901 1172 tablet_bootstrap.cc:492] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.323088 1172 ts_tablet_manager.cc:1403] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.012s
I20260617 07:53:09.323879 1172 raft_consensus.cc:359] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.324103 1172 raft_consensus.cc:385] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.324070 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]
I20260617 07:53:09.324226 1172 raft_consensus.cc:740] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.324539 1172 consensus_queue.cc:260] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.324738 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_768b8c0a1c2b4100aa62ae9ce4250864 [id=0520008198914d0994fb211238c522bf]
I20260617 07:53:09.325623 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_ec3b5256518241a1a661b1e8c1841123 [id=07868985fae742ce95c082e85caa6267]
I20260617 07:53:09.326553 1171 tablet_bootstrap.cc:492] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.328227 1171 tablet_bootstrap.cc:654] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.336081 1169 ts_tablet_manager.cc:1929] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.336220 1169 log.cc:1199] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5203534569bd4da18bc06751f094735f
I20260617 07:53:09.336565 1169 ts_tablet_manager.cc:1950] T 5203534569bd4da18bc06751f094735f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.336979 1178 tablet_bootstrap.cc:492] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:09.337194 1178 ts_tablet_manager.cc:1403] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.059s user 0.008s sys 0.005s
I20260617 07:53:09.337355 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 370) took 2228 ms. Trace:
I20260617 07:53:09.337474 1169 rpcz_store.cc:276] 0617 07:53:07.108614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.108794 (+ 180us) service_pool.cc:224] Handling call
0617 07:53:09.308631 (+2199837us) ts_tablet_manager.cc:1151] Deleting tablet 5203534569bd4da18bc06751f094735f
0617 07:53:09.308641 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.326511 (+ 17870us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.335991 (+ 9480us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.337318 (+ 1327us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2196215}
I20260617 07:53:09.338024 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 389) took 1725 ms. Trace:
I20260617 07:53:09.338133 1175 rpcz_store.cc:276] 0617 07:53:07.612536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.765409 (+152873us) service_pool.cc:224] Handling call
0617 07:53:09.337823 (+1572414us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:09.337833 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.337960 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1518851}
I20260617 07:53:09.338337 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_a0dbb3e035514253b4f61f11d26da473 [id=07f503d6e3f34dbc9eacdead783c4e9e]
I20260617 07:53:09.338500 1178 raft_consensus.cc:359] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.338769 1178 raft_consensus.cc:385] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.338784 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]
I20260617 07:53:09.338878 1178 raft_consensus.cc:740] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.339176 1178 consensus_queue.cc:260] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.339931 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]
I20260617 07:53:09.340359 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_073280306a2740119a28c4682671d83f [id=121feb8666fe4cb5b796fecf0bf1f8b0]
I20260617 07:53:09.340940 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_35ca50ee926746e499128390bf83c078 [id=12d27e43b2da42f7b55dbf5c9f4b103f]
I20260617 07:53:09.341465 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_7c71fb4276494d539fb7ccb468f0e300 [id=18b40cd6665e42f793ddb27a1dacbe73]
I20260617 07:53:09.341859 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_94ca7e593fc74524abf0ef739e7f986b [id=1951a43bb71a41bfaa40c0d3bedc99d0]
I20260617 07:53:09.342855 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_de275810487f4911a911f2d6e00a8963 [id=1f208e21034e47a8a25e0e9988e5b156]
I20260617 07:53:09.343369 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_bfa59190ca144c4d9d0cbab7a39eef9c [id=214df2f2d641469c91a78dfd5bb3aba8]
I20260617 07:53:09.344269 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_5df0947db0104ef6bb9e41fdb647e50c [id=23529b3c51f04f7093273ea0c6802bd5]
I20260617 07:53:09.344583 1685 raft_consensus.cc:493] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.344640 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_94149217b8fd42f3a46ed6df137e9f82 [id=251c405acf1c444ca8d6817889ffeed5]
I20260617 07:53:09.344710 1685 raft_consensus.cc:515] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.345002 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]
I20260617 07:53:09.345273 1685 leader_election.cc:290] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.345939 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd63aa802164f25aca72bea45ea3b96" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.346441 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 377) took 2231 ms. Trace:
I20260617 07:53:09.346585 1169 rpcz_store.cc:276] 0617 07:53:07.114810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.269064 (+154254us) service_pool.cc:224] Handling call
0617 07:53:09.345797 (+2076733us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:09.345807 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.346395 (+ 588us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1921494}
I20260617 07:53:09.347048 1169 tablet_replica.cc:333] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:09.347214 1178 ts_tablet_manager.cc:1434] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260617 07:53:09.347237 1169 raft_consensus.cc:2243] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.347424 1169 raft_consensus.cc:2272] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.347976 1169 ts_tablet_manager.cc:1916] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.350000 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 390) took 1737 ms. Trace:
I20260617 07:53:09.350103 1175 rpcz_store.cc:276] 0617 07:53:07.612607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.819251 (+206644us) service_pool.cc:224] Handling call
0617 07:53:09.349826 (+1530575us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:09.349835 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.349941 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1529960}
I20260617 07:53:09.350610 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 391) took 1737 ms. Trace:
I20260617 07:53:09.351125 1634 raft_consensus.cc:493] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.351167 1175 rpcz_store.cc:276] 0617 07:53:07.612704 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.819940 (+207236us) service_pool.cc:224] Handling call
0617 07:53:09.350468 (+1530528us) ts_tablet_manager.cc:1151] Deleting tablet 18f9bace06e34602acc7fcd7501b3671
0617 07:53:09.350475 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.350557 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1529890}
I20260617 07:53:09.351277 1634 raft_consensus.cc:515] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.351877 1634 leader_election.cc:290] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.351879 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 393) took 1593 ms. Trace:
I20260617 07:53:09.351999 1175 rpcz_store.cc:276] 0617 07:53:07.758551 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.893528 (+134977us) service_pool.cc:224] Handling call
0617 07:53:09.351717 (+1458189us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:09.351725 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.351835 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1438541}
I20260617 07:53:09.352445 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 395) took 1508 ms. Trace:
I20260617 07:53:09.352542 1175 rpcz_store.cc:276] 0617 07:53:07.844276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.949853 (+105577us) service_pool.cc:224] Handling call
0617 07:53:09.352315 (+1402462us) ts_tablet_manager.cc:1151] Deleting tablet 11794aa70824476e9751a41ab305cc80
0617 07:53:09.352324 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.352398 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1393382}
I20260617 07:53:09.352761 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.353005 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 396) took 1502 ms. Trace:
I20260617 07:53:09.353089 1175 rpcz_store.cc:276] 0617 07:53:07.850196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.958967 (+108771us) service_pool.cc:224] Handling call
0617 07:53:09.352857 (+1393890us) ts_tablet_manager.cc:1151] Deleting tablet 5dcfb101cf51487692ef9a6a17f40804
0617 07:53:09.352864 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.352951 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1392586}
W20260617 07:53:09.353315 852 leader_election.cc:343] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.353523 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 397) took 1503 ms. Trace:
I20260617 07:53:09.353603 1175 rpcz_store.cc:276] 0617 07:53:07.850319 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.960300 (+109981us) service_pool.cc:224] Handling call
0617 07:53:09.353399 (+1393099us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:09.353407 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.353478 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1392830}
I20260617 07:53:09.354120 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 398) took 1503 ms. Trace:
I20260617 07:53:09.354202 1175 rpcz_store.cc:276] 0617 07:53:07.850428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.960590 (+110162us) service_pool.cc:224] Handling call
0617 07:53:09.353993 (+1393403us) ts_tablet_manager.cc:1151] Deleting tablet 74ab8e93e3fe475ba9c7b5fce390a8ab
0617 07:53:09.354002 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.354076 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381867}
I20260617 07:53:09.354591 1175 tablet_replica.cc:333] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:09.354789 1175 raft_consensus.cc:2243] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.356076 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.356359 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd63aa802164f25aca72bea45ea3b96" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.356551 1048 raft_consensus.cc:2393] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6438857e0a7741ceaadf84cb9dc979e7 in current term 1: Already voted for candidate 8b7080d37ca245fe914d3dc90f17e3ba in this term.
I20260617 07:53:09.357079 1172 ts_tablet_manager.cc:1434] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.013s user 0.000s sys 0.001s
I20260617 07:53:09.357939 1046 raft_consensus.cc:2468] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.358385 851 leader_election.cc:304] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.358825 1634 raft_consensus.cc:2804] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.358927 1634 raft_consensus.cc:493] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.359023 1634 raft_consensus.cc:3060] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.362109 1172 tablet_bootstrap.cc:492] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.362491 1171 tablet_bootstrap.cc:492] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.362565 1634 raft_consensus.cc:515] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.362668 1171 ts_tablet_manager.cc:1403] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.003s
I20260617 07:53:09.363392 1171 raft_consensus.cc:359] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.363605 1171 raft_consensus.cc:385] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.363714 1171 raft_consensus.cc:740] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.364259 1171 consensus_queue.cc:260] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.364781 1171 ts_tablet_manager.cc:1434] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:09.345667 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]
I20260617 07:53:09.365653 1634 leader_election.cc:290] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.365955 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_da5430a09e3e44e48bafd3678bf638a2 [id=27e37deb26df4bb28507736f1decf709]
I20260617 07:53:09.366077 1171 tablet_bootstrap.cc:492] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.366376 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_187d6ce1f72947bead15cb026aa308cb [id=288a2e361ab149dca98dd515225f0ad7]
I20260617 07:53:09.367358 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_77163a83bea3432b8b2ea745bef42ce8 [id=2cd57d521b8b4434b456c086f0e36de8]
I20260617 07:53:09.367709 1171 tablet_bootstrap.cc:654] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.367733 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_f8e68ee7c0bf43b08f9c84454484121d [id=2ce20b981b024427aca662385456a101]
I20260617 07:53:09.368088 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]
I20260617 07:53:09.368611 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_e90ad53742c6427a87f6e2dfad5f9e54 [id=30f9fa100b704eb9bbc9a42cd664a4a5]
I20260617 07:53:09.369163 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_b8214873449f45f6be18047115a40c52 [id=32680a1bed374ba18c213d1bf46ce772]
I20260617 07:53:09.369433 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:09.369506 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_1f40cdfe73f54202b6223af377958372 [id=347683dc11c24e8e9f2e9eff1d671045]
I20260617 07:53:09.369632 1046 raft_consensus.cc:3060] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.370944 1169 ts_tablet_manager.cc:1929] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 07:53:09.371054 1169 log.cc:1199] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/006b71a3287240a5b15bfd489f514f4c
I20260617 07:53:09.371382 1169 ts_tablet_manager.cc:1950] T 006b71a3287240a5b15bfd489f514f4c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.372062 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 380) took 2254 ms. Trace:
I20260617 07:53:09.372154 1169 rpcz_store.cc:276] 0617 07:53:07.117642 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.305193 (+187551us) service_pool.cc:224] Handling call
0617 07:53:09.346995 (+2041802us) ts_tablet_manager.cc:1151] Deleting tablet 006b71a3287240a5b15bfd489f514f4c
0617 07:53:09.347003 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.362825 (+ 15822us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.370867 (+ 8042us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.372011 (+ 1144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1773566}
I20260617 07:53:09.372329 1046 raft_consensus.cc:2468] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:09.372677 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 383) took 2088 ms. Trace:
I20260617 07:53:09.372786 851 leader_election.cc:304] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:09.372964 1170 ts_tablet_manager.cc:1929] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.373049 1634 raft_consensus.cc:2804] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.373072 1170 log.cc:1199] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/b01721f68e3c41f4a2ffaf05bb180761
I20260617 07:53:09.373181 1634 raft_consensus.cc:697] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:09.373417 1170 ts_tablet_manager.cc:1950] T b01721f68e3c41f4a2ffaf05bb180761 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.373431 1634 consensus_queue.cc:237] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.374181 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 326) took 3172 ms. Trace:
I20260617 07:53:09.374289 1170 rpcz_store.cc:276] 0617 07:53:06.201990 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.202052 (+ 62us) service_pool.cc:224] Handling call
0617 07:53:09.292929 (+3090877us) ts_tablet_manager.cc:1151] Deleting tablet b01721f68e3c41f4a2ffaf05bb180761
0617 07:53:09.292940 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.326480 (+ 33540us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.372864 (+ 46384us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.374145 (+ 1281us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3088621}
I20260617 07:53:09.374588 1170 tablet_replica.cc:333] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.374797 1170 raft_consensus.cc:2243] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.374969 1170 raft_consensus.cc:2272] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.372777 1169 rpcz_store.cc:276] 0617 07:53:07.283907 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.573634 (+289727us) service_pool.cc:224] Handling call
0617 07:53:09.372496 (+1798862us) ts_tablet_manager.cc:1151] Deleting tablet d03d6dc473fc4be1a436fd71a06f403e
0617 07:53:09.372504 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.372622 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1798179}
I20260617 07:53:09.375474 1170 ts_tablet_manager.cc:1916] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.375605 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 384) took 2069 ms. Trace:
I20260617 07:53:09.375711 1169 rpcz_store.cc:276] 0617 07:53:07.306326 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.574440 (+268114us) service_pool.cc:224] Handling call
0617 07:53:09.375424 (+1800984us) ts_tablet_manager.cc:1151] Deleting tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
0617 07:53:09.375432 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.375540 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1775684}
I20260617 07:53:09.376688 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_a25f1398f97f4c2b99ec71d2ce42f295 [id=36382a6d7a5b4ad4b40d94994f91f627]
I20260617 07:53:09.377067 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_0ebdf4b1d9ba4845958bccb5883ec491 [id=369a4a7b1948442aa0520b679c3cf974]
I20260617 07:53:09.377434 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]
I20260617 07:53:09.378468 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 401) took 1378 ms. Trace:
I20260617 07:53:09.378561 1169 rpcz_store.cc:276] 0617 07:53:07.999996 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.260553 (+260557us) service_pool.cc:224] Handling call
0617 07:53:09.378319 (+1117766us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:09.378328 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.378408 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1116663}
I20260617 07:53:09.379833 1172 tablet_bootstrap.cc:654] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.382133 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 402) took 1382 ms. Trace:
I20260617 07:53:09.382228 1169 rpcz_store.cc:276] 0617 07:53:08.000095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.261672 (+261577us) service_pool.cc:224] Handling call
0617 07:53:09.381930 (+1120258us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:09.381939 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.382074 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1046581}
I20260617 07:53:09.382560 1171 tablet_bootstrap.cc:492] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.382732 1171 ts_tablet_manager.cc:1403] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20260617 07:53:09.383211 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]
I20260617 07:53:09.383659 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]
I20260617 07:53:09.383601 1171 raft_consensus.cc:359] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.383772 1171 raft_consensus.cc:385] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.383888 1171 raft_consensus.cc:740] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.384110 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_665c19b8c9d14ccc9f5beb633b690e13 [id=3ab32aa970c24c1bbde1768b3defee07]
I20260617 07:53:09.384114 1171 consensus_queue.cc:260] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.384550 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]
I20260617 07:53:09.384794 1171 ts_tablet_manager.cc:1434] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:09.385037 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_0a73e0c5eead4482b2f6747fec27846f [id=3cda30618acd40f08728b0ccb01bb973]
I20260617 07:53:09.385104 1171 tablet_bootstrap.cc:492] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.385437 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_135d8e6c7f9a41ef809b7e98a6e02c97 [id=3d306a3bde784759bd8e3a45fa8cddec]
I20260617 07:53:09.354990 1175 raft_consensus.cc:2272] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.357044 713 leader_election.cc:304] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:09.386054 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 403) took 1385 ms. Trace:
I20260617 07:53:09.386158 1169 rpcz_store.cc:276] 0617 07:53:08.000178 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.261987 (+261809us) service_pool.cc:224] Handling call
0617 07:53:09.385868 (+1123881us) ts_tablet_manager.cc:1151] Deleting tablet 18f9bace06e34602acc7fcd7501b3671
0617 07:53:09.385877 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.385993 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1046732}
I20260617 07:53:09.386438 1175 ts_tablet_manager.cc:1916] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.386678 1685 raft_consensus.cc:3060] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.387022 1171 tablet_bootstrap.cc:654] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.387204 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 408) took 1386 ms. Trace:
I20260617 07:53:09.387305 1169 rpcz_store.cc:276] 0617 07:53:08.000659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.339149 (+338490us) service_pool.cc:224] Handling call
0617 07:53:09.387041 (+1047892us) ts_tablet_manager.cc:1151] Deleting tablet 11794aa70824476e9751a41ab305cc80
0617 07:53:09.387050 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.387145 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1047753}
I20260617 07:53:09.388530 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 405) took 1388 ms. Trace:
I20260617 07:53:09.388612 1169 rpcz_store.cc:276] 0617 07:53:08.000379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.298770 (+298391us) service_pool.cc:224] Handling call
0617 07:53:09.388265 (+1089495us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:09.388272 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.388483 (+ 211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1044363}
I20260617 07:53:09.389298 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 409) took 1388 ms. Trace:
I20260617 07:53:09.389372 1169 rpcz_store.cc:276] 0617 07:53:08.000745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.339290 (+338545us) service_pool.cc:224] Handling call
0617 07:53:09.389176 (+1049886us) ts_tablet_manager.cc:1151] Deleting tablet 5dcfb101cf51487692ef9a6a17f40804
0617 07:53:09.389184 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.389254 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1037725}
I20260617 07:53:09.389901 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.390424 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 410) took 1389 ms. Trace:
I20260617 07:53:09.390496 1169 rpcz_store.cc:276] 0617 07:53:08.000872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.343933 (+343061us) service_pool.cc:224] Handling call
0617 07:53:09.390311 (+1046378us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:09.390317 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.390382 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1037755}
W20260617 07:53:09.391172 852 leader_election.cc:343] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.391578 1685 raft_consensus.cc:2749] T ddd63aa802164f25aca72bea45ea3b96 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.356015 1178 tablet_bootstrap.cc:492] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:09.393546 1178 tablet_bootstrap.cc:654] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.393558 1170 ts_tablet_manager.cc:1929] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.403030 1169 tablet_replica.cc:333] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:09.403221 1169 raft_consensus.cc:2243] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:09.403390 1171 tablet_bootstrap.cc:492] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.404007 1171 ts_tablet_manager.cc:1403] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260617 07:53:09.404556 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_76ba66e135e34c4cab87ecfb9db4d2f5 [id=408ae87558644eb799bec6ab8d1ad2c1]
I20260617 07:53:09.404757 1171 raft_consensus.cc:359] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.404946 1171 raft_consensus.cc:385] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.405011 1171 raft_consensus.cc:740] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.405046 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_26c85eb5e09949859f6e4039e66bd282 [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]
I20260617 07:53:09.405249 1171 consensus_queue.cc:260] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.405822 1171 ts_tablet_manager.cc:1434] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 07:53:09.406127 1171 tablet_bootstrap.cc:492] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.406282 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa [id=4d565f22e74c4c9d97a5b367e2b016b4]
I20260617 07:53:09.406759 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]
I20260617 07:53:09.407203 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_66c2a830c5a94c0c9f70f12f18100bd5 [id=4f545023638349f686a11acaade9abfe]
I20260617 07:53:09.393693 1170 log.cc:1199] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/7582d201bc5843949d4be08ee7586f9d
I20260617 07:53:09.407800 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a]
I20260617 07:53:09.407960 1171 tablet_bootstrap.cc:654] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.408030 1170 ts_tablet_manager.cc:1950] T 7582d201bc5843949d4be08ee7586f9d P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.408464 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_30348a000daf4ff5b621f97ed5766bd6 [id=52357c6af1e04f2c82768cb39fe1be8d]
I20260617 07:53:09.408872 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 325) took 3230 ms. Trace:
I20260617 07:53:09.408991 1170 rpcz_store.cc:276] 0617 07:53:06.178024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.178077 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:09.374532 (+3196455us) ts_tablet_manager.cc:1151] Deleting tablet 7582d201bc5843949d4be08ee7586f9d
0617 07:53:09.374540 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.390579 (+ 16039us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.393489 (+ 2910us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.408814 (+ 15325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3170075}
I20260617 07:53:09.409456 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 327) took 3202 ms. Trace:
I20260617 07:53:09.409547 1170 rpcz_store.cc:276] 0617 07:53:06.206787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.206835 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:09.409285 (+3202450us) ts_tablet_manager.cc:1151] Deleting tablet 245cff69d83b43e98b1c72b8d3011347
0617 07:53:09.409295 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.409393 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3202264}
I20260617 07:53:09.409725 1169 raft_consensus.cc:2272] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.409862 1170 tablet_replica.cc:333] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.410046 1170 raft_consensus.cc:2243] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.410207 1170 raft_consensus.cc:2272] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.410576 1169 ts_tablet_manager.cc:1916] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.410678 1170 ts_tablet_manager.cc:1916] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.413558 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_5939ce898cc14175961237f56bde80ba [id=5a3a690ecbb34b44a83b177bca7926aa]
I20260617 07:53:09.414039 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_06a54fcfd98445bbafab5f9750da86ea [id=5a4c1e6d9cd541089b5e273664d73be9]
I20260617 07:53:09.414462 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275]
I20260617 07:53:09.414964 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]
I20260617 07:53:09.415804 1178 tablet_bootstrap.cc:492] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:09.415953 1178 ts_tablet_manager.cc:1403] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.060s user 0.007s sys 0.000s
I20260617 07:53:09.417161 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]
I20260617 07:53:09.417338 1178 raft_consensus.cc:359] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.417543 1178 raft_consensus.cc:385] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.417622 1178 raft_consensus.cc:740] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.417884 1178 consensus_queue.cc:260] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.421783 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_4b89f3bc484f44458e623c0e47f28f5f [id=683c9be609d948c8b135b8648a820447]
I20260617 07:53:09.421830 1175 ts_tablet_manager.cc:1929] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.421973 1175 log.cc:1199] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/ddc0439f992048358f1de4381516e543
I20260617 07:53:09.422408 1175 ts_tablet_manager.cc:1950] T ddc0439f992048358f1de4381516e543 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:09.422703 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]
I20260617 07:53:09.423202 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 399) took 1344 ms. Trace:
I20260617 07:53:09.423393 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]
I20260617 07:53:09.423338 1175 rpcz_store.cc:276] 0617 07:53:08.078344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.078512 (+ 168us) service_pool.cc:224] Handling call
0617 07:53:09.354508 (+1275996us) ts_tablet_manager.cc:1151] Deleting tablet ddc0439f992048358f1de4381516e543
0617 07:53:09.354517 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.406202 (+ 51685us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.421744 (+ 15542us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.423168 (+ 1424us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1273886}
I20260617 07:53:09.423955 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]
I20260617 07:53:09.424089 1178 ts_tablet_manager.cc:1434] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260617 07:53:09.424541 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_6e54085dfd0041d2bdb49961526e7594 [id=6f0e007c645a43e6a9611001e0de1864]
I20260617 07:53:09.426806 1169 ts_tablet_manager.cc:1929] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.426944 1169 log.cc:1199] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/ddc0439f992048358f1de4381516e543
I20260617 07:53:09.427148 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_664d31b291bf448b98ad89d939ce5477 [id=752bd629dc0a4345b59cc4536e2e95d3]
I20260617 07:53:09.427431 1169 ts_tablet_manager.cc:1950] T ddc0439f992048358f1de4381516e543 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.428187 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 412) took 1332 ms. Trace:
I20260617 07:53:09.428298 1178 tablet_bootstrap.cc:492] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:09.428313 1169 rpcz_store.cc:276] 0617 07:53:08.096157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.351474 (+255317us) service_pool.cc:224] Handling call
0617 07:53:09.402943 (+1051469us) ts_tablet_manager.cc:1151] Deleting tablet ddc0439f992048358f1de4381516e543
0617 07:53:09.402950 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.419630 (+ 16680us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.426723 (+ 7093us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.428150 (+ 1427us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1038016}
I20260617 07:53:09.428747 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 416) took 1256 ms. Trace:
I20260617 07:53:09.428787 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]
I20260617 07:53:09.428869 1169 rpcz_store.cc:276] 0617 07:53:08.172535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.376812 (+204277us) service_pool.cc:224] Handling call
0617 07:53:09.428605 (+1051793us) ts_tablet_manager.cc:1151] Deleting tablet 570ae1e189a64da6bad10156b401ec46
0617 07:53:09.428616 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.428719 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1051576}
I20260617 07:53:09.429656 1171 tablet_bootstrap.cc:492] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.429772 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 411) took 1428 ms. Trace:
I20260617 07:53:09.429925 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 404) took 1269 ms. Trace:
I20260617 07:53:09.429883 1169 rpcz_store.cc:276] 0617 07:53:08.001002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.351080 (+350078us) service_pool.cc:224] Handling call
0617 07:53:09.429617 (+1078537us) ts_tablet_manager.cc:1151] Deleting tablet 74ab8e93e3fe475ba9c7b5fce390a8ab
0617 07:53:09.429627 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.429735 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1035695}
I20260617 07:53:09.430044 1175 rpcz_store.cc:276] 0617 07:53:08.160133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.160361 (+ 228us) service_pool.cc:224] Handling call
0617 07:53:09.428068 (+1267707us) ts_tablet_manager.cc:1151] Deleting tablet 570ae1e189a64da6bad10156b401ec46
0617 07:53:09.429751 (+ 1683us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.429880 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1267465}
I20260617 07:53:09.430259 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 421) took 1196 ms. Trace:
I20260617 07:53:09.430362 1169 rpcz_store.cc:276] 0617 07:53:08.233459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.401583 (+168124us) service_pool.cc:224] Handling call
0617 07:53:09.430095 (+1028512us) ts_tablet_manager.cc:1151] Deleting tablet 0fd8cedb539748dc917128511325bbcc
0617 07:53:09.430103 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.430231 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1021870}
I20260617 07:53:09.430485 1175 tablet_replica.cc:333] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:09.430691 1175 raft_consensus.cc:2243] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:09.430721 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 420) took 1199 ms. Trace:
I20260617 07:53:09.430824 1169 rpcz_store.cc:276] 0617 07:53:08.230783 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.393950 (+163167us) service_pool.cc:224] Handling call
0617 07:53:09.430609 (+1036659us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:09.430617 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.430692 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1016223}
I20260617 07:53:09.430953 1175 pending_rounds.cc:70] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: Trying to abort 1 pending ops.
I20260617 07:53:09.431033 1175 pending_rounds.cc:77] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772702595100672 op_type: NO_OP noop_request { }
I20260617 07:53:09.431142 1175 raft_consensus.cc:2889] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:09.431149 1169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43908 (request call id 422) took 1194 ms. Trace:
I20260617 07:53:09.431253 1175 raft_consensus.cc:2272] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.431257 1169 rpcz_store.cc:276] 0617 07:53:08.237166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.409327 (+172161us) service_pool.cc:224] Handling call
0617 07:53:09.431049 (+1021722us) ts_tablet_manager.cc:1151] Deleting tablet df37ed81b17d4178adeb6057491b4cc9
0617 07:53:09.431057 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.431125 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":977090}
I20260617 07:53:09.431558 1169 tablet_replica.cc:333] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:09.431751 1169 raft_consensus.cc:2243] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:09.431933 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]
I20260617 07:53:09.432003 1169 pending_rounds.cc:70] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:09.432075 1169 pending_rounds.cc:77] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772703048036352 op_type: NO_OP noop_request { }
I20260617 07:53:09.432184 1169 raft_consensus.cc:2889] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:09.432302 1169 raft_consensus.cc:2272] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.432729 1171 ts_tablet_manager.cc:1403] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260617 07:53:09.433143 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d]
I20260617 07:53:09.433691 1171 raft_consensus.cc:359] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.433897 1171 raft_consensus.cc:385] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.434020 1171 raft_consensus.cc:740] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.434281 1171 consensus_queue.cc:260] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.434444 1175 ts_tablet_manager.cc:1916] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.434863 1171 ts_tablet_manager.cc:1434] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:09.435175 1171 tablet_bootstrap.cc:492] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.438280 1171 tablet_bootstrap.cc:654] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.439677 1170 ts_tablet_manager.cc:1929] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.439800 1170 log.cc:1199] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/950c1c44020a4586b3197f5f68a38963
I20260617 07:53:09.440222 1170 ts_tablet_manager.cc:1950] T 950c1c44020a4586b3197f5f68a38963 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.440296 1178 tablet_bootstrap.cc:654] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.441015 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 331) took 3199 ms. Trace:
I20260617 07:53:09.441133 1170 rpcz_store.cc:276] 0617 07:53:06.241409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.241778 (+ 369us) service_pool.cc:224] Handling call
0617 07:53:09.409789 (+3168011us) ts_tablet_manager.cc:1151] Deleting tablet 950c1c44020a4586b3197f5f68a38963
0617 07:53:09.409797 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.428478 (+ 18681us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.439588 (+ 11110us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.440977 (+ 1389us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3167268}
I20260617 07:53:09.441581 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 336) took 3145 ms. Trace:
I20260617 07:53:09.443948 1172 tablet_bootstrap.cc:492] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.433847 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]
I20260617 07:53:09.444149 1172 ts_tablet_manager.cc:1403] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.082s user 0.000s sys 0.011s
I20260617 07:53:09.445041 1172 raft_consensus.cc:359] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.445271 1172 raft_consensus.cc:385] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.445361 1172 raft_consensus.cc:740] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.446684 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_ad19666d956d43a7979b4226f9645fef [id=7a23152402da4e608156935807a7b61b]
I20260617 07:53:09.447106 1634 raft_consensus.cc:493] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.447245 1634 raft_consensus.cc:515] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.447845 1634 leader_election.cc:290] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.448494 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc0676db18c42259efb1ad7dbd140c8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.449095 852 leader_election.cc:343] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.449095 1169 ts_tablet_manager.cc:1916] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.449501 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_a324b6c42b014d8c97cc1dec8d9d8ca6 [id=7a56001e416e4428ae182d851d149550]
I20260617 07:53:09.450637 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_9f97b99a0ab74a3782a8dfa84db280cc [id=813f40f457074561b406da3616edb14c]
I20260617 07:53:09.441685 1170 rpcz_store.cc:276] 0617 07:53:06.296270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.296319 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:09.441436 (+3145117us) ts_tablet_manager.cc:1151] Deleting tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
0617 07:53:09.441448 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.441552 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3144844}
I20260617 07:53:09.452837 1171 tablet_bootstrap.cc:492] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:09.452900 851 leader_election.cc:343] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 0dc0676db18c42259efb1ad7dbd140c8
I20260617 07:53:09.452836 1172 consensus_queue.cc:260] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.453019 1171 ts_tablet_manager.cc:1403] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.003s
I20260617 07:53:09.453039 851 leader_election.cc:304] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:09.453676 1634 raft_consensus.cc:2749] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.454264 1171 raft_consensus.cc:359] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.454526 1171 raft_consensus.cc:385] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.454648 1171 raft_consensus.cc:740] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.454941 1171 consensus_queue.cc:260] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.455559 1169 ts_tablet_manager.cc:1929] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.455667 1169 log.cc:1199] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/7582d201bc5843949d4be08ee7586f9d
I20260617 07:53:09.456082 1169 ts_tablet_manager.cc:1950] T 7582d201bc5843949d4be08ee7586f9d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:09.459086 1171 ts_tablet_manager.cc:1434] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:09.459450 1171 tablet_bootstrap.cc:492] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.461031 1171 tablet_bootstrap.cc:654] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.461819 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_bd0db0a6290342548196f468ee98943f [id=8193bedf37784197bebc39d711a8eb2b]
I20260617 07:53:09.463485 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_ac940c0f5a9d49babeff827981e9d7d3 [id=829b5684836747b2aa4265ac17eccd80]
I20260617 07:53:09.466486 1175 ts_tablet_manager.cc:1929] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.466637 1175 log.cc:1199] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/f345910256784d2085cb81473534dcaf
I20260617 07:53:09.466679 1634 consensus_queue.cc:1048] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:09.467114 1175 ts_tablet_manager.cc:1950] T f345910256784d2085cb81473534dcaf P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:09.467384 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_e59c908749124f0abd3e5aabc1029149 [id=84bcdf2b9c4e41c5bcd458e52fe90144]
I20260617 07:53:09.467963 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 405) took 1306 ms. Trace:
I20260617 07:53:09.468047 1698 raft_consensus.cc:493] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.468094 1175 rpcz_store.cc:276] 0617 07:53:08.161134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.163364 (+ 2230us) service_pool.cc:224] Handling call
0617 07:53:09.430422 (+1267058us) ts_tablet_manager.cc:1151] Deleting tablet f345910256784d2085cb81473534dcaf
0617 07:53:09.430431 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.437501 (+ 7070us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.466376 (+ 28875us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.467923 (+ 1547us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1266861}
I20260617 07:53:09.468587 1175 tablet_replica.cc:333] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:09.468823 1175 raft_consensus.cc:2243] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.468986 1175 raft_consensus.cc:2272] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.469465 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_69167a2936fa47a08d1f53dfec14f52b [id=8738ee5e888742f9a7c0aa0c9085dc75]
I20260617 07:53:09.469527 1175 ts_tablet_manager.cc:1916] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.470151 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_e01c4bf739194d638e2a3988702d4cfb [id=87e7c45adff04a7eb2c6edf0b75a047c]
I20260617 07:53:09.470621 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_599c014ad57e446a951f4d7cfc3a09b3 [id=885235c3332d4c4c9f62503732d3a38e]
I20260617 07:53:09.471045 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_d7a2cf493ddd427c9087f6b6b1971450 [id=8b962c8429894c52a1ba7296a6f02205]
I20260617 07:53:09.474149 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]
I20260617 07:53:09.475023 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_971d911bece54aee98e3b98f349f0aad [id=912e818e8697427a8ce7dc146b9a428f]
I20260617 07:53:09.476169 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_010f16ad25e74ae9a880163fe9e08de8 [id=94a23a9e1e434285acc94bced26578f6]
I20260617 07:53:09.476866 1175 ts_tablet_manager.cc:1929] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.477020 1175 log.cc:1199] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/787467c65f68442aad071df16d4492f3
I20260617 07:53:09.477372 1175 ts_tablet_manager.cc:1950] T 787467c65f68442aad071df16d4492f3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:09.480603 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_90eee67c1b8d48cfac17fa339cb10a2b [id=951e230ec1f84717b9ed7d19f4dfbc16]
I20260617 07:53:09.482340 1698 raft_consensus.cc:515] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.483067 1698 leader_election.cc:290] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.483986 1698 raft_consensus.cc:493] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.484131 1698 raft_consensus.cc:515] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.484690 1698 leader_election.cc:290] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.485611 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763581e2baeb46149bfb38d81301b9c5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.486215 986 leader_election.cc:343] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.486665 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cf9c672f3b4567b63e878a6ab11334" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.487251 986 leader_election.cc:343] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.488250 1172 ts_tablet_manager.cc:1434] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.044s user 0.001s sys 0.002s
I20260617 07:53:09.488940 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_85c6acc2e0744783bfa3d2f6f6162552 [id=965c116ab3dc4e32ad0febae905610e4]
I20260617 07:53:09.489490 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_528f3acf30374a4d83a514a59fda209b [id=9726df7d693441359861876ae1179b4d]
I20260617 07:53:09.490007 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_00d654600a8a474d84c1678c529d4489 [id=9776f24641614e23a1ea878c6aad0efa]
I20260617 07:53:09.490113 1171 tablet_bootstrap.cc:492] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.490263 1171 ts_tablet_manager.cc:1403] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260617 07:53:09.490319 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 406) took 1318 ms. Trace:
I20260617 07:53:09.490610 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]
I20260617 07:53:09.490684 1172 tablet_bootstrap.cc:492] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.490502 1175 rpcz_store.cc:276] 0617 07:53:08.171581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.171846 (+ 265us) service_pool.cc:224] Handling call
0617 07:53:09.468519 (+1296673us) ts_tablet_manager.cc:1151] Deleting tablet 787467c65f68442aad071df16d4492f3
0617 07:53:09.468527 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.472997 (+ 4470us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.476774 (+ 3777us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.490261 (+ 13487us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1296375}
I20260617 07:53:09.491142 1171 raft_consensus.cc:359] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.491272 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_e0a022b4ea4c4845bfea835c7373a969 [id=9ec5b57144a547818de080724a665c09]
I20260617 07:53:09.491333 1171 raft_consensus.cc:385] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.491243 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 410) took 1276 ms. Trace:
I20260617 07:53:09.491446 1171 raft_consensus.cc:740] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.491559 1175 rpcz_store.cc:276] 0617 07:53:08.214841 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.214919 (+ 78us) service_pool.cc:224] Handling call
0617 07:53:09.491094 (+1276175us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:09.491103 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.491190 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1275774}
I20260617 07:53:09.491688 1171 consensus_queue.cc:260] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.492252 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 411) took 1277 ms. Trace:
I20260617 07:53:09.492368 1171 ts_tablet_manager.cc:1434] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:09.492391 1175 rpcz_store.cc:276] 0617 07:53:08.214992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.215256 (+ 264us) service_pool.cc:224] Handling call
0617 07:53:09.492103 (+1276847us) ts_tablet_manager.cc:1151] Deleting tablet 0fd8cedb539748dc917128511325bbcc
0617 07:53:09.492112 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.492201 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1276660}
I20260617 07:53:09.492666 1171 tablet_bootstrap.cc:492] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.493522 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 412) took 1277 ms. Trace:
I20260617 07:53:09.493680 1175 rpcz_store.cc:276] 0617 07:53:08.215119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.216843 (+ 1724us) service_pool.cc:224] Handling call
0617 07:53:09.492909 (+1276066us) ts_tablet_manager.cc:1151] Deleting tablet df37ed81b17d4178adeb6057491b4cc9
0617 07:53:09.492918 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.492996 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1275837}
I20260617 07:53:09.494258 1175 tablet_replica.cc:333] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:09.494506 1175 raft_consensus.cc:2243] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.494709 1171 tablet_bootstrap.cc:654] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.494810 1175 raft_consensus.cc:2272] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.495383 1175 ts_tablet_manager.cc:1916] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.496632 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_85519a333a1f4899b5a22d43b69fe3cb [id=a141eeb977ca4329ac1404fefb355281]
I20260617 07:53:09.499914 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_2e08b8585e3744a486d5d2c7c227a6c5 [id=a5edc6ed0cb14a0ca2714894a6852ca7]
I20260617 07:53:09.500564 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_eea666288e104386986507e494503cad [id=a8f0e5c51bec410793bcf9283fd190e3]
I20260617 07:53:09.501037 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_c918313039f74feabcd522092350ffa1 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]
I20260617 07:53:09.502386 1175 ts_tablet_manager.cc:1929] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.502575 1175 log.cc:1199] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a460aee4eb514a87b272c4fc858335e7
I20260617 07:53:09.504336 1171 tablet_bootstrap.cc:492] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.504333 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_ddca8eb1aba6417a8cb8a723dd38551b [id=ab7b996d094f49df9532f308d8615d08]
I20260617 07:53:09.504577 1171 ts_tablet_manager.cc:1403] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20260617 07:53:09.505019 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]
I20260617 07:53:09.505461 1171 raft_consensus.cc:359] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.505672 1171 raft_consensus.cc:385] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.505781 1171 raft_consensus.cc:740] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.506053 1171 consensus_queue.cc:260] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.506554 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_872caaea54e048e697337c5c43b80a92 [id=af0c8ea1c1d94ba1a847371952858f99]
I20260617 07:53:09.506713 1171 ts_tablet_manager.cc:1434] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:09.503043 1175 ts_tablet_manager.cc:1950] T a460aee4eb514a87b272c4fc858335e7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:09.508642 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38066 (request call id 415) took 1106 ms. Trace:
I20260617 07:53:09.508682 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]
I20260617 07:53:09.508793 1175 rpcz_store.cc:276] 0617 07:53:08.401964 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.402062 (+ 98us) service_pool.cc:224] Handling call
0617 07:53:09.494181 (+1092119us) ts_tablet_manager.cc:1151] Deleting tablet a460aee4eb514a87b272c4fc858335e7
0617 07:53:09.494190 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.498789 (+ 4599us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.502278 (+ 3489us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.508603 (+ 6325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1091782}
I20260617 07:53:09.509428 1171 tablet_bootstrap.cc:492] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.510416 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_c3ea195c67814080b1221735affcde43 [id=b5b61c6c229d40ac9e489d535a5b38f8]
I20260617 07:53:09.511410 1171 tablet_bootstrap.cc:654] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.515465 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_da1e8c81e4404eecb5c17d208ae890d2 [id=b917e24e4cee4805b575b97ac7068195]
I20260617 07:53:09.517055 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]
I20260617 07:53:09.517503 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_1ecdf060db0649d28c31d222fe25dda1 [id=ba6bd5b57bfc49f6a91b95badafdcb03]
I20260617 07:53:09.518010 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]
I20260617 07:53:09.515374 1172 tablet_bootstrap.cc:654] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.519912 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_95bb54209dbf45bb9b38c213a85eb101 [id=be8b1cef0a134635b8eac9b44b5bf75f]
I20260617 07:53:09.520357 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6]
I20260617 07:53:09.521970 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_5db1eb601069498e990dbb8635e0aa1d [id=c1fbbdf211d24d72bc0673e2ab662d23]
I20260617 07:53:09.523591 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 333) took 3227 ms. Trace:
I20260617 07:53:09.523775 1170 rpcz_store.cc:276] 0617 07:53:06.295871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.296626 (+ 755us) service_pool.cc:224] Handling call
0617 07:53:09.523378 (+3226752us) ts_tablet_manager.cc:1151] Deleting tablet 36ce60b466f7420992ef194d72b5718d
0617 07:53:09.523391 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.523538 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3226209}
I20260617 07:53:09.526207 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_071d2b97455544f48ec96587c227de07 [id=c271a8b75d0e471db316e09706cde9ba]
I20260617 07:53:09.526687 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_3c03bf27d19849b7a595ecc26c80f3ab [id=c36cef97efcd403ebda494e915ac280f]
I20260617 07:53:09.527160 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]
I20260617 07:53:09.527326 1178 tablet_bootstrap.cc:492] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:09.527637 1178 ts_tablet_manager.cc:1403] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.099s user 0.002s sys 0.003s
I20260617 07:53:09.528291 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]
I20260617 07:53:09.528681 1178 raft_consensus.cc:359] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.528903 1178 raft_consensus.cc:385] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.528980 1178 raft_consensus.cc:740] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.529969 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_67181344e3b04622865d4584952c600e [id=c866e35886e44e30b9a235af0b9a18ad]
I20260617 07:53:09.529965 1178 consensus_queue.cc:260] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.530517 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 334) took 3234 ms. Trace:
I20260617 07:53:09.530645 1170 rpcz_store.cc:276] 0617 07:53:06.295995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.306654 (+ 10659us) service_pool.cc:224] Handling call
0617 07:53:09.530372 (+3223718us) ts_tablet_manager.cc:1151] Deleting tablet 63bf519b83c445798bddda3120b542ce
0617 07:53:09.530382 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.530482 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3223496}
I20260617 07:53:09.534510 1171 tablet_bootstrap.cc:492] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.534678 1171 ts_tablet_manager.cc:1403] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.000s
I20260617 07:53:09.535085 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_2f40c198682e49768bee2d6a87292d46 [id=c8eaf721ce2242fdac07849a8ec26e58]
I20260617 07:53:09.535568 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]
I20260617 07:53:09.535585 1171 raft_consensus.cc:359] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.535796 1171 raft_consensus.cc:385] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.535914 1171 raft_consensus.cc:740] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.536182 1171 consensus_queue.cc:260] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.536950 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_45a2812670d9436a960744648a856ec8 [id=cb04083073d5491a9866d8c59d51a5e6]
I20260617 07:53:09.538285 1171 ts_tablet_manager.cc:1434] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:09.538607 1171 tablet_bootstrap.cc:492] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.539077 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]
I20260617 07:53:09.540661 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c]
I20260617 07:53:09.542824 1171 tablet_bootstrap.cc:654] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.546468 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_7ef78d5066e74ed18eb032a94d98e708 [id=d01892eee8954a04bf0e207993e6f950]
I20260617 07:53:09.547281 1178 ts_tablet_manager.cc:1434] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260617 07:53:09.547752 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 [id=d079dbab725b43c0807868020b551ccb]
I20260617 07:53:09.549171 1178 tablet_bootstrap.cc:492] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:09.551057 1178 tablet_bootstrap.cc:654] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.551832 1634 raft_consensus.cc:493] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.552042 1634 raft_consensus.cc:515] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.552400 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_d863711c4bc44037a3f8927442a50d68 [id=d5296e17741746c4b11bb33761009c9d]
I20260617 07:53:09.552770 1634 leader_election.cc:290] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.553288 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_2eb65c0d123846f1804e668fde8d23f5 [id=d8d07e82f2854f639176622bac6035e9]
I20260617 07:53:09.553311 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4996cde4d1514aa081257c802339abe6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.554005 852 leader_election.cc:343] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.554510 1171 tablet_bootstrap.cc:492] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.554668 1171 ts_tablet_manager.cc:1403] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.005s
I20260617 07:53:09.555414 1171 raft_consensus.cc:359] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.555601 1171 raft_consensus.cc:385] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.555680 1171 raft_consensus.cc:740] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.555989 1634 raft_consensus.cc:493] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.555959 1171 consensus_queue.cc:260] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.556145 1634 raft_consensus.cc:515] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.556598 1171 ts_tablet_manager.cc:1434] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:09.556816 1634 leader_election.cc:290] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.557667 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddfb822b5af4bb6b664936c769d9625" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.558022 1171 tablet_bootstrap.cc:492] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:09.563489 852 leader_election.cc:343] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.564100 1171 tablet_bootstrap.cc:654] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.566208 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_9061fb221e90420b87825b0ea482cf1a [id=d8f0c133a75845159f82ac3ea8322ce1]
I20260617 07:53:09.566744 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]
I20260617 07:53:09.567400 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_d199dae87e49454e8a74b84f1e0e28df [id=db2d3339eca0486bae7ce80d2f36323b]
I20260617 07:53:09.567850 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_241a0fade3d14d01ae5af76abbb7480b [id=db98d137d4034f478394697f912bd3ef]
I20260617 07:53:09.568295 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_8e5edb393db8438abed9a541c820e07a [id=dd897f18c75c4eb3a3e593672b437bd6]
I20260617 07:53:09.568782 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21]
I20260617 07:53:09.569471 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012]
I20260617 07:53:09.569981 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_91f0347cdea645c393589810a50ca778 [id=e2e28ecbf16446ae9e53e20ff4537b7d]
I20260617 07:53:09.570420 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_d96805f03e8f47b58040c4896878c01e [id=e42c6141367a4922ace753fd8ccf8463]
I20260617 07:53:09.571296 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_fc5f3ba5ab8a45c7bab81747fe42b662 [id=e65c9a5f1a1f479ea1804dfe806a2926]
I20260617 07:53:09.572010 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]
I20260617 07:53:09.572680 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_d3c466258c0b40f09368d392be11d6dc [id=eb9a1f29372d468bb9449eb1b84c87ad]
I20260617 07:53:09.573529 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb [id=ee23302b46474cb096ae93bc49011eeb]
I20260617 07:53:09.574033 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_b12221b517d346f3adec5874b70f1eb6 [id=f00addaaab9440a3a70bf54d62a94cd3]
I20260617 07:53:09.574468 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_8d97f61ab92d44008502cff52c36b89d [id=f0165435692349baa81584520f068a56]
I20260617 07:53:09.574803 1171 tablet_bootstrap.cc:492] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.575017 1171 ts_tablet_manager.cc:1403] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20260617 07:53:09.575332 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_8bcbcd3e54fe45879e296d390920d3b3 [id=f150a1142b4e4c7e85533806c596f529]
I20260617 07:53:09.575930 1171 raft_consensus.cc:359] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.576149 1171 raft_consensus.cc:385] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.576254 1171 raft_consensus.cc:740] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.576571 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_5cf044f7f8984fdc9c0ea0f028992063 [id=f4ba254355924d909ef34a0453ea4823]
I20260617 07:53:09.576498 1171 consensus_queue.cc:260] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.576788 1657 raft_consensus.cc:493] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.576959 1657 raft_consensus.cc:515] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.577091 1171 ts_tablet_manager.cc:1434] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:09.577414 1171 tablet_bootstrap.cc:492] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.577797 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_55cf1cae5fa44c55bef179cc6aa48834 [id=f96c8d7d0be24aa4958290874ff844b5]
I20260617 07:53:09.577698 1657 leader_election.cc:290] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.578380 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d682ae37d74b4b967da0f8e2de6301" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.578779 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0]
W20260617 07:53:09.578963 852 leader_election.cc:343] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.579383 1171 tablet_bootstrap.cc:654] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.579689 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_aed7483cd2e248e2915c153c409f86b6 [id=fbf729ad353844a4941f218a5f41ea33]
I20260617 07:53:09.580324 1737 catalog_manager.cc:679] Loaded metadata for table default.Table_af1642a493c54650937216698b190b90 [id=fc0975321cab41358afa6fd3d3abc1ad]
I20260617 07:53:09.590099 1172 tablet_bootstrap.cc:492] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.590330 1172 ts_tablet_manager.cc:1403] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.100s user 0.002s sys 0.003s
I20260617 07:53:09.591387 1172 raft_consensus.cc:359] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.591615 1172 raft_consensus.cc:385] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.591717 1172 raft_consensus.cc:740] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.591998 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 335) took 3293 ms. Trace:
I20260617 07:53:09.592137 1170 rpcz_store.cc:276] 0617 07:53:06.296109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.309876 (+ 13767us) service_pool.cc:224] Handling call
0617 07:53:09.547699 (+3237823us) ts_tablet_manager.cc:1151] Deleting tablet 9cddb9e82c354f26b3abe56ebdefd008
0617 07:53:09.547710 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.589670 (+ 41960us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3237467}
I20260617 07:53:09.592840 1170 tablet_replica.cc:333] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.593132 1170 raft_consensus.cc:2243] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.593441 1170 raft_consensus.cc:2272] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.594199 1170 ts_tablet_manager.cc:1916] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.594280 1171 tablet_bootstrap.cc:492] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.594587 1171 ts_tablet_manager.cc:1403] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.003s
I20260617 07:53:09.595394 1171 raft_consensus.cc:359] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.597810 1171 raft_consensus.cc:385] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.597944 1171 raft_consensus.cc:740] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.597826 1172 consensus_queue.cc:260] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.598268 1171 consensus_queue.cc:260] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.598832 1171 ts_tablet_manager.cc:1434] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260617 07:53:09.599218 1171 tablet_bootstrap.cc:492] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.601368 1171 tablet_bootstrap.cc:654] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.602504 1737 tablet_loader.cc:96] loaded metadata for tablet 037539021d1743bb9a66403b8a01662f (table default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a])
I20260617 07:53:09.603434 1737 tablet_loader.cc:96] loaded metadata for tablet 05de71ea02df48ffacb369caa7f7d3de (table default.Table_2f40c198682e49768bee2d6a87292d46 [id=c8eaf721ce2242fdac07849a8ec26e58])
I20260617 07:53:09.610208 1172 ts_tablet_manager.cc:1434] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.020s user 0.000s sys 0.002s
I20260617 07:53:09.610627 1172 tablet_bootstrap.cc:492] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.611945 1737 tablet_loader.cc:96] loaded metadata for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 (table default.Table_00d654600a8a474d84c1678c529d4489 [id=9776f24641614e23a1ea878c6aad0efa])
I20260617 07:53:09.613015 1172 tablet_bootstrap.cc:654] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.614046 1737 tablet_loader.cc:96] loaded metadata for tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_073280306a2740119a28c4682671d83f [id=121feb8666fe4cb5b796fecf0bf1f8b0])
I20260617 07:53:09.614594 1737 tablet_loader.cc:96] loaded metadata for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_30348a000daf4ff5b621f97ed5766bd6 [id=52357c6af1e04f2c82768cb39fe1be8d])
I20260617 07:53:09.614935 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddfb822b5af4bb6b664936c769d9625" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.614938 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cf9c672f3b4567b63e878a6ab11334" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.615114 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4996cde4d1514aa081257c802339abe6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.615149 918 raft_consensus.cc:2468] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:09.615289 1048 raft_consensus.cc:2468] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.615135 1047 raft_consensus.cc:2468] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.615478 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763581e2baeb46149bfb38d81301b9c5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.615841 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d682ae37d74b4b967da0f8e2de6301" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.616015 1047 raft_consensus.cc:2468] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.616142 1737 tablet_loader.cc:96] loaded metadata for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_a25f1398f97f4c2b99ec71d2ce42f295 [id=36382a6d7a5b4ad4b40d94994f91f627])
I20260617 07:53:09.616607 1737 tablet_loader.cc:96] loaded metadata for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_c918313039f74feabcd522092350ffa1 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07])
I20260617 07:53:09.616550 1657 consensus_queue.cc:1048] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:09.617211 1171 tablet_bootstrap.cc:492] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.617297 851 leader_election.cc:304] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.617746 1657 raft_consensus.cc:2804] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.617856 1657 raft_consensus.cc:493] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.617957 1657 raft_consensus.cc:3060] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.620530 1657 raft_consensus.cc:515] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.621395 1737 tablet_loader.cc:96] loaded metadata for tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21])
I20260617 07:53:09.621531 1657 leader_election.cc:290] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.617372 1171 ts_tablet_manager.cc:1403] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.002s
W20260617 07:53:09.622808 562 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:42818 (request call id 31) took 933 ms (client timeout 1000 ms). Trace:
W20260617 07:53:09.622975 562 rpcz_store.cc:269] 0617 07:53:08.688910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.689787 (+ 877us) service_pool.cc:224] Handling call
0617 07:53:09.622742 (+932955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 07:53:09.623930 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 69996eb4ab6e40f9b2d97e00d766822a (table default.Table_0e8fe92eb0e14e9ea3e8b68b977f1690 [id=f7bea6866b9845f1a116293b182de7bc]) successfully deleted
I20260617 07:53:09.624148 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a460aee4eb514a87b272c4fc858335e7 (table default.Table_01592b03d24e492a9fb22885a4195c7f [id=325e591e926743a9ab92d48a1e73bf8b]) successfully deleted
I20260617 07:53:09.624248 1171 raft_consensus.cc:359] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:09.624475 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 245cff69d83b43e98b1c72b8d3011347 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 245cff69d83b43e98b1c72b8d3011347 already in progress: creating tablet
I20260617 07:53:09.624498 1171 raft_consensus.cc:385] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.624656 1171 raft_consensus.cc:740] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.624914 1171 consensus_queue.cc:260] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.624946 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42828:
table { table_name: "default.Table_d3c466258c0b40f09368d392be11d6dc" } new_table_name: "default.Table_a5077d1cb030456e91d1a015037c71fc" modify_external_catalogs: true
I20260617 07:53:09.625397 1171 ts_tablet_manager.cc:1434] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260617 07:53:09.625607 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41ef34e21782488da51b458e095e7bcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:09.625686 1171 tablet_bootstrap.cc:492] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.626330 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet f9e253dca6904dfb914ed4be554da4b5 (table default.Table_9bae350dffe04a48933fbb60e3f26699 [id=d455eadd7e304b7bbb55ccff97befb5c]) successfully deleted
W20260617 07:53:09.626466 517 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 849433us
W20260617 07:53:09.626811 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4681e8e3f1174b299d89ec541ca8e6b3 consensus state has no leader
I20260617 07:53:09.627688 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "becdd6b4fad846399c95f04697e01d0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 526 } } ignore_live_leader: false dest_uuid: "29a94ff9f875443ab6aeac00922cda0d"
I20260617 07:53:09.627761 1171 tablet_bootstrap.cc:654] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.629230 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "becdd6b4fad846399c95f04697e01d0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 526 } } ignore_live_leader: false dest_uuid: "29a94ff9f875443ab6aeac00922cda0d" is_pre_election: true
I20260617 07:53:09.629297 851 leader_election.cc:304] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.621601 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4996cde4d1514aa081257c802339abe6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.629971 1737 tablet_loader.cc:96] loaded metadata for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_7ef78d5066e74ed18eb032a94d98e708 [id=d01892eee8954a04bf0e207993e6f950])
I20260617 07:53:09.630106 1452 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 2 FOLLOWER]: Rejecting Update request from peer 29a94ff9f875443ab6aeac00922cda0d for earlier term 1. Current term is 2. Ops: [1.527-1.529]
I20260617 07:53:09.630398 1737 tablet_loader.cc:96] loaded metadata for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8])
W20260617 07:53:09.630769 852 leader_election.cc:343] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.630990 1657 raft_consensus.cc:2804] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.630963 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 80f67a6c1dcf4a69842452c371a9c078 (table default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35 [id=0552acfce4294af484ccd1f88c42c4cb]) successfully deleted
I20260617 07:53:09.631100 1657 raft_consensus.cc:493] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.631189 1657 raft_consensus.cc:3060] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.631392 1687 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 }, Status: INVALID_TERM, Last received: 1.526, Next index: 527, Last known committed idx: 526, Time since last communication: 0.001s
I20260617 07:53:09.631729 1687 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 1 LEADER]: Stepping down as leader of term 1
I20260617 07:53:09.632054 1687 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29a94ff9f875443ab6aeac00922cda0d, State: Running, Role: LEADER
I20260617 07:53:09.634099 1657 raft_consensus.cc:515] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:09.634737 529 catalog_manager.cc:3964] Illegal state: an error occurred while updating the sys-catalog: replica 29a94ff9f875443ab6aeac00922cda0d is not leader of this config: current role FOLLOWER
I20260617 07:53:09.634940 1657 leader_election.cc:290] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.635354 851 leader_election.cc:304] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.635733 1657 raft_consensus.cc:2804] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.635845 1657 raft_consensus.cc:493] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.635973 1657 raft_consensus.cc:3060] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.635905 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddfb822b5af4bb6b664936c769d9625" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.636060 1171 tablet_bootstrap.cc:492] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.636247 1171 ts_tablet_manager.cc:1403] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
W20260617 07:53:09.636365 852 leader_election.cc:343] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.636699 1687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 526, Committed index: 526, Last appended: 1.529, Last appended by leader: 529, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:09.639146 1657 raft_consensus.cc:515] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.640056 1698 raft_consensus.cc:493] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.640242 1698 raft_consensus.cc:515] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.640754 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d682ae37d74b4b967da0f8e2de6301" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.640882 1698 leader_election.cc:290] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.641026 1698 raft_consensus.cc:493] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.641139 1698 raft_consensus.cc:515] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.641255 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 5b99b80966c94937baf7172b0c36af2a (table default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]) successfully deleted
W20260617 07:53:09.641541 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 63bf519b83c445798bddda3120b542ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bf519b83c445798bddda3120b542ce already in progress: creating tablet
I20260617 07:53:09.641683 1698 leader_election.cc:290] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:09.642459 852 leader_election.cc:343] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.642486 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc84665c7849469aa27e6505dbed1516" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.642758 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c5ff28367b42d3a3922d2b789bc7ec" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.642974 986 leader_election.cc:343] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:09.643211 986 leader_election.cc:343] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.646672 1171 raft_consensus.cc:359] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.646915 1171 raft_consensus.cc:385] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.646998 1171 raft_consensus.cc:740] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.647285 1171 consensus_queue.cc:260] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.647763 1171 ts_tablet_manager.cc:1434] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260617 07:53:09.648044 1171 tablet_bootstrap.cc:492] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.649578 1171 tablet_bootstrap.cc:654] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:09.654806 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 63bf519b83c445798bddda3120b542ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bf519b83c445798bddda3120b542ce already in progress: creating tablet
W20260617 07:53:09.655221 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 36ce60b466f7420992ef194d72b5718d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ce60b466f7420992ef194d72b5718d already in progress: creating tablet
I20260617 07:53:09.655712 1657 leader_election.cc:290] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:09.655959 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 9cddb9e82c354f26b3abe56ebdefd008 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cddb9e82c354f26b3abe56ebdefd008 already in progress: creating tablet
W20260617 07:53:09.656186 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e05a97a4ab4ed7bff523d1fb1c59ae already in progress: creating tablet
I20260617 07:53:09.656786 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 19f8525046964950884b0f9aa515ec81 (table default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]) successfully deleted
W20260617 07:53:09.657019 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d21f61a35ca544568bcfca1a6230deca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d21f61a35ca544568bcfca1a6230deca already in progress: creating tablet
I20260617 07:53:09.657326 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 1f2cb23911614f9dab0767b1f6af3d00 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]) successfully deleted
W20260617 07:53:09.657634 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 36ce60b466f7420992ef194d72b5718d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ce60b466f7420992ef194d72b5718d already in progress: creating tablet
W20260617 07:53:09.657878 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9cddb9e82c354f26b3abe56ebdefd008 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cddb9e82c354f26b3abe56ebdefd008 already in progress: creating tablet
W20260617 07:53:09.658200 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e05a97a4ab4ed7bff523d1fb1c59ae already in progress: creating tablet
I20260617 07:53:09.658414 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 4d9d9ed003c64b1abed6bd3bb14456cd (table default.Table_b80fd4d4286241409493bc531eb7fef8 [id=778d846ba4124b08a28bb83a2777841e]) successfully deleted
I20260617 07:53:09.658390 1685 raft_consensus.cc:493] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.658592 1685 raft_consensus.cc:515] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.658716 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet ddb71e5f65cd4b9e8dbe5ddf44e70340 (table default.Table_12efac8f00f3425cac18946f8560096a [id=7681b3aa59504055a414317c4be40cc2]) successfully deleted
I20260617 07:53:09.658916 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 1f2cb23911614f9dab0767b1f6af3d00 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]) successfully deleted
W20260617 07:53:09.659202 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d21f61a35ca544568bcfca1a6230deca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d21f61a35ca544568bcfca1a6230deca already in progress: creating tablet
I20260617 07:53:09.659387 517 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 06e0f2f9a75d4f9ba8702e4da75c042f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]) successfully deleted
I20260617 07:53:09.659401 1685 leader_election.cc:290] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:09.659600 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0cfb98aecc4546c88371436fcfbf8e86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cfb98aecc4546c88371436fcfbf8e86 already in progress: creating tablet
W20260617 07:53:09.659835 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
W20260617 07:53:09.660111 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d80c2ffcf1b84df0bc6a468ea0929e80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d80c2ffcf1b84df0bc6a468ea0929e80 already in progress: creating tablet
W20260617 07:53:09.660334 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d9e473fd444efa6ab63cc51dbb2bd already in progress: creating tablet
W20260617 07:53:09.660531 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0cfb98aecc4546c88371436fcfbf8e86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cfb98aecc4546c88371436fcfbf8e86 already in progress: creating tablet
W20260617 07:53:09.660737 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a882ae04eeb94276bb78ded81fbea708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a882ae04eeb94276bb78ded81fbea708 already in progress: creating tablet
W20260617 07:53:09.660800 716 leader_election.cc:343] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 80f67a6c1dcf4a69842452c371a9c078
W20260617 07:53:09.660943 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 already in progress: creating tablet
W20260617 07:53:09.661152 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5203534569bd4da18bc06751f094735f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5203534569bd4da18bc06751f094735f already in progress: creating tablet
W20260617 07:53:09.661346 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bbc3d13d519843a9bc38e97dc85b67c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbc3d13d519843a9bc38e97dc85b67c8 already in progress: creating tablet
I20260617 07:53:09.661791 529 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:42828 (request call id 523) took 1028 ms. Trace:
W20260617 07:53:09.662438 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
W20260617 07:53:09.662580 713 leader_election.cc:343] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 80f67a6c1dcf4a69842452c371a9c078
W20260617 07:53:09.662634 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d9e473fd444efa6ab63cc51dbb2bd already in progress: creating tablet
I20260617 07:53:09.662734 713 leader_election.cc:304] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:09.662817 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a882ae04eeb94276bb78ded81fbea708 (table default.Table_e57d7374905b4ff0b1e620e152b6d6c0 [id=b602ba9d92744e8bb82c4c57e9bfccab]) successfully deleted
W20260617 07:53:09.663048 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d80c2ffcf1b84df0bc6a468ea0929e80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d80c2ffcf1b84df0bc6a468ea0929e80 already in progress: creating tablet
I20260617 07:53:09.663172 1685 raft_consensus.cc:2749] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:09.663234 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 already in progress: creating tablet
I20260617 07:53:09.663398 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 8fa23bb0929440b1820afdce4b9e8d8c (table default.Table_456aace94223474f82d1801ec38d7b43 [id=cbd872cee78b4535b90941504bafc133]) successfully deleted
I20260617 07:53:09.663565 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5203534569bd4da18bc06751f094735f (table default.Table_9e10117b19d649668289e1ad8374ff7d [id=77f9a3f7e2e441b888caf756936d7ee5]) successfully deleted
W20260617 07:53:09.663724 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet bbc3d13d519843a9bc38e97dc85b67c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbc3d13d519843a9bc38e97dc85b67c8 already in progress: creating tablet
W20260617 07:53:09.663961 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d03d6dc473fc4be1a436fd71a06f403e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d03d6dc473fc4be1a436fd71a06f403e already in progress: creating tablet
I20260617 07:53:09.663995 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4996cde4d1514aa081257c802339abe6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
W20260617 07:53:09.664124 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 already in progress: creating tablet
W20260617 07:53:09.664296 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a02dbb70eec84932917ef282fdae0bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a02dbb70eec84932917ef282fdae0bd7 already in progress: creating tablet
W20260617 07:53:09.664454 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e9488e8a501e404f85540fb045d8916f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9488e8a501e404f85540fb045d8916f already in progress: creating tablet
W20260617 07:53:09.664628 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 18f9bace06e34602acc7fcd7501b3671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18f9bace06e34602acc7fcd7501b3671 already in progress: creating tablet
W20260617 07:53:09.664776 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 11794aa70824476e9751a41ab305cc80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11794aa70824476e9751a41ab305cc80 already in progress: creating tablet
W20260617 07:53:09.664968 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7f7611958cf143438497c93f5f2bc098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7611958cf143438497c93f5f2bc098 already in progress: creating tablet
W20260617 07:53:09.665539 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5dcfb101cf51487692ef9a6a17f40804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dcfb101cf51487692ef9a6a17f40804 already in progress: creating tablet
I20260617 07:53:09.661903 529 rpcz_store.cc:276] 0617 07:53:08.606225 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.702927 (+ 96702us) service_pool.cc:224] Handling call
0617 07:53:09.625115 (+922188us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:09.633790 (+ 8675us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:09.633976 (+ 186us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:09.634056 (+ 80us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:09.634610 (+ 554us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:09.634615 (+ 5us) write_op.cc:454] Released schema lock
0617 07:53:09.634944 (+ 329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:09.634527 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 29a94ff9f875443ab6aeac00922cda0d is not leader of this config: current role FOLLOWER)
0617 07:53:09.634541 (+ 14us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:09.634547 (+ 6us) write_op.cc:454] Released schema lock
0617 07:53:09.634550 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"spinlock_wait_cycles":435456,"child_traces":[["op",{}]]}
I20260617 07:53:09.667163 1048 raft_consensus.cc:3060] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.667446 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ddfb822b5af4bb6b664936c769d9625" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:09.667740 1046 raft_consensus.cc:3060] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.668605 988 leader_election.cc:304] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.668823 1657 raft_consensus.cc:493] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.668987 1657 raft_consensus.cc:515] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:09.669770 532 catalog_manager.cc:2227] Illegal state: an error occurred while writing to the sys-catalog: replica 29a94ff9f875443ab6aeac00922cda0d is not leader of this config: current role FOLLOWER
I20260617 07:53:09.670204 1657 leader_election.cc:290] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.670166 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7343400555f447b8a1721ba36d7766d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.670315 532 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:42828 (request call id 522) took 1065 ms. Trace:
I20260617 07:53:09.670451 532 rpcz_store.cc:276] 0617 07:53:08.605122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.689201 (+ 84079us) service_pool.cc:224] Handling call
0617 07:53:09.625732 (+936531us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 07:53:09.637185 (+ 11453us) catalog_manager.cc:2172] Created new table and tablet info
0617 07:53:09.638111 (+ 926us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:09.638115 (+ 4us) write_op.cc:454] Released schema lock
0617 07:53:09.670271 (+ 32156us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:09.637606 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 29a94ff9f875443ab6aeac00922cda0d is not leader of this config: current role FOLLOWER)
0617 07:53:09.637624 (+ 18us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:09.637659 (+ 35us) write_op.cc:454] Released schema lock
0617 07:53:09.637663 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{}]]}
W20260617 07:53:09.670748 852 leader_election.cc:343] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:09.671268 988 leader_election.cc:343] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:09.671877 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65bf5384ec244d36ba3d4e781c5eb8a3 already in progress: creating tablet
I20260617 07:53:09.672235 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet ddc0439f992048358f1de4381516e543 (table default.Table_c618c8ab0c5b498eb1aebd26c42d9c10 [id=49f0d093a5f0430f8a88b36ee6719598]) successfully deleted
W20260617 07:53:09.672559 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 570ae1e189a64da6bad10156b401ec46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 570ae1e189a64da6bad10156b401ec46 already in progress: creating tablet
I20260617 07:53:09.672581 1751 raft_consensus.cc:2804] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 07:53:09.673038 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74ab8e93e3fe475ba9c7b5fce390a8ab already in progress: creating tablet
W20260617 07:53:09.673349 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0fd8cedb539748dc917128511325bbcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd8cedb539748dc917128511325bbcc already in progress: creating tablet
W20260617 07:53:09.673637 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 95865af94c04410386d23cb369180611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95865af94c04410386d23cb369180611 already in progress: creating tablet
W20260617 07:53:09.673985 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet df37ed81b17d4178adeb6057491b4cc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df37ed81b17d4178adeb6057491b4cc9 already in progress: creating tablet
I20260617 07:53:09.674530 1048 raft_consensus.cc:2468] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:09.674568 1046 raft_consensus.cc:2468] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:09.674290 1751 raft_consensus.cc:493] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.675004 1751 raft_consensus.cc:3060] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.675580 988 leader_election.cc:304] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:09.679162 1751 raft_consensus.cc:515] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.680913 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cf9c672f3b4567b63e878a6ab11334" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.682808 851 leader_election.cc:304] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.683142 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc84665c7849469aa27e6505dbed1516" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.683346 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c5ff28367b42d3a3922d2b789bc7ec" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.683357 918 raft_consensus.cc:2468] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:09.683820 1657 raft_consensus.cc:2804] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.683861 519 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 7582d201bc5843949d4be08ee7586f9d (table default.Table_540131f07d9249ec80a4db3900a4ed2d [id=f0d64527dd96463a94407118831d2de2]) successfully deleted
I20260617 07:53:09.683907 851 leader_election.cc:304] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.684098 1634 raft_consensus.cc:2804] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
W20260617 07:53:09.684090 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
I20260617 07:53:09.684221 1634 raft_consensus.cc:697] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
W20260617 07:53:09.684262 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
W20260617 07:53:09.684453 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 84f498f551ff4767bd16628b03f55ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84f498f551ff4767bd16628b03f55ae2 already in progress: creating tablet
I20260617 07:53:09.684475 1634 consensus_queue.cc:237] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:09.684636 519 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
W20260617 07:53:09.661649 517 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d03d6dc473fc4be1a436fd71a06f403e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d03d6dc473fc4be1a436fd71a06f403e already in progress: creating tablet
I20260617 07:53:09.679033 1687 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:09.685840 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cf9c672f3b4567b63e878a6ab11334" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:09.686066 918 raft_consensus.cc:3060] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:09.679884 526 catalog_manager.cc:2873] Illegal state: an error occurred while updating the sys-catalog: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.053s ago.
W20260617 07:53:09.688561 422 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu pid 500: Timed out: CheckLeaks RPC to 127.0.105.189:36505 timed out after 1.000s (SENT)
I20260617 07:53:09.688771 422 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu with pid 500
I20260617 07:53:09.688788 526 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:42828 (request call id 508) took 1325 ms. Trace:
I20260617 07:53:09.689496 918 raft_consensus.cc:2468] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:09.690224 1657 raft_consensus.cc:697] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:09.690659 1737 tablet_loader.cc:96] loaded metadata for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_bd0db0a6290342548196f468ee98943f [id=8193bedf37784197bebc39d711a8eb2b])
I20260617 07:53:09.690641 1657 consensus_queue.cc:237] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.691738 1737 tablet_loader.cc:96] loaded metadata for tablet 24ba13170e864dfa96cddfb1a76b8c40 (table default.Table_bfa59190ca144c4d9d0cbab7a39eef9c [id=214df2f2d641469c91a78dfd5bb3aba8])
I20260617 07:53:09.697258 1751 leader_election.cc:290] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.697439 1698 raft_consensus.cc:2749] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.697613 988 leader_election.cc:304] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.698052 1737 tablet_loader.cc:96] loaded metadata for tablet 25b1b128ce484d9ab371fa3c5edc6ea6 (table default.Table_664d31b291bf448b98ad89d939ce5477 [id=752bd629dc0a4345b59cc4536e2e95d3])
W20260617 07:53:09.697611 986 leader_election.cc:343] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.698901 1737 tablet_loader.cc:96] loaded metadata for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d])
I20260617 07:53:09.699321 1737 tablet_loader.cc:96] loaded metadata for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8])
I20260617 07:53:09.699761 1737 tablet_loader.cc:96] loaded metadata for tablet 28538804fd254dc8b4a341debf508a85 (table default.Table_e59c908749124f0abd3e5aabc1029149 [id=84bcdf2b9c4e41c5bcd458e52fe90144])
I20260617 07:53:09.701602 1170 ts_tablet_manager.cc:1929] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:09.701650 1737 tablet_loader.cc:96] loaded metadata for tablet 301bd4d6faec429ba71ce354c23d0f75 (table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012])
W20260617 07:53:09.702294 988 leader_election.cc:343] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.702425 988 leader_election.cc:304] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:09.702361 1737 tablet_loader.cc:96] loaded metadata for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d (table default.Table_5db1eb601069498e990dbb8635e0aa1d [id=c1fbbdf211d24d72bc0673e2ab662d23])
I20260617 07:53:09.703102 1178 tablet_bootstrap.cc:492] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:09.703225 1737 tablet_loader.cc:96] loaded metadata for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_b12221b517d346f3adec5874b70f1eb6 [id=f00addaaab9440a3a70bf54d62a94cd3])
I20260617 07:53:09.703266 1178 ts_tablet_manager.cc:1403] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.154s user 0.005s sys 0.028s
I20260617 07:53:09.703740 1737 tablet_loader.cc:96] loaded metadata for tablet 369442b72f754ee08dc6a484d51f2e99 (table default.Table_8d97f61ab92d44008502cff52c36b89d [id=f0165435692349baa81584520f068a56])
I20260617 07:53:09.704062 1178 raft_consensus.cc:359] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.704274 1178 raft_consensus.cc:385] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.704367 1178 raft_consensus.cc:740] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.705372 1178 consensus_queue.cc:260] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.705935 1737 tablet_loader.cc:96] loaded metadata for tablet 36cbea7b0f024422bc281ea97f6d76d5 (table default.Table_6e54085dfd0041d2bdb49961526e7594 [id=6f0e007c645a43e6a9611001e0de1864])
I20260617 07:53:09.705982 1178 ts_tablet_manager.cc:1434] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:09.706256 1178 tablet_bootstrap.cc:492] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:09.706988 1171 tablet_bootstrap.cc:492] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.707127 1171 ts_tablet_manager.cc:1403] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.021s
I20260617 07:53:09.707876 1171 raft_consensus.cc:359] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.708037 1171 raft_consensus.cc:385] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.708117 1171 raft_consensus.cc:740] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.708189 1178 tablet_bootstrap.cc:654] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.708300 1171 consensus_queue.cc:260] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.708802 1171 ts_tablet_manager.cc:1434] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:09.709781 1737 tablet_loader.cc:96] loaded metadata for tablet 370c8ddac0c747f6b44926f982233ea9 (table default.Table_4b89f3bc484f44458e623c0e47f28f5f [id=683c9be609d948c8b135b8648a820447])
I20260617 07:53:09.717832 988 leader_election.cc:304] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.718397 1698 raft_consensus.cc:2804] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.718528 1698 raft_consensus.cc:493] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.718647 1698 raft_consensus.cc:3060] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.721517 1178 tablet_bootstrap.cc:492] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:09.721699 1178 ts_tablet_manager.cc:1403] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.007s
I20260617 07:53:09.721700 1737 tablet_loader.cc:96] loaded metadata for tablet 39b291b1c9794faa9305f7d936604a44 (table default.Table_94ca7e593fc74524abf0ef739e7f986b [id=1951a43bb71a41bfaa40c0d3bedc99d0])
I20260617 07:53:09.722117 1657 raft_consensus.cc:493] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.722200 1737 tablet_loader.cc:96] loaded metadata for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53])
I20260617 07:53:09.722292 1657 raft_consensus.cc:515] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.723011 1657 leader_election.cc:290] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.722846 1698 raft_consensus.cc:515] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.723618 1737 tablet_loader.cc:96] loaded metadata for tablet 3e3d05dcda274f288aebc279aba3e10a (table default.Table_ec3b5256518241a1a661b1e8c1841123 [id=07868985fae742ce95c082e85caa6267])
I20260617 07:53:09.723639 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7392ca4ba6a140e19c57e962a26162af" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.723803 1178 raft_consensus.cc:359] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.723971 1178 raft_consensus.cc:385] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.724051 1178 raft_consensus.cc:740] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.724277 1178 consensus_queue.cc:260] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.724363 1737 tablet_loader.cc:96] loaded metadata for tablet 3fcf87953dc14bf190ac74101547e52f (table default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7])
I20260617 07:53:09.724738 1737 tablet_loader.cc:96] loaded metadata for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_66c2a830c5a94c0c9f70f12f18100bd5 [id=4f545023638349f686a11acaade9abfe])
W20260617 07:53:09.724718 852 leader_election.cc:343] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.725196 1178 ts_tablet_manager.cc:1434] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:09.725190 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc84665c7849469aa27e6505dbed1516" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.725571 1178 tablet_bootstrap.cc:492] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:09.725744 986 leader_election.cc:343] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.725888 1737 tablet_loader.cc:96] loaded metadata for tablet 464cf1effff241608f4a7255f2646b04 (table default.Table_85519a333a1f4899b5a22d43b69fe3cb [id=a141eeb977ca4329ac1404fefb355281])
I20260617 07:53:09.726114 1698 leader_election.cc:290] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.726332 1737 tablet_loader.cc:96] loaded metadata for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9])
I20260617 07:53:09.726378 1698 raft_consensus.cc:2804] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.726783 1737 tablet_loader.cc:96] loaded metadata for tablet 488cc3a082b14dee8f70153e6f2925a4 (table default.Table_ddca8eb1aba6417a8cb8a723dd38551b [id=ab7b996d094f49df9532f308d8615d08])
I20260617 07:53:09.727793 1737 tablet_loader.cc:96] loaded metadata for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f])
I20260617 07:53:09.728129 1178 tablet_bootstrap.cc:654] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.729254 1737 tablet_loader.cc:96] loaded metadata for tablet 4d9ace137c4e496fafac4e729718577f (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd])
I20260617 07:53:09.730432 1737 tablet_loader.cc:96] loaded metadata for tablet 4de8df5e15cb43c0b95ec5af3110db66 (table default.Table_da5430a09e3e44e48bafd3678bf638a2 [id=27e37deb26df4bb28507736f1decf709])
I20260617 07:53:09.730692 1698 raft_consensus.cc:697] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:09.731653 1171 tablet_bootstrap.cc:492] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.733469 1171 tablet_bootstrap.cc:654] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.735421 1698 consensus_queue.cc:237] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.752393 1657 raft_consensus.cc:493] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.752568 1657 raft_consensus.cc:515] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.753268 1657 leader_election.cc:290] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.754453 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f030d59f4e124f64bb62d05f0bb0f560" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.755111 852 leader_election.cc:343] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.758597 1737 tablet_loader.cc:96] loaded metadata for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 (table default.Table_76ba66e135e34c4cab87ecfb9db4d2f5 [id=408ae87558644eb799bec6ab8d1ad2c1])
I20260617 07:53:09.758873 1657 raft_consensus.cc:493] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.759035 1657 raft_consensus.cc:515] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.759122 1737 tablet_loader.cc:96] loaded metadata for tablet 4e700810cd024dacbadd9ab109d0d87c (table default.Table_2e08b8585e3744a486d5d2c7c227a6c5 [id=a5edc6ed0cb14a0ca2714894a6852ca7])
I20260617 07:53:09.759460 1737 tablet_loader.cc:96] loaded metadata for tablet 4e8e9692227147d6a8c6854133941b44 (table default.Table_d863711c4bc44037a3f8927442a50d68 [id=d5296e17741746c4b11bb33761009c9d])
I20260617 07:53:09.759641 1657 leader_election.cc:290] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.759879 1737 tablet_loader.cc:96] loaded metadata for tablet 4ecf80e090494539ae3d20448f8d1126 (table default.Table_ac940c0f5a9d49babeff827981e9d7d3 [id=829b5684836747b2aa4265ac17eccd80])
I20260617 07:53:09.760252 1737 tablet_loader.cc:96] loaded metadata for tablet 51e757e6f4ce4c6eb8223c4b6955245e (table default.Table_69167a2936fa47a08d1f53dfec14f52b [id=8738ee5e888742f9a7c0aa0c9085dc75])
I20260617 07:53:09.761425 1737 tablet_loader.cc:96] loaded metadata for tablet 53108a2d6c8b4398a568c14df8e0a23e (table default.Table_c3ea195c67814080b1221735affcde43 [id=b5b61c6c229d40ac9e489d535a5b38f8])
I20260617 07:53:09.761475 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3b5cb887da4d86bdc3d69f350fdb40" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.762195 852 leader_election.cc:343] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.767653 1171 tablet_bootstrap.cc:492] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.767844 1171 ts_tablet_manager.cc:1403] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.009s
I20260617 07:53:09.768657 1171 raft_consensus.cc:359] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.768874 1171 raft_consensus.cc:385] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.768958 1171 raft_consensus.cc:740] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.769240 1171 consensus_queue.cc:260] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.769877 1171 ts_tablet_manager.cc:1434] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:09.736312 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d682ae37d74b4b967da0f8e2de6301" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:09.770336 1171 tablet_bootstrap.cc:492] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.770334 1048 raft_consensus.cc:3060] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.772396 1171 tablet_bootstrap.cc:654] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:09.773578 1048 raft_consensus.cc:2468] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:09.739585 1751 raft_consensus.cc:2749] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.757340 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7343400555f447b8a1721ba36d7766d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.775584 1046 raft_consensus.cc:2468] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.757579 1170 log.cc:1199] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/1f2cb23911614f9dab0767b1f6af3d00
I20260617 07:53:09.776458 1170 ts_tablet_manager.cc:1950] T 1f2cb23911614f9dab0767b1f6af3d00 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.776873 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 340) took 3375 ms. Trace:
I20260617 07:53:09.776988 1170 rpcz_store.cc:276] 0617 07:53:06.401281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.404224 (+ 2943us) service_pool.cc:224] Handling call
0617 07:53:09.592755 (+3188531us) ts_tablet_manager.cc:1151] Deleting tablet 1f2cb23911614f9dab0767b1f6af3d00
0617 07:53:09.592767 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.669570 (+ 76803us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.701528 (+ 31958us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.776804 (+ 75276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3188299}
I20260617 07:53:09.778357 1170 tablet_replica.cc:333] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.778699 1170 raft_consensus.cc:2243] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.779296 1170 raft_consensus.cc:2272] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:09.769133 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 66300.1us
I20260617 07:53:09.780133 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc84665c7849469aa27e6505dbed1516" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:09.780350 918 raft_consensus.cc:3060] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.780622 851 leader_election.cc:304] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.781139 1657 raft_consensus.cc:2804] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.781232 1657 raft_consensus.cc:493] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.781342 1657 raft_consensus.cc:3060] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.781919 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f030d59f4e124f64bb62d05f0bb0f560" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.781949 1737 tablet_loader.cc:96] loaded metadata for tablet 5364dfe28b8d4042941c8d8d4d1cf503 (table default.Table_665c19b8c9d14ccc9f5beb633b690e13 [id=3ab32aa970c24c1bbde1768b3defee07])
I20260617 07:53:09.782100 1045 raft_consensus.cc:2468] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.782469 1737 tablet_loader.cc:96] loaded metadata for tablet 5578fd5cb3724ed5b92b313bd52889ad (table default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0])
I20260617 07:53:09.782598 1751 raft_consensus.cc:493] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.782742 1751 raft_consensus.cc:515] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.782868 1737 tablet_loader.cc:96] loaded metadata for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357])
I20260617 07:53:09.783242 918 raft_consensus.cc:2468] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:09.783407 1751 leader_election.cc:290] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.783567 1751 raft_consensus.cc:493] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.783700 1751 raft_consensus.cc:515] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.783787 1737 tablet_loader.cc:96] loaded metadata for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6])
I20260617 07:53:09.784168 1737 tablet_loader.cc:96] loaded metadata for tablet 5942eea42c7541349ad7b6560e6777c8 (table default.Table_5df0947db0104ef6bb9e41fdb647e50c [id=23529b3c51f04f7093273ea0c6802bd5])
I20260617 07:53:09.784374 1751 leader_election.cc:290] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:09.784773 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3b5cb887da4d86bdc3d69f350fdb40" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.784878 1737 tablet_loader.cc:96] loaded metadata for tablet 596ef68705c84791b54f07e03b219b4c (table default.Table_0a73e0c5eead4482b2f6747fec27846f [id=3cda30618acd40f08728b0ccb01bb973])
I20260617 07:53:09.784976 1045 raft_consensus.cc:2468] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.785394 851 leader_election.cc:304] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.785708 1634 raft_consensus.cc:2804] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.785820 1634 raft_consensus.cc:493] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.785940 1634 raft_consensus.cc:3060] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.786700 1737 tablet_loader.cc:96] loaded metadata for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d])
I20260617 07:53:09.787101 1737 tablet_loader.cc:96] loaded metadata for tablet 5f8602b87a20455884c16196a901d335 (table default.Table_e01c4bf739194d638e2a3988702d4cfb [id=87e7c45adff04a7eb2c6edf0b75a047c])
I20260617 07:53:09.787745 1737 tablet_loader.cc:96] loaded metadata for tablet 60d1b4975077493eb6919b23d6523d3d (table default.Table_d199dae87e49454e8a74b84f1e0e28df [id=db2d3339eca0486bae7ce80d2f36323b])
I20260617 07:53:09.788406 1657 raft_consensus.cc:515] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.788633 1634 raft_consensus.cc:515] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.789109 1657 leader_election.cc:290] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.789430 1634 leader_election.cc:290] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.790165 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ce51c155c04897a4cf8f7b4ac9a5c6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.792026 1737 tablet_loader.cc:96] loaded metadata for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777])
W20260617 07:53:09.792271 986 leader_election.cc:343] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:09.792695 1361 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.105.189:36505 timed out after 0.525s (SENT)
I20260617 07:53:09.793637 1685 raft_consensus.cc:493] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.793851 1685 raft_consensus.cc:515] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.794121 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f030d59f4e124f64bb62d05f0bb0f560" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.794484 1685 leader_election.cc:290] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.794621 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5bbdbcf3044128a4cb274f83d5d29b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.794788 1737 tablet_loader.cc:96] loaded metadata for tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_b8214873449f45f6be18047115a40c52 [id=32680a1bed374ba18c213d1bf46ce772])
W20260617 07:53:09.795063 852 leader_election.cc:343] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.795722 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ce51c155c04897a4cf8f7b4ac9a5c6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.795696 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5bbdbcf3044128a4cb274f83d5d29b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.796178 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc0676db18c42259efb1ad7dbd140c8" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.796228 988 leader_election.cc:304] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.796424 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f030d59f4e124f64bb62d05f0bb0f560" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:09.796442 914 raft_consensus.cc:2468] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:09.796598 1047 raft_consensus.cc:3060] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:09.796681 988 leader_election.cc:343] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.796829 988 leader_election.cc:304] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:09.797029 716 leader_election.cc:304] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
W20260617 07:53:09.797225 988 leader_election.cc:343] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.797345 1685 raft_consensus.cc:2804] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.797435 1685 raft_consensus.cc:493] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.797539 1685 raft_consensus.cc:3060] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.797509 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7343400555f447b8a1721ba36d7766d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:09.797674 1045 raft_consensus.cc:3060] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.799703 1047 raft_consensus.cc:2468] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:09.794507 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7343400555f447b8a1721ba36d7766d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:09.800603 986 leader_election.cc:343] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.800622 1685 raft_consensus.cc:515] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.800745 986 leader_election.cc:304] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:09.801054 851 leader_election.cc:304] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
W20260617 07:53:09.801635 852 leader_election.cc:343] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.801769 1634 raft_consensus.cc:2804] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.801884 1634 raft_consensus.cc:493] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.801975 1634 raft_consensus.cc:3060] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.802017 1685 leader_election.cc:290] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.801779 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc0676db18c42259efb1ad7dbd140c8" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:09.806622 914 raft_consensus.cc:3060] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.805537 1634 raft_consensus.cc:515] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.810456 1634 leader_election.cc:290] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.810551 1737 tablet_loader.cc:96] loaded metadata for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_d3c466258c0b40f09368d392be11d6dc [id=eb9a1f29372d468bb9449eb1b84c87ad])
I20260617 07:53:09.810936 1751 raft_consensus.cc:2804] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.810902 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3b5cb887da4d86bdc3d69f350fdb40" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:09.811339 1737 tablet_loader.cc:96] loaded metadata for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b])
I20260617 07:53:09.811362 1770 raft_consensus.cc:2749] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.811570 1770 raft_consensus.cc:2749] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:09.811581 852 leader_election.cc:343] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.811928 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7392ca4ba6a140e19c57e962a26162af" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.812201 1046 raft_consensus.cc:2468] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:09.812610 713 leader_election.cc:343] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 0dc0676db18c42259efb1ad7dbd140c8
W20260617 07:53:09.813529 713 leader_election.cc:343] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 0dc0676db18c42259efb1ad7dbd140c8
I20260617 07:53:09.814589 914 raft_consensus.cc:2468] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:09.815243 716 leader_election.cc:304] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:09.815604 1685 raft_consensus.cc:2804] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.800748 1045 raft_consensus.cc:2468] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:09.818583 1685 raft_consensus.cc:697] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:09.819023 1685 consensus_queue.cc:237] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.813110 1737 tablet_loader.cc:96] loaded metadata for tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938])
I20260617 07:53:09.822367 1737 tablet_loader.cc:96] loaded metadata for tablet 70e4068fdcbb41de966bcc72a4d1d426 (table default.Table_0ebdf4b1d9ba4845958bccb5883ec491 [id=369a4a7b1948442aa0520b679c3cf974])
I20260617 07:53:09.822985 1737 tablet_loader.cc:96] loaded metadata for tablet 72f1051b9dd04db5a8f1245242d39376 (table default.Table_2eb65c0d123846f1804e668fde8d23f5 [id=d8d07e82f2854f639176622bac6035e9])
I20260617 07:53:09.823530 1737 tablet_loader.cc:96] loaded metadata for tablet 737e9344fc824714a2c2596170637158 (table default.Table_3c03bf27d19849b7a595ecc26c80f3ab [id=c36cef97efcd403ebda494e915ac280f])
I20260617 07:53:09.824976 1737 tablet_loader.cc:96] loaded metadata for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_a0dbb3e035514253b4f61f11d26da473 [id=07f503d6e3f34dbc9eacdead783c4e9e])
I20260617 07:53:09.825511 1737 tablet_loader.cc:96] loaded metadata for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d])
I20260617 07:53:09.826022 1737 tablet_loader.cc:96] loaded metadata for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_8e5edb393db8438abed9a541c820e07a [id=dd897f18c75c4eb3a3e593672b437bd6])
I20260617 07:53:09.827104 1737 tablet_loader.cc:96] loaded metadata for tablet 77c3bf1860c34ee3821bf273234cb0a4 (table default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa [id=4d565f22e74c4c9d97a5b367e2b016b4])
I20260617 07:53:09.827680 851 leader_election.cc:304] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.828472 1737 tablet_loader.cc:96] loaded metadata for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_91f0347cdea645c393589810a50ca778 [id=e2e28ecbf16446ae9e53e20ff4537b7d])
I20260617 07:53:09.828680 851 leader_election.cc:304] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.829059 851 leader_election.cc:304] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.829321 1633 raft_consensus.cc:2804] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.829669 1737 tablet_loader.cc:96] loaded metadata for tablet 7a4a3aea221f46d3a7265bd757616bfe (table default.Table_55cf1cae5fa44c55bef179cc6aa48834 [id=f96c8d7d0be24aa4958290874ff844b5])
I20260617 07:53:09.830494 851 leader_election.cc:304] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.831463 1737 tablet_loader.cc:96] loaded metadata for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a])
I20260617 07:53:09.833884 1657 raft_consensus.cc:2804] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:09.834002 1657 raft_consensus.cc:493] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:09.834084 1657 raft_consensus.cc:3060] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.834304 1737 tablet_loader.cc:96] loaded metadata for tablet 7de5420edefc47ed9dcdf1eea02a22fa (table default.Table_af1642a493c54650937216698b190b90 [id=fc0975321cab41358afa6fd3d3abc1ad])
I20260617 07:53:09.835409 1737 tablet_loader.cc:96] loaded metadata for tablet 804126f8451e42748b26c43e31a2a1c4 (table default.Table_9061fb221e90420b87825b0ea482cf1a [id=d8f0c133a75845159f82ac3ea8322ce1])
I20260617 07:53:09.838344 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3b5cb887da4d86bdc3d69f350fdb40" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:09.838766 1045 raft_consensus.cc:3060] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.842010 1737 tablet_loader.cc:96] loaded metadata for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 (table default.Table_e0a022b4ea4c4845bfea835c7373a969 [id=9ec5b57144a547818de080724a665c09])
I20260617 07:53:09.842408 1452 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 2 FOLLOWER]: Refusing update from remote peer becdd6b4fad846399c95f04697e01d0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 526. Preceding OpId from leader: term: 2 index: 527. (index mismatch)
I20260617 07:53:09.843010 1737 tablet_loader.cc:96] loaded metadata for tablet 875962c2e27a4ee1b9889769d53022cc (table default.Table_a041e570964040bfbc2958f16c222993 [id=50331a51441b4912848b324292638c0a])
I20260617 07:53:09.843073 1634 raft_consensus.cc:2804] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.843241 1777 consensus_queue.cc:1048] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 527, Last known committed idx: 526, Time since last communication: 0.000s
I20260617 07:53:09.844650 1737 tablet_loader.cc:96] loaded metadata for tablet 8cf4025a0f784cc6868950e51a45da2e (table default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6])
I20260617 07:53:09.845158 1737 tablet_loader.cc:96] loaded metadata for tablet 8db4fdde370e4d30bbf14285923644a1 (table default.Table_9f97b99a0ab74a3782a8dfa84db280cc [id=813f40f457074561b406da3616edb14c])
I20260617 07:53:09.845628 1737 tablet_loader.cc:96] loaded metadata for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f (table default.Table_90eee67c1b8d48cfac17fa339cb10a2b [id=951e230ec1f84717b9ed7d19f4dfbc16])
I20260617 07:53:09.846035 1170 ts_tablet_manager.cc:1916] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.847182 1737 tablet_loader.cc:96] loaded metadata for tablet 9436fb7fca094eaab925748e254b1a62 (table default.Table_187d6ce1f72947bead15cb026aa308cb [id=288a2e361ab149dca98dd515225f0ad7])
I20260617 07:53:09.850425 1737 tablet_loader.cc:96] loaded metadata for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_26c85eb5e09949859f6e4039e66bd282 [id=40dfd0c31d5b4c0c9dcfae02dd246bdb])
W20260617 07:53:09.850880 446 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.105.189:36505 timed out after 0.593s (SENT) [suppressed 7 similar messages]
I20260617 07:53:09.851301 1737 tablet_loader.cc:96] loaded metadata for tablet 9618a5c0c9dd4c368f5763c434f70da5 (table default.Table_1f40cdfe73f54202b6223af377958372 [id=347683dc11c24e8e9f2e9eff1d671045])
I20260617 07:53:09.855167 1634 raft_consensus.cc:697] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:09.855679 1634 consensus_queue.cc:237] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.856669 1782 raft_consensus.cc:2804] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.857153 1782 raft_consensus.cc:697] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:09.857915 1782 consensus_queue.cc:237] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.862851 1657 raft_consensus.cc:515] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.864113 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7392ca4ba6a140e19c57e962a26162af" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:09.864832 852 leader_election.cc:343] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.865187 1657 leader_election.cc:290] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.867733 1737 tablet_loader.cc:96] loaded metadata for tablet 979087485af94e159d3d0f2cb873899e (table default.Table_ad19666d956d43a7979b4226f9645fef [id=7a23152402da4e608156935807a7b61b])
I20260617 07:53:09.868222 1737 tablet_loader.cc:96] loaded metadata for tablet 98f7c3f6260c4db690de1a5081bb2493 (table default.Table_010f16ad25e74ae9a880163fe9e08de8 [id=94a23a9e1e434285acc94bced26578f6])
I20260617 07:53:09.868714 1737 tablet_loader.cc:96] loaded metadata for tablet 99ec78c123d448329b8442a0de0140d3 (table default.Table_fc5f3ba5ab8a45c7bab81747fe42b662 [id=e65c9a5f1a1f479ea1804dfe806a2926])
W20260617 07:53:09.868782 987 connection.cc:573] server connection from 127.0.0.1:45978 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 07:53:09.869570 1737 tablet_loader.cc:96] loaded metadata for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c])
I20260617 07:53:09.869824 1045 raft_consensus.cc:2468] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:09.875176 1737 tablet_loader.cc:96] loaded metadata for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_599c014ad57e446a951f4d7cfc3a09b3 [id=885235c3332d4c4c9f62503732d3a38e])
I20260617 07:53:09.879269 1172 tablet_bootstrap.cc:492] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.879465 1172 ts_tablet_manager.cc:1403] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.269s user 0.008s sys 0.004s
I20260617 07:53:09.880196 1737 tablet_loader.cc:96] loaded metadata for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_85c6acc2e0744783bfa3d2f6f6162552 [id=965c116ab3dc4e32ad0febae905610e4])
I20260617 07:53:09.880368 1172 raft_consensus.cc:359] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.880640 1172 raft_consensus.cc:385] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.880720 1172 raft_consensus.cc:740] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.880906 1737 tablet_loader.cc:96] loaded metadata for tablet a2f21861cb6f481eae968edc733e6e6f (table default.Table_35ca50ee926746e499128390bf83c078 [id=12d27e43b2da42f7b55dbf5c9f4b103f])
I20260617 07:53:09.881042 1172 consensus_queue.cc:260] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:09.882026 714 connection.cc:573] server connection from 127.0.0.1:38066 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 07:53:09.881669 1172 ts_tablet_manager.cc:1434] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:09.882925 1172 tablet_bootstrap.cc:492] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:09.882929 1737 tablet_loader.cc:96] loaded metadata for tablet a632b42300d64471b516008ebca3312f (table default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d])
I20260617 07:53:09.883404 1737 tablet_loader.cc:96] loaded metadata for tablet a6f90a0d37cb483faa540451bf4dbe85 (table default.Table_135d8e6c7f9a41ef809b7e98a6e02c97 [id=3d306a3bde784759bd8e3a45fa8cddec])
I20260617 07:53:09.884774 1172 tablet_bootstrap.cc:654] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:09.885977 1361 connection.cc:573] client connection to 127.0.105.189:36505 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 07:53:09.886096 1737 tablet_loader.cc:96] loaded metadata for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0])
W20260617 07:53:09.886386 1361 leader_election.cc:336] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 07:53:09.886560 1361 leader_election.cc:304] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b274c37ad4445ba8b41d6784b3cd336; no voters: 29a94ff9f875443ab6aeac00922cda0d, becdd6b4fad846399c95f04697e01d0f
I20260617 07:53:09.886958 1737 tablet_loader.cc:96] loaded metadata for tablet ad2e04c81f964fe1895219311eebdee4 (table default.Table_8bcbcd3e54fe45879e296d390920d3b3 [id=f150a1142b4e4c7e85533806c596f529])
W20260617 07:53:09.887044 1105 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.105.189:36505)
W20260617 07:53:09.887567 1105 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.105.189:36505)
W20260617 07:53:09.887975 1105 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.105.189:36505)
W20260617 07:53:09.888206 1105 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.105.189:36505)
I20260617 07:53:09.894409 1737 tablet_loader.cc:96] loaded metadata for tablet b4c9a032007a412e95bbd2b229edd50b (table default.Table_94149217b8fd42f3a46ed6df137e9f82 [id=251c405acf1c444ca8d6817889ffeed5])
I20260617 07:53:09.897637 1737 tablet_loader.cc:96] loaded metadata for tablet b7c5ff28367b42d3a3922d2b789bc7ec (table default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 [id=d079dbab725b43c0807868020b551ccb])
I20260617 07:53:09.898178 1737 tablet_loader.cc:96] loaded metadata for tablet b7d4fc81456445518c1158f912dd2f8f (table default.Table_7c71fb4276494d539fb7ccb468f0e300 [id=18b40cd6665e42f793ddb27a1dacbe73])
I20260617 07:53:09.898682 1737 tablet_loader.cc:96] loaded metadata for tablet b7d9354c81df42fb9756045e659be26d (table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c])
W20260617 07:53:09.900758 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 70258.6us
I20260617 07:53:09.901639 851 leader_election.cc:304] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:09.902406 1633 raft_consensus.cc:697] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:09.902765 1633 consensus_queue.cc:237] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.904666 1634 raft_consensus.cc:2804] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:09.904835 1634 raft_consensus.cc:697] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:09.905119 1634 consensus_queue.cc:237] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.910202 1737 tablet_loader.cc:96] loaded metadata for tablet beb8fbb44e6147be8c9605be886a8aea (table default.Table_f8e68ee7c0bf43b08f9c84454484121d [id=2ce20b981b024427aca662385456a101])
I20260617 07:53:09.910758 1737 tablet_loader.cc:96] loaded metadata for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913])
I20260617 07:53:09.911558 1737 tablet_loader.cc:96] loaded metadata for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2])
I20260617 07:53:09.912986 1781 raft_consensus.cc:493] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.913159 1781 raft_consensus.cc:515] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.913594 1783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: SysCatalogTable state changed. Reason: New leader becdd6b4fad846399c95f04697e01d0f. Latest consensus state: current_term: 2 leader_uuid: "becdd6b4fad846399c95f04697e01d0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:09.913872 1783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:53:09.914216 1781 leader_election.cc:290] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.914501 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21f61a35ca544568bcfca1a6230deca" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:09.915125 852 leader_election.cc:343] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:09.917786 1790 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:09.919458 1171 tablet_bootstrap.cc:492] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.919613 1171 ts_tablet_manager.cc:1403] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.149s user 0.006s sys 0.023s
I20260617 07:53:09.920428 1171 raft_consensus.cc:359] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.920615 1171 raft_consensus.cc:385] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.920727 1171 raft_consensus.cc:740] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.920996 1171 consensus_queue.cc:260] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.921447 1171 ts_tablet_manager.cc:1434] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:09.923209 1685 raft_consensus.cc:493] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.923413 1685 raft_consensus.cc:515] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.924233 1685 leader_election.cc:290] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:09.924890 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01721f68e3c41f4a2ffaf05bb180761" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:09.928121 1737 tablet_loader.cc:96] loaded metadata for tablet c9657e0dd2a8459cb728bdfe8a68b840 (table default.Table_eea666288e104386986507e494503cad [id=a8f0e5c51bec410793bcf9283fd190e3])
I20260617 07:53:09.930661 1171 tablet_bootstrap.cc:492] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:09.930934 1633 raft_consensus.cc:493] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:09.931113 1633 raft_consensus.cc:515] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.932183 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c9a032007a412e95bbd2b229edd50b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:09.932662 1171 tablet_bootstrap.cc:654] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:09.932770 852 leader_election.cc:343] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:09.934032 714 connection.cc:573] client connection to 127.0.105.189:36505 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 07:53:09.934198 1790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "becdd6b4fad846399c95f04697e01d0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:09.934506 1790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b274c37ad4445ba8b41d6784b3cd336 [sys.catalog]: This master's current role is: FOLLOWER
W20260617 07:53:09.934584 852 connection.cc:573] client connection to 127.0.105.189:36505 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260617 07:53:09.935853 446 connection.cc:573] client connection to 127.0.105.189:36505 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260617 07:53:09.936029 446 leader_election.cc:336] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 07:53:09.935941 1777 sys_catalog.cc:455] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "becdd6b4fad846399c95f04697e01d0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:09.936343 1777 sys_catalog.cc:458] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: This master's current role is: LEADER
I20260617 07:53:09.937949 1737 tablet_loader.cc:96] loaded metadata for tablet cb0ff0f0426440fba477a3dc4d1644e0 (table default.Table_45a2812670d9436a960744648a856ec8 [id=cb04083073d5491a9866d8c59d51a5e6])
I20260617 07:53:09.938812 1737 tablet_loader.cc:96] loaded metadata for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa])
I20260617 07:53:09.943245 1633 leader_election.cc:290] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:09.944926 1793 negotiation.cc:336] Failed RPC negotiation. Trace:
0617 07:53:09.898265 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.189:36505 (local address 127.0.0.1:52590)
0617 07:53:09.930231 (+ 31966us) negotiation.cc:107] Waiting for socket to connect
0617 07:53:09.930248 (+ 17us) client_negotiation.cc:175] Beginning negotiation
0617 07:53:09.930356 (+ 108us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0617 07:53:09.943169 (+ 12813us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":31823,"thread_start_us":32150,"threads_started":1}
I20260617 07:53:09.947073 1737 tablet_loader.cc:96] loaded metadata for tablet cc1d9ce2ab5b428893719d9acd272d88 (table default.Table_971d911bece54aee98e3b98f349f0aad [id=912e818e8697427a8ce7dc146b9a428f])
I20260617 07:53:09.947554 1737 tablet_loader.cc:96] loaded metadata for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7])
I20260617 07:53:09.948063 1737 tablet_loader.cc:96] loaded metadata for tablet cc84665c7849469aa27e6505dbed1516 (table default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f])
I20260617 07:53:09.948576 1737 tablet_loader.cc:96] loaded metadata for tablet ccf7f07441954d35916890efbfa4d836 (table default.Table_d7a2cf493ddd427c9087f6b6b1971450 [id=8b962c8429894c52a1ba7296a6f02205])
I20260617 07:53:09.949023 1737 tablet_loader.cc:96] loaded metadata for tablet cd9777d3619743cf8df19cf93f97f50a (table default.Table_872caaea54e048e697337c5c43b80a92 [id=af0c8ea1c1d94ba1a847371952858f99])
I20260617 07:53:09.949486 1737 tablet_loader.cc:96] loaded metadata for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578])
I20260617 07:53:09.950215 1737 tablet_loader.cc:96] loaded metadata for tablet d06187aa09fd4776a992a07405a10876 (table default.Table_67181344e3b04622865d4584952c600e [id=c866e35886e44e30b9a235af0b9a18ad])
I20260617 07:53:09.955510 1171 tablet_bootstrap.cc:492] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:09.955682 1171 ts_tablet_manager.cc:1403] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.003s
I20260617 07:53:09.956488 1171 raft_consensus.cc:359] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.956686 1171 raft_consensus.cc:385] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.956764 1171 raft_consensus.cc:740] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.957046 1171 consensus_queue.cc:260] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:09.958370 713 leader_election.cc:343] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: b01721f68e3c41f4a2ffaf05bb180761
I20260617 07:53:09.958567 713 leader_election.cc:304] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:09.959084 1685 raft_consensus.cc:2749] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:09.959370 1737 tablet_loader.cc:96] loaded metadata for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_528f3acf30374a4d83a514a59fda209b [id=9726df7d693441359861876ae1179b4d])
I20260617 07:53:09.962658 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21f61a35ca544568bcfca1a6230deca" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.963073 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c9a032007a412e95bbd2b229edd50b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:09.964071 1737 tablet_loader.cc:96] loaded metadata for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 (table default.Table_aed7483cd2e248e2915c153c409f86b6 [id=fbf729ad353844a4941f218a5f41ea33])
I20260617 07:53:09.964190 1047 raft_consensus.cc:2468] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:09.964622 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7392ca4ba6a140e19c57e962a26162af" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:09.964877 1045 raft_consensus.cc:3060] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:09.965621 1170 ts_tablet_manager.cc:1929] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:09.965799 1170 log.cc:1199] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d21f61a35ca544568bcfca1a6230deca
I20260617 07:53:09.966398 1170 ts_tablet_manager.cc:1950] T d21f61a35ca544568bcfca1a6230deca P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:09.966789 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 341) took 3554 ms. Trace:
I20260617 07:53:09.966946 1170 rpcz_store.cc:276] 0617 07:53:06.411837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.412593 (+ 756us) service_pool.cc:224] Handling call
0617 07:53:09.778226 (+3365633us) ts_tablet_manager.cc:1151] Deleting tablet d21f61a35ca544568bcfca1a6230deca
0617 07:53:09.778241 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:09.883289 (+105048us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.965490 (+ 82201us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:09.966745 (+ 1255us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3363733}
W20260617 07:53:09.967401 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 341) could send its response
I20260617 07:53:09.968415 1045 raft_consensus.cc:2468] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:09.970162 851 leader_election.cc:343] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:09.970235 1737 tablet_loader.cc:96] loaded metadata for tablet d657fbccb4af40558033a971aab7f3e4 (table default.Table_de275810487f4911a911f2d6e00a8963 [id=1f208e21034e47a8a25e0e9988e5b156])
I20260617 07:53:09.970366 851 leader_election.cc:304] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:09.970674 1751 raft_consensus.cc:697] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:09.971021 1751 consensus_queue.cc:237] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.972427 1737 tablet_loader.cc:96] loaded metadata for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6])
I20260617 07:53:09.972944 1737 tablet_loader.cc:96] loaded metadata for tablet d965aa4e8dc244cdb93dd15cdee9070c (table default.Table_5cf044f7f8984fdc9c0ea0f028992063 [id=f4ba254355924d909ef34a0453ea4823])
I20260617 07:53:09.973451 1737 tablet_loader.cc:96] loaded metadata for tablet d9968c8179c14d1b9bc9a2c2779fb86e (table default.Table_1ecdf060db0649d28c31d222fe25dda1 [id=ba6bd5b57bfc49f6a91b95badafdcb03])
I20260617 07:53:09.982807 1172 tablet_bootstrap.cc:492] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:09.982981 1172 ts_tablet_manager.cc:1403] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.100s user 0.002s sys 0.002s
I20260617 07:53:09.983489 1170 tablet_replica.cc:333] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:09.983740 1170 raft_consensus.cc:2243] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:09.984058 1172 raft_consensus.cc:359] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.984548 1172 raft_consensus.cc:385] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:09.984687 1172 raft_consensus.cc:740] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:09.985069 1172 consensus_queue.cc:260] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:09.985802 1172 ts_tablet_manager.cc:1434] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20260617 07:53:09.987092 1170 raft_consensus.cc:2272] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:09.989059 1737 tablet_loader.cc:96] loaded metadata for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_768b8c0a1c2b4100aa62ae9ce4250864 [id=0520008198914d0994fb211238c522bf])
I20260617 07:53:09.989930 1170 ts_tablet_manager.cc:1916] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:09.990278 1737 tablet_loader.cc:96] loaded metadata for tablet ddd63aa802164f25aca72bea45ea3b96 (table default.Table_06a54fcfd98445bbafab5f9750da86ea [id=5a4c1e6d9cd541089b5e273664d73be9])
I20260617 07:53:09.991648 1737 tablet_loader.cc:96] loaded metadata for tablet df5bbdbcf3044128a4cb274f83d5d29b (table default.Table_d96805f03e8f47b58040c4896878c01e [id=e42c6141367a4922ace753fd8ccf8463])
I20260617 07:53:09.994308 1172 tablet_bootstrap.cc:492] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:10.003988 1171 ts_tablet_manager.cc:1434] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.048s user 0.000s sys 0.003s
W20260617 07:53:10.004084 851 consensus_peers.cc:597] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 950c1c44020a4586b3197f5f68a38963. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:10.003985 1172 tablet_bootstrap.cc:654] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.004010 1782 raft_consensus.cc:2749] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:10.004022 1781 raft_consensus.cc:493] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.004427 1171 tablet_bootstrap.cc:492] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:10.004783 1781 raft_consensus.cc:515] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.005398 1781 leader_election.cc:290] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.005774 1737 tablet_loader.cc:96] loaded metadata for tablet e03a26e301e747febc4d5bafdc1a49c6 (table default.Table_e90ad53742c6427a87f6e2dfad5f9e54 [id=30f9fa100b704eb9bbc9a42cd664a4a5])
I20260617 07:53:10.004426 851 leader_election.cc:304] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.006500 1780 raft_consensus.cc:493] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.006673 851 leader_election.cc:304] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.006734 1737 tablet_loader.cc:96] loaded metadata for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb])
I20260617 07:53:10.007078 1178 tablet_bootstrap.cc:492] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.007264 1178 ts_tablet_manager.cc:1403] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.282s user 0.033s sys 0.067s
I20260617 07:53:10.007702 1781 raft_consensus.cc:2804] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.007819 1781 raft_consensus.cc:493] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.008047 1737 tablet_loader.cc:96] loaded metadata for tablet e55d63a25a2845dbbcce20e560361007 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8])
I20260617 07:53:10.008165 1178 raft_consensus.cc:359] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.008524 1178 raft_consensus.cc:385] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.008664 1178 raft_consensus.cc:740] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.008978 1178 consensus_queue.cc:260] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.009552 1178 ts_tablet_manager.cc:1434] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:10.009918 1178 tablet_bootstrap.cc:492] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:10.010049 1781 raft_consensus.cc:3060] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.010322 1737 tablet_loader.cc:96] loaded metadata for tablet e897b111e65c497591c7daaa81d783c7 (table default.Table_5939ce898cc14175961237f56bde80ba [id=5a3a690ecbb34b44a83b177bca7926aa])
I20260617 07:53:10.011610 1178 tablet_bootstrap.cc:654] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.011670 1782 raft_consensus.cc:2804] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.011533 1780 raft_consensus.cc:515] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.014470 1737 tablet_loader.cc:96] loaded metadata for tablet e9f8492f127243eca07b2ffbabddded5 (table default.Table_77163a83bea3432b8b2ea745bef42ce8 [id=2cd57d521b8b4434b456c086f0e36de8])
I20260617 07:53:10.014633 1782 raft_consensus.cc:697] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.014948 1780 leader_election.cc:290] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:10.014806 1800 negotiation.cc:336] Failed RPC negotiation. Trace:
0617 07:53:09.937008 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.189:36505 (local address 127.0.0.1:52598)
0617 07:53:09.998126 (+ 61118us) negotiation.cc:107] Waiting for socket to connect
0617 07:53:09.999839 (+ 1713us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":60955,"thread_start_us":55062,"threads_started":1}
I20260617 07:53:10.015093 1782 consensus_queue.cc:237] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:10.015282 446 leader_election.cc:336] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505): Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection reset by peer (error 104)
W20260617 07:53:10.015585 446 consensus_peers.cc:597] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f -> Peer 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505): Couldn't send request to peer 29a94ff9f875443ab6aeac00922cda0d. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:10.017607 1781 raft_consensus.cc:515] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.017845 1737 tablet_loader.cc:96] loaded metadata for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732])
I20260617 07:53:10.018395 1737 tablet_loader.cc:96] loaded metadata for tablet eba5976fcadd4add9c671300b431617b (table default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb [id=ee23302b46474cb096ae93bc49011eeb])
I20260617 07:53:10.018883 1737 tablet_loader.cc:96] loaded metadata for tablet ee0e12aa4c60457182201a94caecda45 (table default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8])
I20260617 07:53:10.019738 1781 leader_election.cc:290] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.020581 1737 tablet_loader.cc:96] loaded metadata for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275])
I20260617 07:53:10.022379 1737 tablet_loader.cc:96] loaded metadata for tablet f14a3cb5e50b42b18ffda6f38cdfdd73 (table default.Table_95bb54209dbf45bb9b38c213a85eb101 [id=be8b1cef0a134635b8eac9b44b5bf75f])
I20260617 07:53:10.026383 1737 tablet_loader.cc:96] loaded metadata for tablet f15dcc10552d4747bad436538662bb66 (table default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b])
I20260617 07:53:10.026911 1737 tablet_loader.cc:96] loaded metadata for tablet f1b93b31475c4f29a7fdc387ffbff0cd (table default.Table_071d2b97455544f48ec96587c227de07 [id=c271a8b75d0e471db316e09706cde9ba])
I20260617 07:53:10.027890 1634 raft_consensus.cc:493] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.028055 1737 tablet_loader.cc:96] loaded metadata for tablet f2d846e5951d400ebc4ba6552406c63c (table default.Table_241a0fade3d14d01ae5af76abbb7480b [id=db98d137d4034f478394697f912bd3ef])
I20260617 07:53:10.028061 1634 raft_consensus.cc:515] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.028825 1737 tablet_loader.cc:96] loaded metadata for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_a324b6c42b014d8c97cc1dec8d9d8ca6 [id=7a56001e416e4428ae182d851d149550])
I20260617 07:53:10.028997 1634 leader_election.cc:290] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.029423 1737 tablet_loader.cc:96] loaded metadata for tablet f6fdc168bd4a4eaca86b24a986b4eb7d (table default.Table_da1e8c81e4404eecb5c17d208ae890d2 [id=b917e24e4cee4805b575b97ac7068195])
I20260617 07:53:10.030751 1737 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260617 07:53:10.035144 1178 tablet_bootstrap.cc:492] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.035312 1178 ts_tablet_manager.cc:1403] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.006s
I20260617 07:53:10.036369 1178 raft_consensus.cc:359] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.036629 1178 raft_consensus.cc:385] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.036731 1178 raft_consensus.cc:740] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.037132 1178 consensus_queue.cc:260] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.037847 1178 ts_tablet_manager.cc:1434] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260617 07:53:10.038204 1178 tablet_bootstrap.cc:492] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:10.039016 1171 tablet_bootstrap.cc:654] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.040233 1178 tablet_bootstrap.cc:654] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.047811 1737 catalog_manager.cc:1294] Loaded cluster ID: 6a36b51fde3b4c70a9a0683607c17859
I20260617 07:53:10.047961 1737 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260617 07:53:10.049777 1178 tablet_bootstrap.cc:492] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.049942 1178 ts_tablet_manager.cc:1403] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.001s
I20260617 07:53:10.050321 1634 raft_consensus.cc:493] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.050496 1634 raft_consensus.cc:515] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.050729 1178 raft_consensus.cc:359] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.050932 1178 raft_consensus.cc:385] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.051040 1178 raft_consensus.cc:740] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.051296 1178 consensus_queue.cc:260] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.051599 1634 leader_election.cc:290] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.052009 1178 ts_tablet_manager.cc:1434] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:10.055876 1171 tablet_bootstrap.cc:492] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:10.056026 1171 ts_tablet_manager.cc:1403] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.003s
I20260617 07:53:10.056828 1171 raft_consensus.cc:359] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.057041 1171 raft_consensus.cc:385] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.057155 1171 raft_consensus.cc:740] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:10.057224 1801 negotiation.cc:336] Failed RPC negotiation. Trace:
0617 07:53:09.937126 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.189:36505 (local address 127.0.105.130:48843)
0617 07:53:10.056795 (+119669us) negotiation.cc:107] Waiting for socket to connect
0617 07:53:10.056951 (+ 156us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":119536,"threads_started":1}
I20260617 07:53:10.057416 1171 consensus_queue.cc:260] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.057890 1171 ts_tablet_manager.cc:1434] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:10.058208 1171 tablet_bootstrap.cc:492] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:10.060295 1737 catalog_manager.cc:1539] Loading token signing keys...
I20260617 07:53:10.060475 1171 tablet_bootstrap.cc:654] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.061533 1178 tablet_bootstrap.cc:492] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:10.063301 1178 tablet_bootstrap.cc:654] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.066778 1698 raft_consensus.cc:493] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.066975 1178 tablet_bootstrap.cc:492] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.066936 1698 raft_consensus.cc:515] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.067111 1178 ts_tablet_manager.cc:1403] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.002s
I20260617 07:53:10.067644 1698 leader_election.cc:290] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.068672 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b7746239c54ab6828299968d18628d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.069204 1178 raft_consensus.cc:359] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.069501 1178 raft_consensus.cc:385] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.069625 1178 raft_consensus.cc:740] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.070025 1178 consensus_queue.cc:260] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.070641 1178 ts_tablet_manager.cc:1434] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:10.073571 1171 tablet_bootstrap.cc:492] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:10.073808 1171 ts_tablet_manager.cc:1403] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260617 07:53:10.067814 1737 catalog_manager.cc:6080] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Loaded TSK: 0
I20260617 07:53:10.074681 1171 raft_consensus.cc:359] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.074995 1171 raft_consensus.cc:385] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.075064 1737 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260617 07:53:10.075126 1171 raft_consensus.cc:740] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.075325 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c21efcad98348ebabcee4821dc4682e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.075358 1171 consensus_queue.cc:260] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.076069 1171 ts_tablet_manager.cc:1434] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:10.076047 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c9a032007a412e95bbd2b229edd50b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.076367 1171 tablet_bootstrap.cc:492] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:10.076318 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f51c76d93674a91b5ada7821393020a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.078428 1171 tablet_bootstrap.cc:654] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.079485 1781 raft_consensus.cc:493] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.079646 1781 raft_consensus.cc:515] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.080279 1781 leader_election.cc:290] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.081456 1047 raft_consensus.cc:2468] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.082005 851 leader_election.cc:304] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.082291 1780 raft_consensus.cc:2804] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.082404 1780 raft_consensus.cc:493] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.082495 1780 raft_consensus.cc:3060] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.085345 1780 raft_consensus.cc:515] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.085819 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b7746239c54ab6828299968d18628d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.086077 914 raft_consensus.cc:2468] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:10.086495 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8388648475499db50cc16a7c36775a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:10.086753 986 leader_election.cc:343] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.087131 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80c2ffcf1b84df0bc6a468ea0929e80" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.087221 1046 raft_consensus.cc:2468] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.087662 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9db8a986b344548e435b77edc14cb6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.087689 1050 raft_consensus.cc:3060] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.088387 1780 leader_election.cc:290] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.088660 1047 raft_consensus.cc:2468] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.094719 988 leader_election.cc:304] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.094904 1178 tablet_bootstrap.cc:492] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:10.096127 851 leader_election.cc:304] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:10.096520 851 leader_election.cc:343] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:10.096791 851 leader_election.cc:304] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.096833 1052 raft_consensus.cc:2468] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.097088 1698 raft_consensus.cc:2804] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.097147 1634 raft_consensus.cc:2804] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.097326 1634 raft_consensus.cc:493] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.097484 1634 raft_consensus.cc:3060] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.097667 459 catalog_manager.cc:5696] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:10.098897 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cc84665c7849469aa27e6505dbed1516 (table default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]). Expected version 2 got 0
I20260617 07:53:10.106957 1782 raft_consensus.cc:2804] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.107112 1782 raft_consensus.cc:493] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.107226 1782 raft_consensus.cc:3060] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.108493 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ddfb822b5af4bb6b664936c769d9625 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:10.109272 460 master_service.cc:960] ReplaceTablet: received request to replace tablet d9968c8179c14d1b9bc9a2c2779fb86e from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:10.109678 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_26c85eb5e09949859f6e4039e66bd282" } new_table_name: "default.Table_68ed1ed6fe664a738ed9a11be098557e" modify_external_catalogs: true
I20260617 07:53:10.102577 1634 raft_consensus.cc:515] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.111399 458 master_service.cc:960] ReplaceTablet: received request to replace tablet cc84665c7849469aa27e6505dbed1516 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:10.111415 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f51c76d93674a91b5ada7821393020a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.111471 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c21efcad98348ebabcee4821dc4682e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.111668 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 3fcf87953dc14bf190ac74101547e52f from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:10.111945 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c21efcad98348ebabcee4821dc4682e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.112709 1634 leader_election.cc:290] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.113221 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_76ba66e135e34c4cab87ecfb9db4d2f5" } modify_external_catalogs: true
I20260617 07:53:10.113459 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_76ba66e135e34c4cab87ecfb9db4d2f5" } modify_external_catalogs: true
W20260617 07:53:10.113667 852 leader_election.cc:343] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.114212 852 leader_election.cc:343] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.114315 1782 raft_consensus.cc:515] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:10.114616 852 leader_election.cc:343] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.115096 1698 raft_consensus.cc:493] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.115269 1698 raft_consensus.cc:3060] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.115489 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_010f16ad25e74ae9a880163fe9e08de8" } modify_external_catalogs: true
I20260617 07:53:10.115660 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_010f16ad25e74ae9a880163fe9e08de8" } modify_external_catalogs: true
I20260617 07:53:10.116971 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_35ca50ee926746e499128390bf83c078" } modify_external_catalogs: true
I20260617 07:53:10.117185 1782 leader_election.cc:290] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.117193 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_35ca50ee926746e499128390bf83c078" } modify_external_catalogs: true
I20260617 07:53:10.118671 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_528f3acf30374a4d83a514a59fda209b" } new_table_name: "default.Table_8eb9043c09274769aecb39dee134ba7e" modify_external_catalogs: true
I20260617 07:53:10.119738 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_dd16c59e32e542048095a371aaddb95b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:10.122740 1170 ts_tablet_manager.cc:1929] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.122923 1170 log.cc:1199] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d80c2ffcf1b84df0bc6a468ea0929e80
I20260617 07:53:10.123292 1170 ts_tablet_manager.cc:1950] T d80c2ffcf1b84df0bc6a468ea0929e80 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.124913 1050 raft_consensus.cc:2468] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.125119 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c21efcad98348ebabcee4821dc4682e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.125855 851 leader_election.cc:304] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.125944 1052 raft_consensus.cc:3060] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.126173 1782 raft_consensus.cc:2804] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.126272 1782 raft_consensus.cc:493] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.126350 851 leader_election.cc:304] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.126396 1782 raft_consensus.cc:3060] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.128605 1052 raft_consensus.cc:2468] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.128572 1698 raft_consensus.cc:515] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.129200 1634 raft_consensus.cc:2804] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.129237 1698 leader_election.cc:290] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.129348 1634 raft_consensus.cc:697] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.129431 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9db8a986b344548e435b77edc14cb6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.129622 1050 raft_consensus.cc:3060] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.129598 1634 consensus_queue.cc:237] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.129760 851 leader_election.cc:304] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.130621 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8388648475499db50cc16a7c36775a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.130807 1047 raft_consensus.cc:3060] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.133052 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 356) took 3567 ms. Trace:
I20260617 07:53:10.133164 1170 rpcz_store.cc:276] 0617 07:53:06.565572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.565627 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:09.983416 (+3417789us) ts_tablet_manager.cc:1151] Deleting tablet d80c2ffcf1b84df0bc6a468ea0929e80
0617 07:53:09.983426 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.066546 (+ 83120us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.121755 (+ 55209us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.132984 (+ 11229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3417101}
W20260617 07:53:10.133488 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 356) could send its response
I20260617 07:53:10.133302 1050 raft_consensus.cc:2468] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.133980 1780 raft_consensus.cc:2804] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.134131 1780 raft_consensus.cc:697] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.134433 1780 consensus_queue.cc:237] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.135676 1781 raft_consensus.cc:493] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.135848 1781 raft_consensus.cc:515] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.135891 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b7746239c54ab6828299968d18628d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:10.136116 914 raft_consensus.cc:3060] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.133688 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 354) took 3569 ms. Trace:
I20260617 07:53:10.136304 1170 rpcz_store.cc:276] 0617 07:53:06.564674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.566515 (+ 1841us) service_pool.cc:224] Handling call
0617 07:53:10.133482 (+3566967us) ts_tablet_manager.cc:1151] Deleting tablet 0cfb98aecc4546c88371436fcfbf8e86
0617 07:53:10.133493 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.133630 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3528346}
I20260617 07:53:10.136560 1781 leader_election.cc:290] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.136730 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 358) took 3534 ms. Trace:
I20260617 07:53:10.136813 1170 rpcz_store.cc:276] 0617 07:53:06.602241 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.611476 (+ 9235us) service_pool.cc:224] Handling call
0617 07:53:10.136568 (+3525092us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:10.136578 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.136682 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3518803}
I20260617 07:53:10.137144 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 355) took 3571 ms. Trace:
I20260617 07:53:10.137217 1170 rpcz_store.cc:276] 0617 07:53:06.565424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.566611 (+ 1187us) service_pool.cc:224] Handling call
0617 07:53:10.137022 (+3570411us) ts_tablet_manager.cc:1151] Deleting tablet 6d8f144d04af4ea18f99aee3b82f4a28
0617 07:53:10.137029 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.137098 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3516828}
I20260617 07:53:10.137457 1170 tablet_replica.cc:333] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.137633 1170 raft_consensus.cc:2243] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.137814 1170 raft_consensus.cc:2272] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.137884 851 leader_election.cc:304] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.138212 1633 raft_consensus.cc:2804] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.138350 1633 raft_consensus.cc:697] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.138651 1633 consensus_queue.cc:237] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.139102 914 raft_consensus.cc:2468] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:10.141079 1172 tablet_bootstrap.cc:492] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:10.141224 1172 ts_tablet_manager.cc:1403] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.147s user 0.005s sys 0.007s
W20260617 07:53:10.141355 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 354) could send its response
W20260617 07:53:10.141559 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 358) could send its response
W20260617 07:53:10.141677 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 355) could send its response
I20260617 07:53:10.142079 1172 raft_consensus.cc:359] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.142275 1172 raft_consensus.cc:385] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.142333 1172 raft_consensus.cc:740] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.142547 1172 consensus_queue.cc:260] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.133688 1047 raft_consensus.cc:2468] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.143625 988 leader_election.cc:304] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.143985 851 leader_election.cc:304] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.144290 1633 raft_consensus.cc:2804] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.144461 1633 raft_consensus.cc:697] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.144778 1633 consensus_queue.cc:237] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.146622 1170 ts_tablet_manager.cc:1916] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.147204 1782 raft_consensus.cc:515] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.148150 1782 leader_election.cc:290] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.149912 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8388648475499db50cc16a7c36775a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.151706 1172 ts_tablet_manager.cc:1434] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260617 07:53:10.152123 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9db8a986b344548e435b77edc14cb6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.152431 1172 tablet_bootstrap.cc:492] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:10.153657 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b291b1c9794faa9305f7d936604a44" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.154064 1047 raft_consensus.cc:2468] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.154228 1172 tablet_bootstrap.cc:654] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.154711 851 leader_election.cc:304] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.155192 1782 raft_consensus.cc:2804] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.155323 1782 raft_consensus.cc:493] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.155432 1782 raft_consensus.cc:3060] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.156348 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f51c76d93674a91b5ada7821393020a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.156576 1778 raft_consensus.cc:493] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.156718 1778 raft_consensus.cc:515] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.157361 1778 leader_election.cc:290] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.157507 1050 raft_consensus.cc:3060] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.157509 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80c2ffcf1b84df0bc6a468ea0929e80" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.157781 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c9a032007a412e95bbd2b229edd50b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.157932 775 raft_consensus.cc:3060] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.158994 1170 ts_tablet_manager.cc:1929] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.159098 1170 log.cc:1199] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/7392ca4ba6a140e19c57e962a26162af
I20260617 07:53:10.159425 1170 ts_tablet_manager.cc:1950] T 7392ca4ba6a140e19c57e962a26162af P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.160205 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 363) took 3468 ms. Trace:
I20260617 07:53:10.160312 1170 rpcz_store.cc:276] 0617 07:53:06.692054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.692104 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:10.137387 (+3445283us) ts_tablet_manager.cc:1151] Deleting tablet 7392ca4ba6a140e19c57e962a26162af
0617 07:53:10.137396 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.149090 (+ 11694us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.158914 (+ 9824us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.160161 (+ 1247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3445036}
W20260617 07:53:10.160593 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 363) could send its response
I20260617 07:53:10.160652 1170 tablet_replica.cc:333] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.160869 1170 raft_consensus.cc:2243] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.161026 1170 raft_consensus.cc:2272] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.161283 775 raft_consensus.cc:2468] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.161522 1170 ts_tablet_manager.cc:1916] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.161861 1698 raft_consensus.cc:2804] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.162024 1698 raft_consensus.cc:697] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:10.162283 1698 consensus_queue.cc:237] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:10.163472 716 leader_election.cc:343] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 7582d201bc5843949d4be08ee7586f9d
I20260617 07:53:10.164130 1171 tablet_bootstrap.cc:492] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:10.164173 1050 raft_consensus.cc:2468] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.164284 1171 ts_tablet_manager.cc:1403] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.088s user 0.012s sys 0.034s
I20260617 07:53:10.165058 1171 raft_consensus.cc:359] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.165182 1178 tablet_bootstrap.cc:654] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.165241 1171 raft_consensus.cc:385] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.165328 1171 raft_consensus.cc:740] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.165552 1171 consensus_queue.cc:260] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.166049 1171 ts_tablet_manager.cc:1434] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:10.166344 1171 tablet_bootstrap.cc:492] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:10.166280 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd16c59e32e542048095a371aaddb95b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:10.167339 1685 raft_consensus.cc:493] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.167508 1685 raft_consensus.cc:515] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.168030 1171 tablet_bootstrap.cc:654] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.168241 1751 raft_consensus.cc:493] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.168430 1751 raft_consensus.cc:515] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.169061 1751 leader_election.cc:290] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.169332 1685 leader_election.cc:290] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.170786 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b7746239c54ab6828299968d18628d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.171145 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f51c76d93674a91b5ada7821393020a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:10.171365 852 leader_election.cc:343] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.171725 852 leader_election.cc:343] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.172008 852 leader_election.cc:343] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.172130 852 leader_election.cc:304] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:10.172544 1657 raft_consensus.cc:2749] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:10.172802 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b291b1c9794faa9305f7d936604a44" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.173060 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8388648475499db50cc16a7c36775a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:10.173305 716 leader_election.cc:343] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 5203534569bd4da18bc06751f094735f
I20260617 07:53:10.173588 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5203534569bd4da18bc06751f094735f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.173823 1047 raft_consensus.cc:2468] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:10.173959 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:10.178159 986 leader_election.cc:343] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.178474 986 leader_election.cc:343] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.178732 713 leader_election.cc:304] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:10.179143 713 leader_election.cc:343] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 7582d201bc5843949d4be08ee7586f9d
I20260617 07:53:10.179239 713 leader_election.cc:304] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:10.179587 1778 raft_consensus.cc:2804] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.179694 1778 raft_consensus.cc:493] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.179765 1778 raft_consensus.cc:3060] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.181977 1685 raft_consensus.cc:2749] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:10.182399 852 leader_election.cc:343] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.182658 852 leader_election.cc:343] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.183051 852 leader_election.cc:343] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.184270 1778 raft_consensus.cc:515] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.185019 1171 tablet_bootstrap.cc:492] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:10.185210 1171 ts_tablet_manager.cc:1403] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.002s
W20260617 07:53:10.185974 716 leader_election.cc:343] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 5203534569bd4da18bc06751f094735f
I20260617 07:53:10.186025 1171 raft_consensus.cc:359] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.186231 1171 raft_consensus.cc:385] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.186314 1171 raft_consensus.cc:740] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.186355 1172 tablet_bootstrap.cc:492] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:10.186489 1172 ts_tablet_manager.cc:1403] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.004s
I20260617 07:53:10.186517 1778 leader_election.cc:290] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.186614 1171 consensus_queue.cc:260] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.187111 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d9968c8179c14d1b9bc9a2c2779fb86e
I20260617 07:53:10.187315 1171 ts_tablet_manager.cc:1434] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:10.187376 1172 raft_consensus.cc:359] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.187549 1172 raft_consensus.cc:385] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.187548 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5203534569bd4da18bc06751f094735f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.187692 1172 raft_consensus.cc:740] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.187796 1171 tablet_bootstrap.cc:492] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:10.187775 1050 raft_consensus.cc:3060] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.187901 1172 consensus_queue.cc:260] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.188581 1172 ts_tablet_manager.cc:1434] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:10.188982 1172 tablet_bootstrap.cc:492] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:10.189303 460 catalog_manager.cc:6784] ReplaceTablet: tablet d9968c8179c14d1b9bc9a2c2779fb86e deleted and replaced by tablet f4d8542262864a0ab9d763528502bcbb
I20260617 07:53:10.189857 1171 tablet_bootstrap.cc:654] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.195344 1050 raft_consensus.cc:2468] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:10.199754 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9db8a986b344548e435b77edc14cb6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.208493 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 3fcf87953dc14bf190ac74101547e52f
I20260617 07:53:10.209035 457 catalog_manager.cc:6784] ReplaceTablet: tablet 3fcf87953dc14bf190ac74101547e52f deleted and replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16
I20260617 07:53:10.210999 1657 raft_consensus.cc:493] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.211195 1657 raft_consensus.cc:515] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.211931 1657 leader_election.cc:290] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.213320 1172 tablet_bootstrap.cc:654] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.213584 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d9354c81df42fb9756045e659be26d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.213858 1047 raft_consensus.cc:2468] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.214752 851 leader_election.cc:304] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.215256 851 leader_election.cc:304] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.215580 1657 raft_consensus.cc:2804] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.215727 1657 raft_consensus.cc:697] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.216068 1657 consensus_queue.cc:237] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.217176 1781 raft_consensus.cc:2804] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.217306 1781 raft_consensus.cc:493] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.217425 1781 raft_consensus.cc:3060] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.220500 1781 raft_consensus.cc:515] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.221202 1781 leader_election.cc:290] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.224524 1170 ts_tablet_manager.cc:1929] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.224676 1170 log.cc:1199] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/4996cde4d1514aa081257c802339abe6
I20260617 07:53:10.225067 1170 ts_tablet_manager.cc:1950] T 4996cde4d1514aa081257c802339abe6 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.227280 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d9354c81df42fb9756045e659be26d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.228160 1050 raft_consensus.cc:3060] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.231752 1050 raft_consensus.cc:2468] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.232100 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 362) took 3559 ms. Trace:
I20260617 07:53:10.232326 851 leader_election.cc:304] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.232221 1170 rpcz_store.cc:276] 0617 07:53:06.667455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.692270 (+ 24815us) service_pool.cc:224] Handling call
0617 07:53:10.160589 (+3468319us) ts_tablet_manager.cc:1151] Deleting tablet 4996cde4d1514aa081257c802339abe6
0617 07:53:10.160599 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.183357 (+ 22758us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.224442 (+ 41085us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.226673 (+ 2231us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3468012}
W20260617 07:53:10.232568 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 362) could send its response
I20260617 07:53:10.232656 1170 tablet_replica.cc:333] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.232638 1657 raft_consensus.cc:2804] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.232775 1657 raft_consensus.cc:697] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.232833 1170 raft_consensus.cc:2243] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.233048 1170 raft_consensus.cc:2272] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.233032 1657 consensus_queue.cc:237] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.233698 1170 ts_tablet_manager.cc:1916] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.236900 1782 raft_consensus.cc:515] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.238119 1782 leader_election.cc:290] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.238130 1171 tablet_bootstrap.cc:492] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:10.238422 1171 ts_tablet_manager.cc:1403] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.051s user 0.018s sys 0.020s
I20260617 07:53:10.239435 1171 raft_consensus.cc:359] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.239705 1171 raft_consensus.cc:385] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.239862 1171 raft_consensus.cc:740] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.240146 1171 consensus_queue.cc:260] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.240846 1171 ts_tablet_manager.cc:1434] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:10.241547 1171 tablet_bootstrap.cc:492] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:10.243291 1171 tablet_bootstrap.cc:654] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.246733 1172 tablet_bootstrap.cc:492] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:10.246953 1172 ts_tablet_manager.cc:1403] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20260617 07:53:10.248165 1172 raft_consensus.cc:359] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.248411 1172 raft_consensus.cc:385] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.248499 1172 raft_consensus.cc:740] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.248776 1172 consensus_queue.cc:260] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.249610 1172 ts_tablet_manager.cc:1434] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:10.250020 1172 tablet_bootstrap.cc:492] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:10.251889 1171 tablet_bootstrap.cc:492] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:10.251907 1172 tablet_bootstrap.cc:654] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.252158 1171 ts_tablet_manager.cc:1403] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260617 07:53:10.253017 1171 raft_consensus.cc:359] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.253250 1171 raft_consensus.cc:385] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.253351 1171 raft_consensus.cc:740] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.253769 1171 consensus_queue.cc:260] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.254501 1171 ts_tablet_manager.cc:1434] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:10.254887 1171 tablet_bootstrap.cc:492] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:10.256531 1171 tablet_bootstrap.cc:654] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.256858 1170 ts_tablet_manager.cc:1929] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.256986 1170 log.cc:1199] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a882ae04eeb94276bb78ded81fbea708
I20260617 07:53:10.257300 1170 ts_tablet_manager.cc:1950] T a882ae04eeb94276bb78ded81fbea708 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.257887 1782 raft_consensus.cc:493] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.258033 1782 raft_consensus.cc:515] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.258566 1782 leader_election.cc:290] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.258558 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b291b1c9794faa9305f7d936604a44" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.258750 1050 raft_consensus.cc:3060] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.259362 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7309d2b22c849ce980fd263a29ac77f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.259560 1047 raft_consensus.cc:2468] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.260023 851 leader_election.cc:304] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.260429 1782 raft_consensus.cc:2804] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.260519 1782 raft_consensus.cc:493] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.260594 1782 raft_consensus.cc:3060] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.263561 1782 raft_consensus.cc:515] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.264295 1782 leader_election.cc:290] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.265331 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7309d2b22c849ce980fd263a29ac77f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.265547 1047 raft_consensus.cc:3060] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.271564 1172 tablet_bootstrap.cc:492] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:10.271755 1172 ts_tablet_manager.cc:1403] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.001s
I20260617 07:53:10.272953 1172 raft_consensus.cc:359] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.273360 1172 raft_consensus.cc:385] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.273518 1172 raft_consensus.cc:740] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.273808 1172 consensus_queue.cc:260] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.278352 1172 ts_tablet_manager.cc:1434] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 07:53:10.278666 1172 tablet_bootstrap.cc:492] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:10.280475 1172 tablet_bootstrap.cc:654] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.282009 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 69996eb4ab6e40f9b2d97e00d766822a from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:10.282053 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 364) took 3580 ms. Trace:
I20260617 07:53:10.282196 1170 rpcz_store.cc:276] 0617 07:53:06.701344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.701475 (+ 131us) service_pool.cc:224] Handling call
0617 07:53:10.232568 (+3531093us) ts_tablet_manager.cc:1151] Deleting tablet a882ae04eeb94276bb78ded81fbea708
0617 07:53:10.232578 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.253692 (+ 21114us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.256770 (+ 3078us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.282006 (+ 25236us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3530645}
W20260617 07:53:10.282567 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 364) could send its response
I20260617 07:53:10.282626 1170 tablet_replica.cc:333] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.282580 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_37fb232762ab44cdb03ff6b8cb54866f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:10.282858 1170 raft_consensus.cc:2243] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.283025 1170 raft_consensus.cc:2272] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.283630 1170 ts_tablet_manager.cc:1916] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.284713 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a2a2da44081f4fb694da113bdbae780c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:10.285254 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2a2da44081f4fb694da113bdbae780c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:10.286582 964 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
W20260617 07:53:10.292779 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37fb232762ab44cdb03ff6b8cb54866f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:10.295848 1171 tablet_bootstrap.cc:492] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:10.296017 1171 ts_tablet_manager.cc:1403] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.041s user 0.016s sys 0.009s
I20260617 07:53:10.296870 1171 raft_consensus.cc:359] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.297052 1171 raft_consensus.cc:385] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.297145 1171 raft_consensus.cc:740] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.297549 1171 consensus_queue.cc:260] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.298079 1171 ts_tablet_manager.cc:1434] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260617 07:53:10.300555 1170 ts_tablet_manager.cc:1929] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.300700 1170 log.cc:1199] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/f030d59f4e124f64bb62d05f0bb0f560
I20260617 07:53:10.301045 1170 ts_tablet_manager.cc:1950] T f030d59f4e124f64bb62d05f0bb0f560 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:10.302027 852 leader_election.cc:343] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.304129 775 raft_consensus.cc:3060] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:10.304673 851 consensus_peers.cc:597] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b01721f68e3c41f4a2ffaf05bb180761. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:10.305157 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.305401 914 raft_consensus.cc:2468] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:10.310415 1171 tablet_bootstrap.cc:492] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:10.312438 1171 tablet_bootstrap.cc:654] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.314044 1178 tablet_bootstrap.cc:492] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.314190 1178 ts_tablet_manager.cc:1403] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.243s user 0.001s sys 0.011s
I20260617 07:53:10.314941 1178 raft_consensus.cc:359] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.315109 1178 raft_consensus.cc:385] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.315188 1178 raft_consensus.cc:740] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.315445 1178 consensus_queue.cc:260] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.321327 1098 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:10.329217 775 raft_consensus.cc:3060] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.333420 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d9354c81df42fb9756045e659be26d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.333997 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39b291b1c9794faa9305f7d936604a44" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.334786 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7309d2b22c849ce980fd263a29ac77f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.335227 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7309d2b22c849ce980fd263a29ac77f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.335794 826 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:10.344770 1778 raft_consensus.cc:493] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.344950 1778 raft_consensus.cc:515] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.346171 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.347003 1778 leader_election.cc:290] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.359805 1698 raft_consensus.cc:493] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.360110 1698 raft_consensus.cc:515] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.361008 1698 leader_election.cc:290] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.361402 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d9354c81df42fb9756045e659be26d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.362437 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 365) took 3635 ms. Trace:
I20260617 07:53:10.362564 1170 rpcz_store.cc:276] 0617 07:53:06.726840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.726894 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:10.282557 (+3555663us) ts_tablet_manager.cc:1151] Deleting tablet f030d59f4e124f64bb62d05f0bb0f560
0617 07:53:10.282568 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.298343 (+ 15775us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.300487 (+ 2144us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.362370 (+ 61883us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3555449}
W20260617 07:53:10.362926 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 365) could send its response
I20260617 07:53:10.363065 1170 tablet_replica.cc:333] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.363343 1170 raft_consensus.cc:2243] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.363400 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df705c2300064db680bec1fefab08d2f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.363565 1170 raft_consensus.cc:2272] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:10.363870 986 leader_election.cc:343] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.364279 1170 ts_tablet_manager.cc:1916] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.364799 1047 raft_consensus.cc:2468] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.365262 851 leader_election.cc:304] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.370080 1657 raft_consensus.cc:2804] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.370304 1657 raft_consensus.cc:697] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.370846 1657 consensus_queue.cc:237] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.371060 713 leader_election.cc:304] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:10.371608 1778 raft_consensus.cc:2804] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.371769 1778 raft_consensus.cc:697] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:10.372042 1778 consensus_queue.cc:237] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.372274 1170 ts_tablet_manager.cc:1929] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.372412 1170 log.cc:1199] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/82d682ae37d74b4b967da0f8e2de6301
I20260617 07:53:10.372884 1170 ts_tablet_manager.cc:1950] T 82d682ae37d74b4b967da0f8e2de6301 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.373267 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 366) took 3627 ms. Trace:
I20260617 07:53:10.373387 1170 rpcz_store.cc:276] 0617 07:53:06.746228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.746282 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:10.362947 (+3616665us) ts_tablet_manager.cc:1151] Deleting tablet 82d682ae37d74b4b967da0f8e2de6301
0617 07:53:10.362958 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.368257 (+ 5299us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.372165 (+ 3908us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.373228 (+ 1063us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3616027}
W20260617 07:53:10.373797 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 366) could send its response
I20260617 07:53:10.373875 1050 raft_consensus.cc:2468] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.374440 851 leader_election.cc:304] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.373850 1170 tablet_replica.cc:333] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.374734 1780 raft_consensus.cc:2804] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.374866 1780 raft_consensus.cc:697] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.374984 1170 raft_consensus.cc:2243] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.375152 1170 raft_consensus.cc:2272] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.375119 1780 consensus_queue.cc:237] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.375705 1170 ts_tablet_manager.cc:1916] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.377497 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.377789 1050 raft_consensus.cc:2468] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:10.379267 1178 ts_tablet_manager.cc:1434] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.065s user 0.002s sys 0.000s
I20260617 07:53:10.381973 988 leader_election.cc:304] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.382382 1178 tablet_bootstrap.cc:492] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:10.382514 1698 raft_consensus.cc:2804] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.382660 1698 raft_consensus.cc:493] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.383857 1698 raft_consensus.cc:3060] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.384223 1178 tablet_bootstrap.cc:654] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.386744 1698 raft_consensus.cc:515] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.387969 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.388689 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df705c2300064db680bec1fefab08d2f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.388762 1782 consensus_queue.cc:1048] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:10.388845 852 leader_election.cc:343] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.388975 914 raft_consensus.cc:2468] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
W20260617 07:53:10.389186 852 leader_election.cc:343] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.389195 1782 consensus_queue.cc:1048] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:10.389621 852 leader_election.cc:343] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.389613 986 leader_election.cc:343] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.389945 852 leader_election.cc:343] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.390080 1685 raft_consensus.cc:493] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:10.390255 852 leader_election.cc:343] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.390202 1685 raft_consensus.cc:515] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.390797 1685 leader_election.cc:290] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.390849 988 leader_election.cc:304] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.391242 1751 raft_consensus.cc:2804] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.391338 1751 raft_consensus.cc:493] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.391480 1751 raft_consensus.cc:3060] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.394166 1751 raft_consensus.cc:515] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.394268 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c1c44020a4586b3197f5f68a38963" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.394834 1751 leader_election.cc:290] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.395534 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df705c2300064db680bec1fefab08d2f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:10.395990 986 leader_election.cc:343] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.396341 713 leader_election.cc:304] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:10.396692 775 raft_consensus.cc:3060] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.403777 1685 raft_consensus.cc:2804] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 07:53:10.403901 1685 raft_consensus.cc:493] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.403990 1685 raft_consensus.cc:3060] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:10.402673 1170 ts_tablet_manager.cc:1929] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.404618 1170 log.cc:1199] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/c7343400555f447b8a1721ba36d7766d
I20260617 07:53:10.404423 1172 tablet_bootstrap.cc:492] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:10.403163 1698 leader_election.cc:290] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.404871 1172 ts_tablet_manager.cc:1403] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.126s user 0.009s sys 0.018s
I20260617 07:53:10.405922 1172 raft_consensus.cc:359] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.406173 1172 raft_consensus.cc:385] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.406255 1172 raft_consensus.cc:740] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.406661 1633 raft_consensus.cc:493] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.406818 1633 raft_consensus.cc:515] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.407521 1685 raft_consensus.cc:515] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.408090 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c7ced951c34afa8dff243d275bfb36" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.408350 1050 raft_consensus.cc:2468] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.408449 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:10.408946 851 leader_election.cc:304] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.409314 1782 raft_consensus.cc:2804] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.409449 1782 raft_consensus.cc:493] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.409593 1782 raft_consensus.cc:3060] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.409365 1685 leader_election.cc:290] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.410728 1780 raft_consensus.cc:493] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.410889 1780 raft_consensus.cc:515] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.411516 1780 leader_election.cc:290] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.412099 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763581e2baeb46149bfb38d81301b9c5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.412310 1050 raft_consensus.cc:2468] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.412421 1782 raft_consensus.cc:515] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.412752 851 leader_election.cc:304] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.413055 1782 leader_election.cc:290] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.413057 1780 raft_consensus.cc:2804] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.413373 1780 raft_consensus.cc:493] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.413479 1780 raft_consensus.cc:3060] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.416996 1780 raft_consensus.cc:515] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.417985 1633 leader_election.cc:290] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.418243 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c7ced951c34afa8dff243d275bfb36" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.418329 1780 leader_election.cc:290] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.418496 1050 raft_consensus.cc:3060] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.418886 1170 ts_tablet_manager.cc:1950] T c7343400555f447b8a1721ba36d7766d P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.419740 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 367) took 3628 ms. Trace:
I20260617 07:53:10.419849 1170 rpcz_store.cc:276] 0617 07:53:06.791421 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.791474 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:10.373754 (+3582280us) ts_tablet_manager.cc:1151] Deleting tablet c7343400555f447b8a1721ba36d7766d
0617 07:53:10.373766 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.386505 (+ 12739us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.402579 (+ 16074us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.419680 (+ 17101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3582076}
W20260617 07:53:10.420198 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 367) could send its response
I20260617 07:53:10.420331 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 370) took 3585 ms. Trace:
I20260617 07:53:10.420421 1170 rpcz_store.cc:276] 0617 07:53:06.835271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.835329 (+ 58us) service_pool.cc:224] Handling call
0617 07:53:10.420143 (+3584814us) ts_tablet_manager.cc:1151] Deleting tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
0617 07:53:10.420157 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.420265 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3584579}
W20260617 07:53:10.420694 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 370) could send its response
I20260617 07:53:10.420832 1172 consensus_queue.cc:260] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.420961 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9968c8179c14d1b9bc9a2c2779fb86e" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.421175 1052 raft_consensus.cc:3060] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:10.421397 1172 ts_tablet_manager.cc:1434] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260617 07:53:10.421790 1172 tablet_bootstrap.cc:492] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:10.421873 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d9968c8179c14d1b9bc9a2c2779fb86e with delete_type TABLET_DATA_DELETED (replaced by tablet f4d8542262864a0ab9d763528502bcbb) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:10.422241 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:10.422464 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 7392ca4ba6a140e19c57e962a26162af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:10.423552 1172 tablet_bootstrap.cc:654] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.424099 1052 raft_consensus.cc:2468] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 2.
I20260617 07:53:10.420737 1170 tablet_replica.cc:333] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.424507 1170 raft_consensus.cc:2243] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.424715 1170 raft_consensus.cc:2272] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.425386 1170 ts_tablet_manager.cc:1916] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.425895 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet d9968c8179c14d1b9bc9a2c2779fb86e with delete_type TABLET_DATA_DELETED (replaced by tablet f4d8542262864a0ab9d763528502bcbb) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:10.426321 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:10.427593 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763581e2baeb46149bfb38d81301b9c5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.427800 1047 raft_consensus.cc:3060] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.429847 1050 raft_consensus.cc:2468] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.429909 1780 raft_consensus.cc:493] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.430051 1780 raft_consensus.cc:515] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.430362 851 leader_election.cc:304] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.430711 1633 raft_consensus.cc:2804] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
W20260617 07:53:10.430838 713 leader_election.cc:343] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 950c1c44020a4586b3197f5f68a38963
I20260617 07:53:10.431003 713 leader_election.cc:304] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:10.431000 1633 raft_consensus.cc:697] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.431319 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ce51c155c04897a4cf8f7b4ac9a5c6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.431380 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:10.431314 1633 consensus_queue.cc:237] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.431509 1050 raft_consensus.cc:2468] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.431625 713 leader_election.cc:304] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:10.431869 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:10.431905 851 leader_election.cc:304] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.432255 1780 leader_election.cc:290] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.432315 1634 raft_consensus.cc:2804] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.432367 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:10.432410 1634 raft_consensus.cc:493] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.432514 1634 raft_consensus.cc:3060] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.433844 1047 raft_consensus.cc:2468] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.434418 851 leader_election.cc:304] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.434684 1751 raft_consensus.cc:493] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.435012 1657 raft_consensus.cc:2804] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.435252 1657 raft_consensus.cc:697] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.435504 1657 consensus_queue.cc:237] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.435619 1634 raft_consensus.cc:515] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.436748 1751 raft_consensus.cc:515] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.437253 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ce51c155c04897a4cf8f7b4ac9a5c6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.437417 1047 raft_consensus.cc:3060] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.437740 1685 raft_consensus.cc:2749] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:10.438190 1685 raft_consensus.cc:2804] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260617 07:53:10.438338 1685 raft_consensus.cc:697] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:10.438586 1685 consensus_queue.cc:237] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.443094 1751 leader_election.cc:290] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.443410 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e1fd7f91f94221884be2166f0cc793" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.443681 1047 raft_consensus.cc:2468] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.445806 851 leader_election.cc:304] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.446136 1780 raft_consensus.cc:2804] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.447463 1780 raft_consensus.cc:697] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.447811 1634 leader_election.cc:290] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.448119 1780 consensus_queue.cc:237] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:10.451313 986 leader_election.cc:343] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.452983 1170 ts_tablet_manager.cc:1929] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.453117 1170 log.cc:1199] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5203534569bd4da18bc06751f094735f
I20260617 07:53:10.453495 1170 ts_tablet_manager.cc:1950] T 5203534569bd4da18bc06751f094735f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.457011 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:10.457005 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df705c2300064db680bec1fefab08d2f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:10.457248 918 raft_consensus.cc:3060] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.457358 914 raft_consensus.cc:3060] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.458491 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 373) took 3592 ms. Trace:
I20260617 07:53:10.458614 1170 rpcz_store.cc:276] 0617 07:53:06.865863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.865919 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:10.420646 (+3554727us) ts_tablet_manager.cc:1151] Deleting tablet 5203534569bd4da18bc06751f094735f
0617 07:53:10.420655 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.449827 (+ 29172us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.452898 (+ 3071us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.458445 (+ 5547us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3554485}
I20260617 07:53:10.459007 1170 tablet_replica.cc:333] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:10.459148 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 373) could send its response
I20260617 07:53:10.459233 1170 raft_consensus.cc:2243] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.459414 1170 raft_consensus.cc:2272] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.460036 1170 ts_tablet_manager.cc:1916] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.460235 918 raft_consensus.cc:2468] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:10.460485 914 raft_consensus.cc:2468] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:10.460757 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e1fd7f91f94221884be2166f0cc793" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.460939 918 raft_consensus.cc:2468] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:10.461175 1846 tablet_replica.cc:333] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:10.461508 918 raft_consensus.cc:1275] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Refusing update from remote peer dc3bec007846459a9da0c7b8211e477b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:10.470175 988 leader_election.cc:304] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.472321 1698 raft_consensus.cc:2804] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.472877 1698 raft_consensus.cc:697] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:10.473239 1698 consensus_queue.cc:237] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.476171 1178 tablet_bootstrap.cc:492] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.476542 1178 ts_tablet_manager.cc:1403] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.094s user 0.002s sys 0.002s
I20260617 07:53:10.477416 1178 raft_consensus.cc:359] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.477774 1178 raft_consensus.cc:385] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.477909 1178 raft_consensus.cc:740] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.478638 1178 consensus_queue.cc:260] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.479241 1178 ts_tablet_manager.cc:1434] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260617 07:53:10.480043 986 consensus_peers.cc:597] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:10.484764 1170 ts_tablet_manager.cc:1929] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.484923 1170 log.cc:1199] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/ab8388648475499db50cc16a7c36775a
I20260617 07:53:10.485266 1170 ts_tablet_manager.cc:1950] T ab8388648475499db50cc16a7c36775a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.489571 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 375) took 3603 ms. Trace:
I20260617 07:53:10.489683 1170 rpcz_store.cc:276] 0617 07:53:06.886235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.886286 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:10.458909 (+3572623us) ts_tablet_manager.cc:1151] Deleting tablet ab8388648475499db50cc16a7c36775a
0617 07:53:10.458919 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.472859 (+ 13940us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.484688 (+ 11829us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.489511 (+ 4823us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3572372}
I20260617 07:53:10.490257 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 381) took 3562 ms. Trace:
W20260617 07:53:10.490309 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 375) could send its response
I20260617 07:53:10.490353 1170 rpcz_store.cc:276] 0617 07:53:06.928067 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.931966 (+ 3899us) service_pool.cc:224] Handling call
0617 07:53:10.490056 (+3558090us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:10.490067 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.490195 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3557728}
I20260617 07:53:10.490650 1170 tablet_replica.cc:333] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:10.490687 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 381) could send its response
I20260617 07:53:10.490849 1170 raft_consensus.cc:2243] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.491077 1170 raft_consensus.cc:2272] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.491621 1170 ts_tablet_manager.cc:1916] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.492656 988 leader_election.cc:304] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.493582 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
/tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:36505
--webserver_interface=127.0.105.189
--webserver_port=38635
--builtin_ntp_servers=127.0.105.148:37851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 07:53:10.494670 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet cc84665c7849469aa27e6505dbed1516
I20260617 07:53:10.495289 458 catalog_manager.cc:6784] ReplaceTablet: tablet cc84665c7849469aa27e6505dbed1516 deleted and replaced by tablet 71e8f7118aaf4c6a9b9caab5abc030fa
I20260617 07:53:10.500520 1751 raft_consensus.cc:2804] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.510437 1171 tablet_bootstrap.cc:492] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:10.510623 1171 ts_tablet_manager.cc:1403] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.200s user 0.027s sys 0.074s
I20260617 07:53:10.511548 1171 raft_consensus.cc:359] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.511834 1171 raft_consensus.cc:385] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.511902 1171 raft_consensus.cc:740] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.512184 1171 consensus_queue.cc:260] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.512974 1171 ts_tablet_manager.cc:1434] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:10.513363 1171 tablet_bootstrap.cc:492] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:10.515388 1171 tablet_bootstrap.cc:654] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.520450 1170 ts_tablet_manager.cc:1929] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 07:53:10.520641 1170 log.cc:1199] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/006b71a3287240a5b15bfd489f514f4c
I20260617 07:53:10.521176 1170 ts_tablet_manager.cc:1950] T 006b71a3287240a5b15bfd489f514f4c P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.522197 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 384) took 3527 ms. Trace:
I20260617 07:53:10.522365 1170 rpcz_store.cc:276] 0617 07:53:06.994503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:06.994816 (+ 313us) service_pool.cc:224] Handling call
0617 07:53:10.490574 (+3495758us) ts_tablet_manager.cc:1151] Deleting tablet 006b71a3287240a5b15bfd489f514f4c
0617 07:53:10.490582 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.515157 (+ 24575us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.520286 (+ 5129us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.522143 (+ 1857us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3495537}
W20260617 07:53:10.522821 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 384) could send its response
I20260617 07:53:10.522933 1170 tablet_replica.cc:333] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.523252 1751 raft_consensus.cc:697] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:10.523785 1751 consensus_queue.cc:237] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.528823 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet cc84665c7849469aa27e6505dbed1516 with delete_type TABLET_DATA_DELETED (replaced by tablet 71e8f7118aaf4c6a9b9caab5abc030fa) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:10.532070 1857 raft_consensus.cc:493] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.532402 988 leader_election.cc:304] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.532331 1857 raft_consensus.cc:515] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.532793 1698 raft_consensus.cc:2804] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.532891 1698 raft_consensus.cc:493] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.532991 1698 raft_consensus.cc:3060] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.533490 1857 leader_election.cc:290] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.533748 1857 consensus_queue.cc:1048] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:10.536599 1698 raft_consensus.cc:515] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.537731 1698 leader_election.cc:290] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.523239 1170 raft_consensus.cc:2243] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.539079 1170 raft_consensus.cc:2272] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.539784 1170 ts_tablet_manager.cc:1916] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.547021 897 tablet_service.cc:1558] Processing DeleteTablet for tablet d9968c8179c14d1b9bc9a2c2779fb86e with delete_type TABLET_DATA_DELETED (replaced by tablet f4d8542262864a0ab9d763528502bcbb) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:10.535178 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cb2c879e6451886c55907678792de" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.538628 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e1fd7f91f94221884be2166f0cc793" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.559422 1178 tablet_bootstrap.cc:492] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:10.560767 986 leader_election.cc:343] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.561183 986 leader_election.cc:343] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.562932 1178 tablet_bootstrap.cc:654] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.569828 1780 raft_consensus.cc:493] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.570204 1780 raft_consensus.cc:515] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.571363 1780 leader_election.cc:290] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.573457 1846 raft_consensus.cc:2243] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 LEADER]: Raft consensus shutting down.
I20260617 07:53:10.574035 1846 pending_rounds.cc:70] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: Trying to abort 1 pending ops.
I20260617 07:53:10.574096 1846 pending_rounds.cc:77] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7297772709639270400 op_type: NO_OP noop_request { }
I20260617 07:53:10.574241 1846 raft_consensus.cc:2889] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:10.574359 1846 raft_consensus.cc:2272] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:10.577103 713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 145496us
I20260617 07:53:10.577858 759 tablet_service.cc:1558] Processing DeleteTablet for tablet cc84665c7849469aa27e6505dbed1516 with delete_type TABLET_DATA_DELETED (replaced by tablet 71e8f7118aaf4c6a9b9caab5abc030fa) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:10.586997 1170 ts_tablet_manager.cc:1929] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.587196 1170 log.cc:1199] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/6ddfb822b5af4bb6b664936c769d9625
I20260617 07:53:10.587447 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:10.587630 1170 ts_tablet_manager.cc:1950] T 6ddfb822b5af4bb6b664936c769d9625 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.588760 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 387) took 3447 ms. Trace:
I20260617 07:53:10.588883 1170 rpcz_store.cc:276] 0617 07:53:07.141460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.143181 (+ 1721us) service_pool.cc:224] Handling call
0617 07:53:10.522818 (+3379637us) ts_tablet_manager.cc:1151] Deleting tablet 6ddfb822b5af4bb6b664936c769d9625
0617 07:53:10.522833 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.563500 (+ 40667us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.586272 (+ 22772us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.588678 (+ 2406us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3378795}
W20260617 07:53:10.589232 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 387) could send its response
I20260617 07:53:10.591976 898 tablet_service.cc:1558] Processing DeleteTablet for tablet cc84665c7849469aa27e6505dbed1516 with delete_type TABLET_DATA_DELETED (replaced by tablet 71e8f7118aaf4c6a9b9caab5abc030fa) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:10.592083 1170 tablet_replica.cc:333] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.592340 1170 raft_consensus.cc:2243] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.592628 1170 raft_consensus.cc:2272] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.593386 1170 ts_tablet_manager.cc:1916] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.605043 1862 tablet_replica.cc:333] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:10.605417 1862 raft_consensus.cc:2243] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:10.605835 1862 pending_rounds.cc:70] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:10.605929 1862 pending_rounds.cc:77] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772705276018688 op_type: NO_OP noop_request { }
I20260617 07:53:10.606156 1862 raft_consensus.cc:2889] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:10.606293 1862 raft_consensus.cc:2272] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.607182 1862 ts_tablet_manager.cc:1916] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.615965 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2d516117840d45a0b36733f1f4cc08d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:10.616065 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_912b307c6f95423883dad501646529f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:10.616840 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_912b307c6f95423883dad501646529f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:10.616873 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d516117840d45a0b36733f1f4cc08d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:10.619277 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 86067.1us
I20260617 07:53:10.620325 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e43e1a3df54efe992a86dd0bd0c149" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.620606 1047 raft_consensus.cc:2468] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.620882 1170 ts_tablet_manager.cc:1929] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.621021 1170 log.cc:1199] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d7309d2b22c849ce980fd263a29ac77f
I20260617 07:53:10.621419 1170 ts_tablet_manager.cc:1950] T d7309d2b22c849ce980fd263a29ac77f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.623090 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763581e2baeb46149bfb38d81301b9c5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.623925 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c7ced951c34afa8dff243d275bfb36" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.624563 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763581e2baeb46149bfb38d81301b9c5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.625209 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ce51c155c04897a4cf8f7b4ac9a5c6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.625819 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ce51c155c04897a4cf8f7b4ac9a5c6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.626524 772 raft_consensus.cc:3060] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.632189 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c7ced951c34afa8dff243d275bfb36" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.633338 1846 ts_tablet_manager.cc:1916] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.635910 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 388) took 3381 ms. Trace:
I20260617 07:53:10.636075 1170 rpcz_store.cc:276] 0617 07:53:07.256634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.256693 (+ 59us) service_pool.cc:224] Handling call
0617 07:53:10.591939 (+3335246us) ts_tablet_manager.cc:1151] Deleting tablet d7309d2b22c849ce980fd263a29ac77f
0617 07:53:10.591954 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.609968 (+ 18014us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.620796 (+ 10828us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.635836 (+ 15040us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3323139}
W20260617 07:53:10.636477 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 388) could send its response
I20260617 07:53:10.636644 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 389) took 3353 ms. Trace:
I20260617 07:53:10.636772 1170 rpcz_store.cc:276] 0617 07:53:07.283100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.283378 (+ 278us) service_pool.cc:224] Handling call
0617 07:53:10.636445 (+3353067us) ts_tablet_manager.cc:1151] Deleting tablet d03d6dc473fc4be1a436fd71a06f403e
0617 07:53:10.636461 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.636597 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3352851}
W20260617 07:53:10.637069 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 389) could send its response
I20260617 07:53:10.641970 1846 ts_tablet_manager.cc:1929] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260617 07:53:10.642428 1846 log.cc:1199] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d9968c8179c14d1b9bc9a2c2779fb86e
I20260617 07:53:10.642560 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 390) took 3328 ms. Trace:
I20260617 07:53:10.642735 1170 rpcz_store.cc:276] 0617 07:53:07.314228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.353796 (+ 39568us) service_pool.cc:224] Handling call
0617 07:53:10.642305 (+3288509us) ts_tablet_manager.cc:1151] Deleting tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
0617 07:53:10.642322 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.642503 (+ 181us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3262936}
I20260617 07:53:10.643159 1846 ts_tablet_manager.cc:1950] T d9968c8179c14d1b9bc9a2c2779fb86e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:10.643131 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 390) could send its response
I20260617 07:53:10.643276 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 407) took 3139 ms. Trace:
I20260617 07:53:10.643415 1170 rpcz_store.cc:276] 0617 07:53:07.503370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.510274 (+ 6904us) service_pool.cc:224] Handling call
0617 07:53:10.643115 (+3132841us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:10.643126 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.643229 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3132301}
W20260617 07:53:10.643724 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 407) could send its response
I20260617 07:53:10.643877 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 408) took 3133 ms. Trace:
I20260617 07:53:10.643990 1170 rpcz_store.cc:276] 0617 07:53:07.510527 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.510579 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:10.643725 (+3133146us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:10.643736 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.643840 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3132561}
W20260617 07:53:10.644209 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 408) could send its response
I20260617 07:53:10.644309 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 409) took 3106 ms. Trace:
I20260617 07:53:10.644440 1170 rpcz_store.cc:276] 0617 07:53:07.538171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.552496 (+ 14325us) service_pool.cc:224] Handling call
0617 07:53:10.644174 (+3091678us) ts_tablet_manager.cc:1151] Deleting tablet 18f9bace06e34602acc7fcd7501b3671
0617 07:53:10.644182 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.644275 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3087221}
I20260617 07:53:10.644687 1846 tablet_replica.cc:333] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:10.644654 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 409) could send its response
I20260617 07:53:10.644709 1170 tablet_replica.cc:333] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.644928 1846 raft_consensus.cc:2243] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.645210 1846 raft_consensus.cc:2272] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.651499 1172 tablet_bootstrap.cc:492] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:10.651793 1172 ts_tablet_manager.cc:1403] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.230s user 0.055s sys 0.076s
I20260617 07:53:10.652276 1170 raft_consensus.cc:2243] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.652518 1170 raft_consensus.cc:2272] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.652766 1685 raft_consensus.cc:493] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.652973 1685 raft_consensus.cc:515] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.653019 1172 raft_consensus.cc:359] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.653146 1170 ts_tablet_manager.cc:1916] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.653209 1172 raft_consensus.cc:385] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.653301 1172 raft_consensus.cc:740] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.653538 1172 consensus_queue.cc:260] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.654295 1685 leader_election.cc:290] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.654398 1172 ts_tablet_manager.cc:1434] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:10.654762 1172 tablet_bootstrap.cc:492] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:10.669142 1846 ts_tablet_manager.cc:1916] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.671195 1170 ts_tablet_manager.cc:1929] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.676928 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d9968c8179c14d1b9bc9a2c2779fb86e (table default.Table_1ecdf060db0649d28c31d222fe25dda1 [id=ba6bd5b57bfc49f6a91b95badafdcb03]) successfully deleted
I20260617 07:53:10.677824 1170 log.cc:1199] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/3f51c76d93674a91b5ada7821393020a
W20260617 07:53:10.677800 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3fcf87953dc14bf190ac74101547e52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcf87953dc14bf190ac74101547e52f already in progress: creating tablet
I20260617 07:53:10.678553 1685 raft_consensus.cc:493] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.678704 1685 raft_consensus.cc:515] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:10.679308 713 leader_election.cc:343] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a882ae04eeb94276bb78ded81fbea708
I20260617 07:53:10.679354 1685 leader_election.cc:290] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.678465 1178 tablet_bootstrap.cc:492] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.679945 1178 ts_tablet_manager.cc:1403] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.121s user 0.003s sys 0.001s
I20260617 07:53:10.680279 1170 ts_tablet_manager.cc:1950] T 3f51c76d93674a91b5ada7821393020a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:10.680683 713 consensus_peers.cc:597] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0dc0676db18c42259efb1ad7dbd140c8. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:10.680929 713 leader_election.cc:343] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 82d682ae37d74b4b967da0f8e2de6301
I20260617 07:53:10.681083 1172 tablet_bootstrap.cc:654] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.682726 1846 ts_tablet_manager.cc:1929] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.682843 1846 log.cc:1199] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/7392ca4ba6a140e19c57e962a26162af
I20260617 07:53:10.683173 1846 ts_tablet_manager.cc:1950] T 7392ca4ba6a140e19c57e962a26162af P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:10.687577 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d3c466258c0b40f09368d392be11d6dc" } new_table_name: "default.Table_a5077d1cb030456e91d1a015037c71fc" modify_external_catalogs: true
I20260617 07:53:10.689284 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 7392ca4ba6a140e19c57e962a26162af (table default.Table_7e5bc7ff50154b6ea71d9df096938e22 [id=7b8289fa3bd0446d8c61e654188ef0a1]) successfully deleted
W20260617 07:53:10.689563 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cc84665c7849469aa27e6505dbed1516 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc84665c7849469aa27e6505dbed1516 already in progress: creating tablet
I20260617 07:53:10.691346 759 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8e9692227147d6a8c6854133941b44 (DEFAULT_TABLE table=default.Table_d863711c4bc44037a3f8927442a50d68 [id=d5296e17741746c4b11bb33761009c9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.698189 741 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8ffe940130474ca09d3680e470918a (DEFAULT_TABLE table=default.Table_a25f1398f97f4c2b99ec71d2ce42f295 [id=36382a6d7a5b4ad4b40d94994f91f627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.699193 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8e9692227147d6a8c6854133941b44 (DEFAULT_TABLE table=default.Table_d863711c4bc44037a3f8927442a50d68 [id=d5296e17741746c4b11bb33761009c9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.699865 1178 raft_consensus.cc:359] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.700124 1178 raft_consensus.cc:385] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.700243 1178 raft_consensus.cc:740] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.700544 1178 consensus_queue.cc:260] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.701257 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8ffe940130474ca09d3680e470918a (DEFAULT_TABLE table=default.Table_a25f1398f97f4c2b99ec71d2ce42f295 [id=36382a6d7a5b4ad4b40d94994f91f627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.701200 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8e9692227147d6a8c6854133941b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.703526 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e43e1a3df54efe992a86dd0bd0c149" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.703720 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8ffe940130474ca09d3680e470918a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.704051 749 tablet_service.cc:1511] Processing CreateTablet for tablet 5942eea42c7541349ad7b6560e6777c8 (DEFAULT_TABLE table=default.Table_5df0947db0104ef6bb9e41fdb647e50c [id=23529b3c51f04f7093273ea0c6802bd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.704444 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5942eea42c7541349ad7b6560e6777c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.707944 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 5942eea42c7541349ad7b6560e6777c8 (DEFAULT_TABLE table=default.Table_5df0947db0104ef6bb9e41fdb647e50c [id=23529b3c51f04f7093273ea0c6802bd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.709877 1751 raft_consensus.cc:493] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.710043 1178 ts_tablet_manager.cc:1434] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.030s user 0.000s sys 0.002s
I20260617 07:53:10.710040 1751 raft_consensus.cc:515] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.710335 1178 tablet_bootstrap.cc:492] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:10.710662 1751 leader_election.cc:290] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.712942 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb95639e16ed423fbe60b15a1bcdf5a6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.715709 851 leader_election.cc:304] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.716257 1178 tablet_bootstrap.cc:654] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.716511 1685 raft_consensus.cc:493] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.716666 1685 raft_consensus.cc:515] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.717381 1685 leader_election.cc:290] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:10.718351 986 leader_election.cc:343] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.719475 749 tablet_service.cc:1511] Processing CreateTablet for tablet 9436fb7fca094eaab925748e254b1a62 (DEFAULT_TABLE table=default.Table_187d6ce1f72947bead15cb026aa308cb [id=288a2e361ab149dca98dd515225f0ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.720124 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 9436fb7fca094eaab925748e254b1a62 (DEFAULT_TABLE table=default.Table_187d6ce1f72947bead15cb026aa308cb [id=288a2e361ab149dca98dd515225f0ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.720369 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:10.720745 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_528f3acf30374a4d83a514a59fda209b [id=9726df7d693441359861876ae1179b4d]). Expected version 2 got 0
I20260617 07:53:10.720817 753 tablet_service.cc:1511] Processing CreateTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 (DEFAULT_TABLE table=default.Table_aed7483cd2e248e2915c153c409f86b6 [id=fbf729ad353844a4941f218a5f41ea33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.721127 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9436fb7fca094eaab925748e254b1a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.721993 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.723278 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:10.723464 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:10.724498 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]). Expected version 3 got 0
I20260617 07:53:10.724678 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 301bd4d6faec429ba71ce354c23d0f75 (table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012]). Expected version 2 got 0
I20260617 07:53:10.724895 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d]). Expected version 2 got 0
I20260617 07:53:10.725085 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet e55d63a25a2845dbbcce20e560361007 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]). Expected version 1 got 0
I20260617 07:53:10.725353 459 catalog_manager.cc:5696] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:10.726415 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
I20260617 07:53:10.726676 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]). Expected version 2 got 0
I20260617 07:53:10.726764 1019 tablet_service.cc:1511] Processing CreateTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 (DEFAULT_TABLE table=default.Table_aed7483cd2e248e2915c153c409f86b6 [id=fbf729ad353844a4941f218a5f41ea33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.726855 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]). Expected version 1 got 0
I20260617 07:53:10.727173 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_91f0347cdea645c393589810a50ca778 [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 1 got 0
I20260617 07:53:10.727349 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:10.727799 459 catalog_manager.cc:5696] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:10.728196 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet b7d9354c81df42fb9756045e659be26d (table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c]). Expected version 2 got 0
I20260617 07:53:10.728603 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:10.728911 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:10.729115 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:10.729441 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 2 got 0
I20260617 07:53:10.729640 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:10.729869 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:10.730051 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_073280306a2740119a28c4682671d83f [id=121feb8666fe4cb5b796fecf0bf1f8b0]). Expected version 1 got 0
I20260617 07:53:10.730368 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:10.730752 1751 raft_consensus.cc:493] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.730919 1751 raft_consensus.cc:515] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:10.731045 716 leader_election.cc:343] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a882ae04eeb94276bb78ded81fbea708
I20260617 07:53:10.731233 716 leader_election.cc:304] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:10.731748 1751 leader_election.cc:290] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.731870 1778 raft_consensus.cc:2749] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:10.732110 1778 consensus_queue.cc:1048] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:10.734017 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddb9e82c354f26b3abe56ebdefd008" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.730604 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 2 got 0
I20260617 07:53:10.737984 459 catalog_manager.cc:5696] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:10.738566 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5942eea42c7541349ad7b6560e6777c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.738771 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.739248 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:10.739463 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:10.739650 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:10.740103 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:10.740271 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 4d9ace137c4e496fafac4e729718577f (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:10.740635 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21]). Expected version 1 got 0
I20260617 07:53:10.741096 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:10.741289 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:10.741602 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:10.741777 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:10.741948 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9436fb7fca094eaab925748e254b1a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.742674 1171 tablet_bootstrap.cc:492] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:10.742854 1171 ts_tablet_manager.cc:1403] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.230s user 0.061s sys 0.081s
I20260617 07:53:10.743767 1171 raft_consensus.cc:359] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.743961 1171 raft_consensus.cc:385] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.744048 1171 raft_consensus.cc:740] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.744251 1171 consensus_queue.cc:260] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.745018 1780 raft_consensus.cc:2804] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 07:53:10.745124 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 94659.9us
I20260617 07:53:10.745765 1171 ts_tablet_manager.cc:1434] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:10.745834 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8ffe940130474ca09d3680e470918a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.746176 1780 raft_consensus.cc:493] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.746315 1780 raft_consensus.cc:3060] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.748842 1780 raft_consensus.cc:515] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.749416 1780 leader_election.cc:290] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.750694 775 raft_consensus.cc:3060] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.751083 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_41ef34e21782488da51b458e095e7bcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:10.751654 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41ef34e21782488da51b458e095e7bcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:10.755662 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e43e1a3df54efe992a86dd0bd0c149" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.755904 1047 raft_consensus.cc:3060] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:10.759500 713 leader_election.cc:343] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 4996cde4d1514aa081257c802339abe6
W20260617 07:53:10.759480 986 leader_election.cc:343] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.760643 1047 raft_consensus.cc:2468] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.762032 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 411) took 3112 ms. Trace:
I20260617 07:53:10.762168 1170 rpcz_store.cc:276] 0617 07:53:07.649940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.650908 (+ 968us) service_pool.cc:224] Handling call
0617 07:53:10.644643 (+2993735us) ts_tablet_manager.cc:1151] Deleting tablet 3f51c76d93674a91b5ada7821393020a
0617 07:53:10.644651 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.666848 (+ 22197us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.671127 (+ 4279us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.761965 (+ 90838us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7247,"tablet-delete.queue_time_us":2956228}
I20260617 07:53:10.762792 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 412) took 3021 ms. Trace:
I20260617 07:53:10.762900 1170 rpcz_store.cc:276] 0617 07:53:07.741319 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.744690 (+ 3371us) service_pool.cc:224] Handling call
0617 07:53:10.762602 (+3017912us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:10.762614 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.762736 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3016038}
I20260617 07:53:10.762933 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c5f15ddabb8041ac80b9ac925dd9cacd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:10.763330 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 416) took 2894 ms. Trace:
I20260617 07:53:10.763422 1170 rpcz_store.cc:276] 0617 07:53:07.869322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.869443 (+ 121us) service_pool.cc:224] Handling call
0617 07:53:10.763155 (+2893712us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:10.763166 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.763264 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2892253}
W20260617 07:53:10.763602 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5f15ddabb8041ac80b9ac925dd9cacd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:10.763841 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 415) took 2899 ms. Trace:
I20260617 07:53:10.763932 1170 rpcz_store.cc:276] 0617 07:53:07.864009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.864093 (+ 84us) service_pool.cc:224] Handling call
0617 07:53:10.763662 (+2899569us) ts_tablet_manager.cc:1151] Deleting tablet 5dcfb101cf51487692ef9a6a17f40804
0617 07:53:10.763672 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.763792 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2892660}
I20260617 07:53:10.764305 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 414) took 2903 ms. Trace:
I20260617 07:53:10.764422 1170 rpcz_store.cc:276] 0617 07:53:07.860709 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.860750 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:10.764162 (+2903412us) ts_tablet_manager.cc:1151] Deleting tablet 11794aa70824476e9751a41ab305cc80
0617 07:53:10.764172 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.764253 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2893083}
I20260617 07:53:10.764801 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 417) took 2894 ms. Trace:
I20260617 07:53:10.764917 1170 rpcz_store.cc:276] 0617 07:53:07.872597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:07.872651 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:10.764660 (+2892009us) ts_tablet_manager.cc:1151] Deleting tablet 74ab8e93e3fe475ba9c7b5fce390a8ab
0617 07:53:10.764670 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.764750 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2891828}
I20260617 07:53:10.765257 1170 tablet_replica.cc:333] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.765537 1170 raft_consensus.cc:2243] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.765803 1170 raft_consensus.cc:2272] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.766535 1170 ts_tablet_manager.cc:1916] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:10.766942 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 411) could send its response
W20260617 07:53:10.767148 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 412) could send its response
W20260617 07:53:10.767316 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 416) could send its response
W20260617 07:53:10.767515 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 415) could send its response
W20260617 07:53:10.767659 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 414) could send its response
W20260617 07:53:10.767792 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 417) could send its response
I20260617 07:53:10.768626 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8e9692227147d6a8c6854133941b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.779384 1172 tablet_bootstrap.cc:492] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:10.779614 1172 ts_tablet_manager.cc:1403] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.125s user 0.006s sys 0.016s
I20260617 07:53:10.780704 1172 raft_consensus.cc:359] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.780962 1172 raft_consensus.cc:385] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.781054 1172 raft_consensus.cc:740] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.781383 1172 consensus_queue.cc:260] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.782097 1172 ts_tablet_manager.cc:1434] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260617 07:53:10.786275 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d682ae37d74b4b967da0f8e2de6301" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.789649 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:10.789968 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_073280306a2740119a28c4682671d83f" } new_table_name: "default.Table_50c9e41224614d21a12eac5dea96559c" modify_external_catalogs: true
I20260617 07:53:10.791266 1171 tablet_bootstrap.cc:492] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:10.791608 716 leader_election.cc:304] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:10.792061 1685 raft_consensus.cc:2749] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:10.790096 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:10.792521 1633 raft_consensus.cc:493] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.792821 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:10.793136 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:10.793623 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d]). Expected version 2 got 0
I20260617 07:53:10.794003 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]). Expected version 1 got 0
I20260617 07:53:10.794431 1170 ts_tablet_manager.cc:1929] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:10.794592 1170 log.cc:1199] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/ddc0439f992048358f1de4381516e543
I20260617 07:53:10.795085 1170 ts_tablet_manager.cc:1950] T ddc0439f992048358f1de4381516e543 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.795077 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:10.795537 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:10.795657 1633 raft_consensus.cc:515] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.796072 1657 raft_consensus.cc:493] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.796111 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]). Expected version 3 got 0
I20260617 07:53:10.796728 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e55d63a25a2845dbbcce20e560361007 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]). Expected version 1 got 0
I20260617 07:53:10.795444 894 tablet_service.cc:1511] Processing CreateTablet for tablet 5942eea42c7541349ad7b6560e6777c8 (DEFAULT_TABLE table=default.Table_5df0947db0104ef6bb9e41fdb647e50c [id=23529b3c51f04f7093273ea0c6802bd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.797382 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet b7d9354c81df42fb9756045e659be26d (table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c]). Expected version 2 got 0
I20260617 07:53:10.797984 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_91f0347cdea645c393589810a50ca778 [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 1 got 0
W20260617 07:53:10.797685 851 consensus_peers.cc:597] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4996cde4d1514aa081257c802339abe6. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:10.798122 1657 raft_consensus.cc:515] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.798571 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:10.799561 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_528f3acf30374a4d83a514a59fda209b [id=9726df7d693441359861876ae1179b4d]). Expected version 2 got 0
I20260617 07:53:10.799903 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
I20260617 07:53:10.800308 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:10.800649 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]). Expected version 2 got 0
I20260617 07:53:10.800907 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:10.801143 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 301bd4d6faec429ba71ce354c23d0f75 (table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012]). Expected version 2 got 0
I20260617 07:53:10.801537 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:10.801810 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_073280306a2740119a28c4682671d83f [id=121feb8666fe4cb5b796fecf0bf1f8b0]). Expected version 1 got 0
I20260617 07:53:10.802145 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 2 got 0
I20260617 07:53:10.802412 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:10.802927 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:10.803862 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:10.803831 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4996cde4d1514aa081257c802339abe6" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.804265 851 leader_election.cc:304] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.804179 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 2 got 0
I20260617 07:53:10.804535 897 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8e9692227147d6a8c6854133941b44 (DEFAULT_TABLE table=default.Table_d863711c4bc44037a3f8927442a50d68 [id=d5296e17741746c4b11bb33761009c9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.804809 1634 raft_consensus.cc:2804] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.804875 716 leader_election.cc:304] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:10.804981 1634 raft_consensus.cc:697] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.805145 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:10.805244 1634 consensus_queue.cc:237] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.805408 1849 raft_consensus.cc:2749] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:10.805950 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:10.806134 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:10.806464 898 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8ffe940130474ca09d3680e470918a (DEFAULT_TABLE table=default.Table_a25f1398f97f4c2b99ec71d2ce42f295 [id=36382a6d7a5b4ad4b40d94994f91f627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.806674 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21]). Expected version 1 got 0
I20260617 07:53:10.806913 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 4d9ace137c4e496fafac4e729718577f (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:10.807207 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:10.807632 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:10.811779 887 tablet_service.cc:1511] Processing CreateTablet for tablet 9436fb7fca094eaab925748e254b1a62 (DEFAULT_TABLE table=default.Table_187d6ce1f72947bead15cb026aa308cb [id=288a2e361ab149dca98dd515225f0ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.815109 882 tablet_service.cc:1511] Processing CreateTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 (DEFAULT_TABLE table=default.Table_aed7483cd2e248e2915c153c409f86b6 [id=fbf729ad353844a4941f218a5f41ea33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.816768 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5942eea42c7541349ad7b6560e6777c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.818010 1657 leader_election.cc:290] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:10.819033 852 leader_election.cc:343] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.821110 1780 consensus_queue.cc:1048] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260617 07:53:10.821882 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.827310 1633 leader_election.cc:290] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.827471 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8e9692227147d6a8c6854133941b44. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:10.828858 852 leader_election.cc:343] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.835012 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:10.835698 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]). Expected version 1 got 0
I20260617 07:53:10.836133 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_528f3acf30374a4d83a514a59fda209b [id=9726df7d693441359861876ae1179b4d]). Expected version 2 got 0
I20260617 07:53:10.837504 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9436fb7fca094eaab925748e254b1a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.839886 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
I20260617 07:53:10.840461 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e55d63a25a2845dbbcce20e560361007 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]). Expected version 1 got 0
I20260617 07:53:10.842801 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a547dabaeb742ba941690f4895955bd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.843042 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cb2c879e6451886c55907678792de" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.843058 1052 raft_consensus.cc:2468] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.843256 1048 raft_consensus.cc:2468] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.844542 1172 tablet_bootstrap.cc:492] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:10.845917 1171 tablet_bootstrap.cc:654] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.846472 1172 tablet_bootstrap.cc:654] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.847831 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 418) took 2759 ms. Trace:
I20260617 07:53:10.847949 1170 rpcz_store.cc:276] 0617 07:53:08.087989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.088531 (+ 542us) service_pool.cc:224] Handling call
0617 07:53:10.765170 (+2676639us) ts_tablet_manager.cc:1151] Deleting tablet ddc0439f992048358f1de4381516e543
0617 07:53:10.765179 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.790869 (+ 25690us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.794325 (+ 3456us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.847797 (+ 53472us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2676351}
I20260617 07:53:10.848433 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 67cd66ea6ebc42bda00fbec82da73f16 (DEFAULT_TABLE table=default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:10.848578 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 418) could send its response
I20260617 07:53:10.848807 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67cd66ea6ebc42bda00fbec82da73f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.848456 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 423) took 2609 ms. Trace:
I20260617 07:53:10.849049 1170 rpcz_store.cc:276] 0617 07:53:08.239055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.239161 (+ 106us) service_pool.cc:224] Handling call
0617 07:53:10.848264 (+2609103us) ts_tablet_manager.cc:1151] Deleting tablet 570ae1e189a64da6bad10156b401ec46
0617 07:53:10.848277 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.848410 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2605911}
I20260617 07:53:10.849334 1170 tablet_replica.cc:333] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.849318 741 tablet_service.cc:1511] Processing CreateTablet for tablet 67cd66ea6ebc42bda00fbec82da73f16 (DEFAULT_TABLE table=default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.849704 1170 raft_consensus.cc:2243] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.850005 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67cd66ea6ebc42bda00fbec82da73f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.849952 1170 raft_consensus.cc:2272] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.850585 1170 ts_tablet_manager.cc:1916] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:10.851325 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 423) could send its response
W20260617 07:53:10.851468 851 consensus_peers.cc:597] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ddfb822b5af4bb6b664936c769d9625. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:10.851696 851 leader_election.cc:304] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.852058 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8ffe940130474ca09d3680e470918a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.852407 851 leader_election.cc:304] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.852563 1633 raft_consensus.cc:2804] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.853113 1633 raft_consensus.cc:493] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.853220 1633 raft_consensus.cc:3060] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:10.856174 852 leader_election.cc:343] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.857476 1633 raft_consensus.cc:515] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.858206 1633 leader_election.cc:290] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:10.858440 852 leader_election.cc:343] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.859558 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a547dabaeb742ba941690f4895955bd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.859543 749 tablet_service.cc:1511] Processing CreateTablet for tablet 979087485af94e159d3d0f2cb873899e (DEFAULT_TABLE table=default.Table_ad19666d956d43a7979b4226f9645fef [id=7a23152402da4e608156935807a7b61b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.859802 1050 raft_consensus.cc:3060] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.860016 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979087485af94e159d3d0f2cb873899e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.861778 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 979087485af94e159d3d0f2cb873899e (DEFAULT_TABLE table=default.Table_ad19666d956d43a7979b4226f9645fef [id=7a23152402da4e608156935807a7b61b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.862241 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979087485af94e159d3d0f2cb873899e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.862596 1050 raft_consensus.cc:2468] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:10.863095 852 leader_election.cc:343] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:10.863577 852 leader_election.cc:343] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.864023 1782 consensus_queue.cc:1048] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:10.865319 1780 raft_consensus.cc:2804] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 07:53:10.866874 986 consensus_peers.cc:597] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:10.867415 741 tablet_service.cc:1511] Processing CreateTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 (DEFAULT_TABLE table=default.Table_eea666288e104386986507e494503cad [id=a8f0e5c51bec410793bcf9283fd190e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.867815 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9657e0dd2a8459cb728bdfe8a68b840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.869995 851 leader_election.cc:304] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.870414 1780 raft_consensus.cc:493] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.870577 1780 raft_consensus.cc:3060] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.871223 1657 raft_consensus.cc:2804] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.871536 1657 raft_consensus.cc:697] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.871798 1657 consensus_queue.cc:237] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.872813 753 tablet_service.cc:1511] Processing CreateTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 (DEFAULT_TABLE table=default.Table_e0a022b4ea4c4845bfea835c7373a969 [id=9ec5b57144a547818de080724a665c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.873186 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.876819 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 (DEFAULT_TABLE table=default.Table_eea666288e104386986507e494503cad [id=a8f0e5c51bec410793bcf9283fd190e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.877247 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9657e0dd2a8459cb728bdfe8a68b840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.880069 749 tablet_service.cc:1511] Processing CreateTablet for tablet f4d8542262864a0ab9d763528502bcbb (DEFAULT_TABLE table=default.Table_1ecdf060db0649d28c31d222fe25dda1 [id=ba6bd5b57bfc49f6a91b95badafdcb03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.880462 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d8542262864a0ab9d763528502bcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.880889 1634 raft_consensus.cc:493] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.881033 1634 raft_consensus.cc:515] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.881767 1634 leader_election.cc:290] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.882084 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 (DEFAULT_TABLE table=default.Table_e0a022b4ea4c4845bfea835c7373a969 [id=9ec5b57144a547818de080724a665c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.882489 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.885994 1019 tablet_service.cc:1511] Processing CreateTablet for tablet f4d8542262864a0ab9d763528502bcbb (DEFAULT_TABLE table=default.Table_1ecdf060db0649d28c31d222fe25dda1 [id=ba6bd5b57bfc49f6a91b95badafdcb03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.886619 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d8542262864a0ab9d763528502bcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.886792 1178 tablet_bootstrap.cc:492] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.886988 1178 ts_tablet_manager.cc:1403] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.177s user 0.023s sys 0.053s
W20260617 07:53:10.887879 852 consensus_peers.cc:597] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:10.887848 1178 raft_consensus.cc:359] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.888518 1178 raft_consensus.cc:385] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.888600 1178 raft_consensus.cc:740] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.888950 1178 consensus_queue.cc:260] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.890892 1780 raft_consensus.cc:515] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.891623 1780 leader_election.cc:290] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.892840 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cb2c879e6451886c55907678792de" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:10.893076 1048 raft_consensus.cc:3060] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.893240 1178 ts_tablet_manager.cc:1434] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:10.896239 1048 raft_consensus.cc:2468] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:10.897029 1178 tablet_bootstrap.cc:492] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:10.897598 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c5ff28367b42d3a3922d2b789bc7ec" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:10.897838 1050 raft_consensus.cc:2468] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:10.898185 851 leader_election.cc:304] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.898579 851 leader_election.cc:304] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:10.898757 1178 tablet_bootstrap.cc:654] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:10.898787 852 leader_election.cc:343] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.899490 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cb2c879e6451886c55907678792de" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.899793 914 raft_consensus.cc:2393] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc3bec007846459a9da0c7b8211e477b in current term 1: Already voted for candidate 8b7080d37ca245fe914d3dc90f17e3ba in this term.
I20260617 07:53:10.900388 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e1fd7f91f94221884be2166f0cc793" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:10.900592 914 raft_consensus.cc:3060] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.904040 914 raft_consensus.cc:2468] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:10.904752 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb95639e16ed423fbe60b15a1bcdf5a6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.904939 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddb9e82c354f26b3abe56ebdefd008" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:10.905156 918 raft_consensus.cc:2468] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:10.908442 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e43e1a3df54efe992a86dd0bd0c149" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.908924 1170 ts_tablet_manager.cc:1929] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:10.909405 1170 log.cc:1199] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/c7e43e1a3df54efe992a86dd0bd0c149
I20260617 07:53:10.910079 1170 ts_tablet_manager.cc:1950] T c7e43e1a3df54efe992a86dd0bd0c149 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:10.914644 1634 raft_consensus.cc:2804] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.914852 1634 raft_consensus.cc:697] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:10.915131 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 419) took 2683 ms. Trace:
I20260617 07:53:10.915230 1634 consensus_queue.cc:237] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.915586 1170 rpcz_store.cc:276] 0617 07:53:08.232162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.233662 (+ 1500us) service_pool.cc:224] Handling call
0617 07:53:10.849274 (+2615612us) ts_tablet_manager.cc:1151] Deleting tablet c7e43e1a3df54efe992a86dd0bd0c149
0617 07:53:10.849282 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.867748 (+ 18466us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.908845 (+ 41097us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:10.915075 (+ 6230us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2603222}
W20260617 07:53:10.917109 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 419) could send its response
I20260617 07:53:10.917650 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 427) took 2673 ms. Trace:
I20260617 07:53:10.918569 1170 rpcz_store.cc:276] 0617 07:53:08.244505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.244600 (+ 95us) service_pool.cc:224] Handling call
0617 07:53:10.917463 (+2672863us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:10.917486 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.917602 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2643455}
I20260617 07:53:10.919776 1633 raft_consensus.cc:2804] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.919915 1633 raft_consensus.cc:493] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260617 07:53:10.920017 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 427) could send its response
I20260617 07:53:10.920045 1633 raft_consensus.cc:3060] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:10.923548 986 consensus_peers.cc:597] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:10.923833 1172 tablet_bootstrap.cc:492] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:10.924039 1172 ts_tablet_manager.cc:1403] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.080s user 0.007s sys 0.003s
I20260617 07:53:10.924057 1633 raft_consensus.cc:515] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.924893 1633 leader_election.cc:290] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:10.925031 1172 raft_consensus.cc:359] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.925097 1633 consensus_queue.cc:1048] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:10.925431 1172 raft_consensus.cc:385] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.925561 1172 raft_consensus.cc:740] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.925907 1172 consensus_queue.cc:260] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.931032 1172 ts_tablet_manager.cc:1434] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:10.934937 1862 ts_tablet_manager.cc:1929] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:10.935127 1862 log.cc:1199] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d9968c8179c14d1b9bc9a2c2779fb86e
I20260617 07:53:10.935603 1862 ts_tablet_manager.cc:1950] T d9968c8179c14d1b9bc9a2c2779fb86e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:10.937318 1172 tablet_bootstrap.cc:492] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:10.939744 1172 tablet_bootstrap.cc:654] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.940646 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a547dabaeb742ba941690f4895955bd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.941030 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 428) took 2665 ms. Trace:
I20260617 07:53:10.941141 1170 rpcz_store.cc:276] 0617 07:53:08.275841 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.275939 (+ 98us) service_pool.cc:224] Handling call
0617 07:53:10.920859 (+2644920us) ts_tablet_manager.cc:1151] Deleting tablet 0fd8cedb539748dc917128511325bbcc
0617 07:53:10.920869 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.940970 (+ 20101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2642700}
W20260617 07:53:10.941423 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 428) could send its response
I20260617 07:53:10.942044 779 raft_consensus.cc:3060] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.942767 1178 tablet_bootstrap.cc:492] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.942904 1178 ts_tablet_manager.cc:1403] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.013s
I20260617 07:53:10.943699 1178 raft_consensus.cc:359] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.943859 1178 raft_consensus.cc:385] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.943938 1178 raft_consensus.cc:740] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.944207 1178 consensus_queue.cc:260] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.946451 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cb2c879e6451886c55907678792de" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.948544 1178 ts_tablet_manager.cc:1434] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:10.948858 1178 tablet_bootstrap.cc:492] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:10.949865 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 429) took 2669 ms. Trace:
I20260617 07:53:10.949992 1170 rpcz_store.cc:276] 0617 07:53:08.276316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.293549 (+ 17233us) service_pool.cc:224] Handling call
0617 07:53:10.941676 (+2648127us) ts_tablet_manager.cc:1151] Deleting tablet df37ed81b17d4178adeb6057491b4cc9
0617 07:53:10.941689 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.945575 (+ 3886us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2637641}
W20260617 07:53:10.950285 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 429) could send its response
I20260617 07:53:10.950749 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 452) took 2233 ms. Trace:
I20260617 07:53:10.950889 1170 rpcz_store.cc:276] 0617 07:53:08.716971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.717025 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:10.950585 (+2233560us) ts_tablet_manager.cc:1151] Deleting tablet 8a4f81daf583464e988521e189ca39b6
0617 07:53:10.950596 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.950697 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2233363}
W20260617 07:53:10.951195 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 452) could send its response
I20260617 07:53:10.951613 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 451) took 2236 ms. Trace:
I20260617 07:53:10.955437 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a547dabaeb742ba941690f4895955bd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.951743 1170 rpcz_store.cc:276] 0617 07:53:08.715104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.715206 (+ 102us) service_pool.cc:224] Handling call
0617 07:53:10.951441 (+2236235us) ts_tablet_manager.cc:1151] Deleting tablet 630e540a77374c11895ab5a0e394b3bb
0617 07:53:10.951451 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.951565 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2215622}
W20260617 07:53:10.956252 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 451) could send its response
I20260617 07:53:10.956666 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 453) took 2239 ms. Trace:
I20260617 07:53:10.956800 1170 rpcz_store.cc:276] 0617 07:53:08.717110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.717244 (+ 134us) service_pool.cc:224] Handling call
0617 07:53:10.956516 (+2239272us) ts_tablet_manager.cc:1151] Deleting tablet 2f8cd6ff8fa44536acdd84a107ab1525
0617 07:53:10.956526 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.956617 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2213516}
W20260617 07:53:10.958035 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 453) could send its response
I20260617 07:53:10.959563 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 450) took 2245 ms. Trace:
I20260617 07:53:10.959627 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c5ff28367b42d3a3922d2b789bc7ec" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:10.959851 1170 rpcz_store.cc:276] 0617 07:53:08.713589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:08.713729 (+ 140us) service_pool.cc:224] Handling call
0617 07:53:10.959389 (+2245660us) ts_tablet_manager.cc:1151] Deleting tablet 84f498f551ff4767bd16628b03f55ae2
0617 07:53:10.959399 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:10.959518 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2207232}
I20260617 07:53:10.960114 1178 tablet_bootstrap.cc:654] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:10.961490 987 connection.cc:466] server connection from 127.0.0.1:45978 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45978 (request call id 450) could send its response
I20260617 07:53:10.961838 1170 tablet_replica.cc:333] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:10.965893 1170 raft_consensus.cc:2243] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:10.966158 1170 raft_consensus.cc:2272] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:10.970504 1170 ts_tablet_manager.cc:1916] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:10.973326 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cb2c879e6451886c55907678792de" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.973748 988 leader_election.cc:304] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:10.973870 1178 tablet_bootstrap.cc:492] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:10.974040 1178 ts_tablet_manager.cc:1403] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.003s
I20260617 07:53:10.974123 1751 raft_consensus.cc:2749] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:10.974536 779 raft_consensus.cc:3060] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.974599 988 leader_election.cc:304] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.974841 1178 raft_consensus.cc:359] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.974982 1751 raft_consensus.cc:2804] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:10.975060 1178 raft_consensus.cc:385] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.975108 1751 raft_consensus.cc:697] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:10.975144 1178 raft_consensus.cc:740] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.975373 1751 consensus_queue.cc:237] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.975422 1178 consensus_queue.cc:260] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.976080 1178 ts_tablet_manager.cc:1434] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:10.976454 1178 tablet_bootstrap.cc:492] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:10.978772 988 leader_election.cc:343] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.978964 988 leader_election.cc:304] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:10.979045 1178 tablet_bootstrap.cc:654] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:10.979290 1857 raft_consensus.cc:2749] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:10.979722 988 leader_election.cc:304] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:10.979992 1857 raft_consensus.cc:2804] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:10.980084 1857 raft_consensus.cc:493] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:10.980152 1857 raft_consensus.cc:3060] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:10.980050 894 tablet_service.cc:1511] Processing CreateTablet for tablet 67cd66ea6ebc42bda00fbec82da73f16 (DEFAULT_TABLE table=default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:10.980619 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67cd66ea6ebc42bda00fbec82da73f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:10.982818 1857 raft_consensus.cc:515] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.983812 1857 leader_election.cc:290] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.986503 1857 raft_consensus.cc:493] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:10.986678 1857 raft_consensus.cc:515] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.987601 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89783bab2e584fe9a8eda963f78bf3ec" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:10.988320 986 leader_election.cc:343] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:10.988765 1857 leader_election.cc:290] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:10.991415 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet b7d9354c81df42fb9756045e659be26d (table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c]). Expected version 2 got 0
I20260617 07:53:10.991919 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d]). Expected version 2 got 0
I20260617 07:53:10.992208 1172 tablet_bootstrap.cc:492] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:10.992420 1172 ts_tablet_manager.cc:1403] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260617 07:53:10.992695 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_91f0347cdea645c393589810a50ca778 [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 1 got 0
I20260617 07:53:10.993366 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:10.993432 1172 raft_consensus.cc:359] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:10.993707 1172 raft_consensus.cc:385] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:10.993820 1172 raft_consensus.cc:740] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:10.994338 457 catalog_manager.cc:5696] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:10.994693 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddb9e82c354f26b3abe56ebdefd008" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:10.995520 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]). Expected version 3 got 0
W20260617 07:53:10.995771 986 leader_election.cc:343] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.000204 1857 raft_consensus.cc:493] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.000408 1857 raft_consensus.cc:515] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.001459 1857 leader_election.cc:290] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.001456 898 tablet_service.cc:1511] Processing CreateTablet for tablet 979087485af94e159d3d0f2cb873899e (DEFAULT_TABLE table=default.Table_ad19666d956d43a7979b4226f9645fef [id=7a23152402da4e608156935807a7b61b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.001974 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979087485af94e159d3d0f2cb873899e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.002115 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301bd4d6faec429ba71ce354c23d0f75" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:11.002662 986 leader_election.cc:343] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.002995 1172 consensus_queue.cc:260] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.006179 887 tablet_service.cc:1511] Processing CreateTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 (DEFAULT_TABLE table=default.Table_eea666288e104386986507e494503cad [id=a8f0e5c51bec410793bcf9283fd190e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.006659 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9657e0dd2a8459cb728bdfe8a68b840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.014086 1172 ts_tablet_manager.cc:1434] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260617 07:53:11.015239 882 tablet_service.cc:1511] Processing CreateTablet for tablet f4d8542262864a0ab9d763528502bcbb (DEFAULT_TABLE table=default.Table_1ecdf060db0649d28c31d222fe25dda1 [id=ba6bd5b57bfc49f6a91b95badafdcb03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.015688 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d8542262864a0ab9d763528502bcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.018751 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c5ff28367b42d3a3922d2b789bc7ec" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:11.020573 1172 tablet_bootstrap.cc:492] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.023501 1172 tablet_bootstrap.cc:654] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.029377 1862 tablet_replica.cc:333] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:11.029767 1862 raft_consensus.cc:2243] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.032598 1170 ts_tablet_manager.cc:1929] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:11.032765 1170 log.cc:1199] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d9968c8179c14d1b9bc9a2c2779fb86e
I20260617 07:53:11.033196 1170 ts_tablet_manager.cc:1950] T d9968c8179c14d1b9bc9a2c2779fb86e P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:11.037277 1862 raft_consensus.cc:2272] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.038184 1862 ts_tablet_manager.cc:1916] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.039192 1178 tablet_bootstrap.cc:492] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.039343 1178 ts_tablet_manager.cc:1403] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.012s
I20260617 07:53:11.040140 1178 raft_consensus.cc:359] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.040331 1178 raft_consensus.cc:385] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.040431 1178 raft_consensus.cc:740] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.040711 1178 consensus_queue.cc:260] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.042104 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cddb9e82c354f26b3abe56ebdefd008" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:11.042260 1178 ts_tablet_manager.cc:1434] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:11.042326 918 raft_consensus.cc:3060] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.043205 1178 tablet_bootstrap.cc:492] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:11.044610 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89783bab2e584fe9a8eda963f78bf3ec" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:11.045413 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301bd4d6faec429ba71ce354c23d0f75" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:11.046000 1178 tablet_bootstrap.cc:654] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.047513 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c5ff28367b42d3a3922d2b789bc7ec" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:11.047711 1050 raft_consensus.cc:3060] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.053934 1050 raft_consensus.cc:2468] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:11.054740 1172 tablet_bootstrap.cc:492] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.054909 1172 ts_tablet_manager.cc:1403] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.001s
I20260617 07:53:11.056089 1172 raft_consensus.cc:359] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.056313 1172 raft_consensus.cc:385] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.056404 1172 raft_consensus.cc:740] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.056669 1172 consensus_queue.cc:260] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.062268 1178 tablet_bootstrap.cc:492] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.062440 1172 ts_tablet_manager.cc:1434] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:11.062506 1178 ts_tablet_manager.cc:1403] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.005s
W20260617 07:53:11.045418 852 leader_election.cc:343] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.063423 1178 raft_consensus.cc:359] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.063685 1178 raft_consensus.cc:385] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.063793 1178 raft_consensus.cc:740] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.064098 1178 consensus_queue.cc:260] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.065605 1178 ts_tablet_manager.cc:1434] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:11.022362 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d9968c8179c14d1b9bc9a2c2779fb86e (table default.Table_1ecdf060db0649d28c31d222fe25dda1 [id=ba6bd5b57bfc49f6a91b95badafdcb03]) successfully deleted
I20260617 07:53:11.066651 1178 tablet_bootstrap.cc:492] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:11.066620 448 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 44285.5us
I20260617 07:53:11.067912 1172 tablet_bootstrap.cc:492] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.068074 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:11.068429 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:11.068706 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:11.069096 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]). Expected version 2 got 0
I20260617 07:53:11.069363 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:11.069433 1172 tablet_bootstrap.cc:654] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.069823 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 301bd4d6faec429ba71ce354c23d0f75 (table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012]). Expected version 2 got 0
I20260617 07:53:11.071116 1170 tablet_replica.cc:333] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.070576 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d9968c8179c14d1b9bc9a2c2779fb86e (table default.Table_1ecdf060db0649d28c31d222fe25dda1 [id=ba6bd5b57bfc49f6a91b95badafdcb03]) successfully deleted
I20260617 07:53:11.071332 1170 raft_consensus.cc:2243] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:11.071450 1178 tablet_bootstrap.cc:654] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.071584 1170 pending_rounds.cc:70] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
W20260617 07:53:11.071620 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3fcf87953dc14bf190ac74101547e52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcf87953dc14bf190ac74101547e52f already in progress: creating tablet
I20260617 07:53:11.071663 1170 pending_rounds.cc:77] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772711837642752 op_type: NO_OP noop_request { }
I20260617 07:53:11.071781 1170 raft_consensus.cc:2889] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:11.071885 1170 raft_consensus.cc:2272] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.072664 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:11.072980 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_073280306a2740119a28c4682671d83f [id=121feb8666fe4cb5b796fecf0bf1f8b0]). Expected version 1 got 0
I20260617 07:53:11.073308 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 2 got 0
I20260617 07:53:11.073625 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:11.074105 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:11.074361 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:11.075137 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 2 got 0
I20260617 07:53:11.075508 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:11.076136 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:11.076710 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:11.077108 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21]). Expected version 1 got 0
I20260617 07:53:11.077381 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 4d9ace137c4e496fafac4e729718577f (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:11.079303 1178 tablet_bootstrap.cc:492] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.079452 1178 ts_tablet_manager.cc:1403] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260617 07:53:11.080149 1170 ts_tablet_manager.cc:1916] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.080221 1178 raft_consensus.cc:359] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.080395 1178 raft_consensus.cc:385] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.080489 1178 raft_consensus.cc:740] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.080760 1178 consensus_queue.cc:260] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.086103 1178 ts_tablet_manager.cc:1434] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 07:53:11.090972 1178 tablet_bootstrap.cc:492] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:11.093024 1178 tablet_bootstrap.cc:654] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.100559 1171 tablet_bootstrap.cc:492] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:11.101625 887 tablet_service.cc:1511] Processing CreateTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 (DEFAULT_TABLE table=default.Table_e0a022b4ea4c4845bfea835c7373a969 [id=9ec5b57144a547818de080724a665c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.102041 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.103734 918 raft_consensus.cc:2468] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:11.111265 1170 ts_tablet_manager.cc:1929] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:11.111459 1170 log.cc:1199] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/28e1fd7f91f94221884be2166f0cc793
I20260617 07:53:11.111985 1170 ts_tablet_manager.cc:1950] T 28e1fd7f91f94221884be2166f0cc793 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:11.113550 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 28e1fd7f91f94221884be2166f0cc793 (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]) successfully deleted
I20260617 07:53:11.113826 1751 raft_consensus.cc:493] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.114024 1751 raft_consensus.cc:515] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.114856 1751 leader_election.cc:290] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.116065 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59acdc64fe9247d28c4c277161b42f4f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:11.116847 986 leader_election.cc:343] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.120816 1171 ts_tablet_manager.cc:1403] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.347s user 0.004s sys 0.009s
I20260617 07:53:11.121618 1171 raft_consensus.cc:359] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.121840 1171 raft_consensus.cc:385] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.121949 1171 raft_consensus.cc:740] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.122174 1171 consensus_queue.cc:260] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.122678 1171 ts_tablet_manager.cc:1434] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:11.123065 1171 tablet_bootstrap.cc:492] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:11.124568 1751 raft_consensus.cc:493] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.124815 1171 tablet_bootstrap.cc:654] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.124724 1751 raft_consensus.cc:515] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.125560 1751 leader_election.cc:290] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.126222 1862 ts_tablet_manager.cc:1929] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:11.126364 1862 log.cc:1199] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/cc84665c7849469aa27e6505dbed1516
I20260617 07:53:11.126426 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c70f5c41e04ad0b913c15aa315353f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:11.126729 1862 ts_tablet_manager.cc:1950] T cc84665c7849469aa27e6505dbed1516 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:11.127494 851 leader_election.cc:304] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:11.127468 986 leader_election.cc:343] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:11.127735 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 48048.9us
I20260617 07:53:11.127815 1876 raft_consensus.cc:2804] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:11.128031 1876 raft_consensus.cc:697] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
W20260617 07:53:11.128151 852 leader_election.cc:343] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.128427 1876 consensus_queue.cc:237] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.128541 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:11.128763 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:11.128933 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:11.129356 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:11.129509 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
W20260617 07:53:11.129781 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 64839.5us
I20260617 07:53:11.130331 1170 tablet_replica.cc:333] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.130648 1170 raft_consensus.cc:2243] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:11.130968 1170 pending_rounds.cc:70] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:11.130698 1657 consensus_queue.cc:1048] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.131074 1170 pending_rounds.cc:77] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772707232940032 op_type: NO_OP noop_request { }
I20260617 07:53:11.131201 1170 raft_consensus.cc:2889] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:11.131328 1170 raft_consensus.cc:2272] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:11.131589 852 leader_election.cc:343] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.132076 1170 ts_tablet_manager.cc:1916] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:11.131852 851 consensus_peers.cc:597] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab8388648475499db50cc16a7c36775a. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:11.132401 851 consensus_peers.cc:597] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7343400555f447b8a1721ba36d7766d. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:11.134210 851 consensus_peers.cc:597] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7392ca4ba6a140e19c57e962a26162af. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.136147 1657 consensus_queue.cc:1048] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:11.137473 851 consensus_peers.cc:597] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f030d59f4e124f64bb62d05f0bb0f560. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:11.136632 852 leader_election.cc:343] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:11.138350 852 leader_election.cc:343] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:11.141112 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 121339ab4842432e9fb7bc357750f8ad consensus state has no leader
I20260617 07:53:11.141336 458 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 27) took 1033 ms. Trace:
I20260617 07:53:11.141460 458 rpcz_store.cc:276] 0617 07:53:10.107790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.789744 (+681954us) service_pool.cc:224] Handling call
0617 07:53:10.790278 (+ 534us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:10.790526 (+ 248us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:10.790724 (+ 198us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:10.790797 (+ 73us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:10.852396 (+ 61599us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:11.141290 (+288894us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:10.791325 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:10.791430 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:10.791435 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:10.791437 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:10.791530 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:10.791541 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:10.791547 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:10.791616 (+ 69us) tablet.cc:701] Row locks acquired
0617 07:53:10.791618 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:10.791649 (+ 31us) write_op.cc:270] Start()
0617 07:53:10.791675 (+ 26us) write_op.cc:276] Timestamp: P: 1781682790791622 usec, L: 0
0617 07:53:10.791679 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:10.791833 (+ 154us) log.cc:844] Serialized 405 byte log entry
0617 07:53:10.851430 (+ 59597us) op_driver.cc:464] REPLICATION: finished
0617 07:53:10.851595 (+ 165us) write_op.cc:301] APPLY: starting
0617 07:53:10.851613 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:10.851655 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:10.851687 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:10.851745 (+ 58us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:10.851782 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:10.851789 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:10.851872 (+ 83us) log.cc:844] Serialized 23 byte log entry
0617 07:53:10.851947 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.851969 (+ 22us) write_op.cc:454] Released schema lock
0617 07:53:10.851978 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:10.852086 (+ 108us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.852090 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":99,"apply.run_cpu_time_us":480,"apply.run_wall_time_us":479,"num_ops":1,"prepare.queue_time_us":44,"prepare.run_cpu_time_us":601,"prepare.run_wall_time_us":602,"raft.queue_time_us":240,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":59713}]]}
I20260617 07:53:11.142797 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b3c6dc341bb4497186428c46a5d6c0d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:11.143316 1751 raft_consensus.cc:493] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:11.143555 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3c6dc341bb4497186428c46a5d6c0d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.143535 1751 raft_consensus.cc:515] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.144299 1751 leader_election.cc:290] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.145323 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b83fda0ce74779b4cca2ffd2a9b903" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:11.145520 1685 raft_consensus.cc:493] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.145649 1685 raft_consensus.cc:515] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:11.146140 986 leader_election.cc:343] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.146296 1685 leader_election.cc:290] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:11.146813 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet a2f21861cb6f481eae968edc733e6e6f
I20260617 07:53:11.147385 454 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 14) took 1041 ms. Trace:
I20260617 07:53:11.147459 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c7ced951c34afa8dff243d275bfb36" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:11.147745 1050 raft_consensus.cc:2393] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6438857e0a7741ceaadf84cb9dc979e7 in current term 1: Already voted for candidate 8b7080d37ca245fe914d3dc90f17e3ba in this term.
I20260617 07:53:11.147500 454 rpcz_store.cc:276] 0617 07:53:10.106294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.116800 (+ 10506us) service_pool.cc:224] Handling call
0617 07:53:10.117315 (+ 515us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:10.117464 (+ 149us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:10.117560 (+ 96us) catalog_manager.cc:2849] Locking tablets
0617 07:53:10.117692 (+ 132us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:10.401170 (+283478us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:10.401259 (+ 89us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:11.146737 (+745478us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:11.147344 (+ 607us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:10.352948 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:10.353050 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:10.353055 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:10.353057 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:10.396324 (+ 43267us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:10.396341 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:10.396348 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:10.396497 (+ 149us) tablet.cc:701] Row locks acquired
0617 07:53:10.396500 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:10.396546 (+ 46us) write_op.cc:270] Start()
0617 07:53:10.396584 (+ 38us) write_op.cc:276] Timestamp: P: 1781682790396501 usec, L: 0
0617 07:53:10.396588 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:10.396819 (+ 231us) log.cc:844] Serialized 762 byte log entry
0617 07:53:10.400339 (+ 3520us) op_driver.cc:464] REPLICATION: finished
0617 07:53:10.400548 (+ 209us) write_op.cc:301] APPLY: starting
0617 07:53:10.400563 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:10.400611 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:10.400663 (+ 52us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:10.400732 (+ 69us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:10.400768 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:10.400775 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:10.400846 (+ 71us) log.cc:844] Serialized 29 byte log entry
0617 07:53:10.401063 (+ 217us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.401084 (+ 21us) write_op.cc:454] Released schema lock
0617 07:53:10.401092 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:10.403250 (+ 2158us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.403256 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":155,"apply.run_cpu_time_us":470,"apply.run_wall_time_us":1652,"num_ops":2,"prepare.queue_time_us":234494,"prepare.run_cpu_time_us":957,"prepare.run_wall_time_us":50291,"raft.queue_time_us":772,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":513,"replication_time_us":3720}]]}
I20260617 07:53:11.148361 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ec014388c38a4b7ebbbb7c1bccde17c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.148841 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec014388c38a4b7ebbbb7c1bccde17c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.150491 741 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.152283 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:11.152587 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a2f21861cb6f481eae968edc733e6e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2f21861cb6f481eae968edc733e6e6f already in progress: creating tablet
I20260617 07:53:11.152999 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c7ced951c34afa8dff243d275bfb36" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:11.153240 1178 tablet_bootstrap.cc:492] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.153398 1178 ts_tablet_manager.cc:1403] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.067s user 0.015s sys 0.022s
I20260617 07:53:11.153601 716 leader_election.cc:304] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:11.154045 1685 raft_consensus.cc:3060] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.155679 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 4e3b5cb887da4d86bdc3d69f350fdb40
I20260617 07:53:11.154318 1178 raft_consensus.cc:359] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.156107 1178 raft_consensus.cc:385] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.156194 1178 raft_consensus.cc:740] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.156199 456 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 12) took 1050 ms. Trace:
I20260617 07:53:11.156746 1178 consensus_queue.cc:260] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.156304 456 rpcz_store.cc:276] 0617 07:53:10.106050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.112906 (+ 6856us) service_pool.cc:224] Handling call
0617 07:53:10.113588 (+ 682us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:10.113871 (+ 283us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:10.114007 (+ 136us) catalog_manager.cc:2849] Locking tablets
0617 07:53:10.114251 (+ 244us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:10.354863 (+240612us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:10.354988 (+ 125us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:11.155608 (+800620us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:11.156166 (+ 558us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:10.341481 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:10.341615 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:10.341620 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:10.341622 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:10.341770 (+ 148us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:10.341784 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:10.341789 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:10.341883 (+ 94us) tablet.cc:701] Row locks acquired
0617 07:53:10.341885 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:10.341925 (+ 40us) write_op.cc:270] Start()
0617 07:53:10.341956 (+ 31us) write_op.cc:276] Timestamp: P: 1781682790341885 usec, L: 0
0617 07:53:10.341959 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:10.348384 (+ 6425us) log.cc:844] Serialized 762 byte log entry
0617 07:53:10.349011 (+ 627us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f1441cd3f22 00007f14430b5305 00007f14430b3e29 00007f14430bc250 00007f14430bc05d 0000000000aa681c 00007f1435d0ff6f 00007f1435d1328b 00007f1435d13108 0000000000aa681c
0617 07:53:10.353840 (+ 4829us) op_driver.cc:464] REPLICATION: finished
0617 07:53:10.354021 (+ 181us) write_op.cc:301] APPLY: starting
0617 07:53:10.354036 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:10.354082 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:10.354084 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:10.354154 (+ 70us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:10.354188 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:10.354196 (+ 8us) write_op.cc:312] APPLY: finished
0617 07:53:10.354271 (+ 75us) log.cc:844] Serialized 29 byte log entry
0617 07:53:10.354332 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.354349 (+ 17us) write_op.cc:454] Released schema lock
0617 07:53:10.354354 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:10.354434 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.354438 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":131,"apply.run_cpu_time_us":404,"apply.run_wall_time_us":405,"num_ops":2,"prepare.queue_time_us":226245,"prepare.run_cpu_time_us":1125,"prepare.run_wall_time_us":7594,"raft.queue_time_us":725,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":2733,"replication_time_us":11854,"spinlock_wait_cycles":14219008}]]}
I20260617 07:53:11.157102 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a25f1398f97f4c2b99ec71d2ce42f295" } new_table_name: "default.Table_7be7b293324744f4b216a6aaf234a5b1" modify_external_catalogs: true
I20260617 07:53:11.157218 1685 raft_consensus.cc:2749] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:11.159720 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.160212 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.160432 1846 tablet_replica.cc:333] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:11.160631 1846 raft_consensus.cc:2243] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.160763 1846 raft_consensus.cc:2272] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:11.160853 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 956eefc9ac3147bb857a448563c6fb6f consensus state has no leader
I20260617 07:53:11.161016 461 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 18) took 1054 ms. Trace:
I20260617 07:53:11.161581 1846 ts_tablet_manager.cc:1916] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.161118 461 rpcz_store.cc:276] 0617 07:53:10.106849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.109213 (+ 2364us) service_pool.cc:224] Handling call
0617 07:53:10.110139 (+ 926us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:10.110693 (+ 554us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:10.174308 (+ 63615us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:10.174487 (+ 179us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:10.465436 (+290949us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:11.160980 (+695544us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:10.413953 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:10.452934 (+ 38981us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:10.452945 (+ 11us) write_op.cc:435] Acquired schema lock
0617 07:53:10.452949 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:10.453092 (+ 143us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:10.453107 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:10.453112 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:10.453192 (+ 80us) tablet.cc:701] Row locks acquired
0617 07:53:10.453194 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:10.453232 (+ 38us) write_op.cc:270] Start()
0617 07:53:10.453273 (+ 41us) write_op.cc:276] Timestamp: P: 1781682790453181 usec, L: 0
0617 07:53:10.453279 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:10.453507 (+ 228us) log.cc:844] Serialized 405 byte log entry
0617 07:53:10.463937 (+ 10430us) op_driver.cc:464] REPLICATION: finished
0617 07:53:10.464701 (+ 764us) write_op.cc:301] APPLY: starting
0617 07:53:10.464721 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:10.464767 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:10.464804 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:10.464859 (+ 55us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:10.464897 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:10.464905 (+ 8us) write_op.cc:312] APPLY: finished
0617 07:53:10.464993 (+ 88us) log.cc:844] Serialized 23 byte log entry
0617 07:53:10.465274 (+ 281us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.465297 (+ 23us) write_op.cc:454] Released schema lock
0617 07:53:10.465304 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:10.482355 (+ 17051us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.482363 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":588,"apply.run_cpu_time_us":502,"apply.run_wall_time_us":792,"num_ops":1,"prepare.queue_time_us":238923,"prepare.run_cpu_time_us":974,"prepare.run_wall_time_us":68365,"raft.queue_time_us":307,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":696,"replication_time_us":10619}]]}
I20260617 07:53:11.161953 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_704289c2a96943cb8eefe02205ef161a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.162461 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_704289c2a96943cb8eefe02205ef161a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.163872 458 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:33390 (request call id 28) took 1055 ms. Trace:
I20260617 07:53:11.163986 458 rpcz_store.cc:276] 0617 07:53:10.107866 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.142561 (+1034695us) service_pool.cc:224] Handling call
0617 07:53:11.143669 (+ 1108us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 07:53:11.145228 (+ 1559us) catalog_manager.cc:2172] Created new table and tablet info
0617 07:53:11.163655 (+ 18427us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 07:53:11.163749 (+ 94us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 07:53:11.163830 (+ 81us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.146647 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.146759 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.146765 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:11.146767 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:11.146870 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.146886 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.146890 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:11.146967 (+ 77us) tablet.cc:701] Row locks acquired
0617 07:53:11.146969 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:11.147002 (+ 33us) write_op.cc:270] Start()
0617 07:53:11.147034 (+ 32us) write_op.cc:276] Timestamp: P: 1781682791146940 usec, L: 0
0617 07:53:11.147038 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.147241 (+ 203us) log.cc:844] Serialized 433 byte log entry
0617 07:53:11.151048 (+ 3807us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.151184 (+ 136us) write_op.cc:301] APPLY: starting
0617 07:53:11.151198 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.151243 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.151265 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.151362 (+ 97us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.151396 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 07:53:11.151435 (+ 39us) write_op.cc:312] APPLY: finished
0617 07:53:11.151506 (+ 71us) log.cc:844] Serialized 29 byte log entry
0617 07:53:11.151564 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.151584 (+ 20us) write_op.cc:454] Released schema lock
0617 07:53:11.151590 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.151657 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.151664 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":464,"apply.run_wall_time_us":462,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":710,"prepare.run_wall_time_us":710,"raft.queue_time_us":1221,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":244,"replication_time_us":3984}]]}
I20260617 07:53:11.164630 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 98f7c3f6260c4db690de1a5081bb2493
I20260617 07:53:11.165123 455 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 13) took 1058 ms. Trace:
I20260617 07:53:11.165267 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c3ea195c67814080b1221735affcde43" } modify_external_catalogs: true
I20260617 07:53:11.165431 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c3ea195c67814080b1221735affcde43" } modify_external_catalogs: true
I20260617 07:53:11.165237 455 rpcz_store.cc:276] 0617 07:53:10.106174 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.115261 (+ 9087us) service_pool.cc:224] Handling call
0617 07:53:10.115748 (+ 487us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:10.115884 (+ 136us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:10.115969 (+ 85us) catalog_manager.cc:2849] Locking tablets
0617 07:53:10.116089 (+ 120us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:10.355031 (+238942us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:10.355087 (+ 56us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:11.164544 (+809457us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:11.165086 (+ 542us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:10.349104 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:10.349229 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:10.349234 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:10.349237 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:10.349356 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:10.349369 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:10.349387 (+ 18us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:10.349496 (+ 109us) tablet.cc:701] Row locks acquired
0617 07:53:10.349499 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:10.349535 (+ 36us) write_op.cc:270] Start()
0617 07:53:10.349569 (+ 34us) write_op.cc:276] Timestamp: P: 1781682790349496 usec, L: 0
0617 07:53:10.349572 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:10.352538 (+ 2966us) log.cc:844] Serialized 762 byte log entry
0617 07:53:10.353913 (+ 1375us) op_driver.cc:464] REPLICATION: finished
0617 07:53:10.354507 (+ 594us) write_op.cc:301] APPLY: starting
0617 07:53:10.354517 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:10.354546 (+ 29us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:10.354568 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:10.354614 (+ 46us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:10.354639 (+ 25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:10.354645 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:10.354692 (+ 47us) log.cc:844] Serialized 29 byte log entry
0617 07:53:10.354726 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.354740 (+ 14us) write_op.cc:454] Released schema lock
0617 07:53:10.354744 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":562,"apply.run_cpu_time_us":287,"apply.run_wall_time_us":287,"num_ops":2,"prepare.queue_time_us":232326,"prepare.run_cpu_time_us":710,"prepare.run_wall_time_us":3807,"replication_time_us":4323}]]}
I20260617 07:53:11.166651 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_187d6ce1f72947bead15cb026aa308cb" } modify_external_catalogs: true
I20260617 07:53:11.166818 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_187d6ce1f72947bead15cb026aa308cb" } modify_external_catalogs: true
I20260617 07:53:11.167200 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:11.167726 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1c7ced951c34afa8dff243d275bfb36 consensus state has no leader
I20260617 07:53:11.167927 453 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 15) took 1061 ms. Trace:
I20260617 07:53:11.168020 453 rpcz_store.cc:276] 0617 07:53:10.106436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.118476 (+ 12040us) service_pool.cc:224] Handling call
0617 07:53:10.118871 (+ 395us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:10.119123 (+ 252us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:10.165651 (+ 46528us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:10.169338 (+ 3687us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:10.419838 (+250500us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:11.167868 (+748030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:10.406988 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:10.407084 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:10.407091 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:10.407093 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:10.407176 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:10.407186 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:10.407193 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:10.407249 (+ 56us) tablet.cc:701] Row locks acquired
0617 07:53:10.407251 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:10.407281 (+ 30us) write_op.cc:270] Start()
0617 07:53:10.407306 (+ 25us) write_op.cc:276] Timestamp: P: 1781682790407237 usec, L: 0
0617 07:53:10.407316 (+ 10us) op_driver.cc:348] REPLICATION: starting
0617 07:53:10.407484 (+ 168us) log.cc:844] Serialized 405 byte log entry
0617 07:53:10.414627 (+ 7143us) op_driver.cc:464] REPLICATION: finished
0617 07:53:10.415239 (+ 612us) write_op.cc:301] APPLY: starting
0617 07:53:10.415248 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:10.415277 (+ 29us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:10.415316 (+ 39us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:10.415353 (+ 37us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:10.415391 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:10.415397 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:10.415448 (+ 51us) log.cc:844] Serialized 23 byte log entry
0617 07:53:10.415486 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.415499 (+ 13us) write_op.cc:454] Released schema lock
0617 07:53:10.415503 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":572,"apply.run_cpu_time_us":315,"apply.run_wall_time_us":315,"num_ops":1,"prepare.queue_time_us":236945,"prepare.run_cpu_time_us":622,"prepare.run_wall_time_us":6928,"raft.queue_time_us":48,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":7282}]]}
I20260617 07:53:11.168926 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 53108a2d6c8b4398a568c14df8e0a23e from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:11.171169 454 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:33390 (request call id 29) took 1063 ms. Trace:
I20260617 07:53:11.171312 454 rpcz_store.cc:276] 0617 07:53:10.107936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.148193 (+1040257us) service_pool.cc:224] Handling call
0617 07:53:11.148939 (+ 746us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 07:53:11.149392 (+ 453us) catalog_manager.cc:2172] Created new table and tablet info
0617 07:53:11.170882 (+ 21490us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 07:53:11.171001 (+ 119us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 07:53:11.171101 (+ 100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.153597 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.153702 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.153707 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:11.153747 (+ 40us) tablet.cc:662] Decoding operations
0617 07:53:11.153830 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.153841 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.153846 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:11.153948 (+ 102us) tablet.cc:701] Row locks acquired
0617 07:53:11.153951 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:11.153981 (+ 30us) write_op.cc:270] Start()
0617 07:53:11.154006 (+ 25us) write_op.cc:276] Timestamp: P: 1781682791153918 usec, L: 0
0617 07:53:11.154009 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.154142 (+ 133us) log.cc:844] Serialized 433 byte log entry
0617 07:53:11.160345 (+ 6203us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.160640 (+ 295us) write_op.cc:301] APPLY: starting
0617 07:53:11.160655 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.160699 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.160729 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.160850 (+ 121us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.160887 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 07:53:11.160894 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:11.160979 (+ 85us) log.cc:844] Serialized 29 byte log entry
0617 07:53:11.161045 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.161060 (+ 15us) write_op.cc:454] Released schema lock
0617 07:53:11.161065 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.161144 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.161148 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":227,"apply.run_cpu_time_us":496,"apply.run_wall_time_us":495,"num_ops":2,"prepare.queue_time_us":86,"prepare.run_cpu_time_us":641,"prepare.run_wall_time_us":641,"raft.queue_time_us":340,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":197,"replication_time_us":6310}]]}
I20260617 07:53:11.173266 1880 consensus_queue.cc:1048] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.172380 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2d4094e6462248ce8997e5c441d4211b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:11.173676 1876 consensus_queue.cc:1048] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:11.174090 852 leader_election.cc:343] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:11.174634 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 68b448c65e684f49bf142ce2b5084d33 consensus state has no leader
W20260617 07:53:11.174769 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d4094e6462248ce8997e5c441d4211b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.174799 460 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 24) took 1067 ms. Trace:
I20260617 07:53:11.174891 460 rpcz_store.cc:276] 0617 07:53:10.107537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.687388 (+579851us) service_pool.cc:224] Handling call
0617 07:53:10.687801 (+ 413us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:10.688036 (+ 235us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:10.688206 (+ 170us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:10.688324 (+ 118us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:10.754399 (+ 66075us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:11.174759 (+420360us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:10.690147 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:10.690290 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:10.690299 (+ 9us) write_op.cc:435] Acquired schema lock
0617 07:53:10.690303 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:10.690441 (+ 138us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:10.690456 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:10.690464 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:10.690547 (+ 83us) tablet.cc:701] Row locks acquired
0617 07:53:10.690551 (+ 4us) write_op.cc:260] PREPARE: finished
0617 07:53:10.690593 (+ 42us) write_op.cc:270] Start()
0617 07:53:10.690633 (+ 40us) write_op.cc:276] Timestamp: P: 1781682790690573 usec, L: 0
0617 07:53:10.690639 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:10.690856 (+ 217us) log.cc:844] Serialized 405 byte log entry
0617 07:53:10.746140 (+ 55284us) op_driver.cc:464] REPLICATION: finished
0617 07:53:10.750185 (+ 4045us) write_op.cc:301] APPLY: starting
0617 07:53:10.750196 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:10.750226 (+ 30us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:10.750247 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:10.750296 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:10.750322 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:10.750328 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:10.750391 (+ 63us) log.cc:844] Serialized 23 byte log entry
0617 07:53:10.750431 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.750442 (+ 11us) write_op.cc:454] Released schema lock
0617 07:53:10.750447 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:10.750509 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.750513 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":4007,"apply.run_cpu_time_us":316,"apply.run_wall_time_us":316,"num_ops":1,"prepare.queue_time_us":1209,"prepare.run_cpu_time_us":824,"prepare.run_wall_time_us":824,"raft.queue_time_us":1438,"raft.run_cpu_time_us":9,"raft.run_wall_time_us":10,"replication_time_us":55479}]]}
I20260617 07:53:11.175669 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0276ca256ddc491e93325794b1ff6d2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.176205 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0276ca256ddc491e93325794b1ff6d2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:11.177052 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b8ffe940130474ca09d3680e470918a consensus state has no leader
I20260617 07:53:11.177184 456 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 30) took 1069 ms. Trace:
I20260617 07:53:11.177274 456 rpcz_store.cc:276] 0617 07:53:10.108021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.156954 (+1048933us) service_pool.cc:224] Handling call
0617 07:53:11.157265 (+ 311us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:11.157491 (+ 226us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:11.157691 (+ 200us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:11.157810 (+ 119us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:11.176865 (+ 19055us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:11.177150 (+ 285us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.159814 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.159921 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.159926 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:11.159929 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:11.160015 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.160024 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.160028 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:11.160081 (+ 53us) tablet.cc:701] Row locks acquired
0617 07:53:11.160083 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:11.160104 (+ 21us) write_op.cc:270] Start()
0617 07:53:11.160129 (+ 25us) write_op.cc:276] Timestamp: P: 1781682791160044 usec, L: 0
0617 07:53:11.160134 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.160274 (+ 140us) log.cc:844] Serialized 405 byte log entry
0617 07:53:11.175177 (+ 14903us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.175382 (+ 205us) write_op.cc:301] APPLY: starting
0617 07:53:11.175401 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.175453 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.175509 (+ 56us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.175572 (+ 63us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.175617 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:11.175628 (+ 11us) write_op.cc:312] APPLY: finished
0617 07:53:11.175718 (+ 90us) log.cc:844] Serialized 23 byte log entry
0617 07:53:11.175786 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.175806 (+ 20us) write_op.cc:454] Released schema lock
0617 07:53:11.175814 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.175895 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.175901 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":148,"apply.run_cpu_time_us":500,"apply.run_wall_time_us":500,"num_ops":1,"prepare.queue_time_us":1580,"prepare.run_cpu_time_us":541,"prepare.run_wall_time_us":542,"raft.queue_time_us":132,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":15005}]]}
I20260617 07:53:11.178246 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_66b270e872d540d693beb8d8493416ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.178719 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66b270e872d540d693beb8d8493416ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.183521 1171 tablet_bootstrap.cc:492] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:11.183713 1171 ts_tablet_manager.cc:1403] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.061s user 0.006s sys 0.000s
I20260617 07:53:11.185613 1846 ts_tablet_manager.cc:1929] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:11.185833 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.185959 1780 consensus_queue.cc:1048] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:11.186631 852 leader_election.cc:343] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:11.187018 852 consensus_peers.cc:597] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.189400 1846 log.cc:1199] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/4e3b5cb887da4d86bdc3d69f350fdb40
I20260617 07:53:11.189831 1846 ts_tablet_manager.cc:1950] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:11.190205 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3fcf87953dc14bf190ac74101547e52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcf87953dc14bf190ac74101547e52f already in progress: creating tablet
W20260617 07:53:11.190685 988 leader_election.cc:343] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.190832 988 leader_election.cc:304] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:11.191246 988 leader_election.cc:343] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.191347 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 9436fb7fca094eaab925748e254b1a62
I20260617 07:53:11.191380 988 leader_election.cc:304] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:11.191882 455 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 33) took 1083 ms. Trace:
I20260617 07:53:11.192057 1857 raft_consensus.cc:2749] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:11.192237 1857 raft_consensus.cc:2749] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:11.192018 455 rpcz_store.cc:276] 0617 07:53:10.108272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.166517 (+1058245us) service_pool.cc:224] Handling call
0617 07:53:11.166923 (+ 406us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:11.167066 (+ 143us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:11.167119 (+ 53us) catalog_manager.cc:2849] Locking tablets
0617 07:53:11.167270 (+ 151us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:11.191162 (+ 23892us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:11.191245 (+ 83us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:11.191300 (+ 55us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:11.191827 (+ 527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.167984 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.168097 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.168101 (+ 4us) write_op.cc:435] Acquired schema lock
0617 07:53:11.168104 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:11.168194 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.168201 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.168206 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:11.168286 (+ 80us) tablet.cc:701] Row locks acquired
0617 07:53:11.168288 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:11.168316 (+ 28us) write_op.cc:270] Start()
0617 07:53:11.168344 (+ 28us) write_op.cc:276] Timestamp: P: 1781682791168041 usec, L: 0
0617 07:53:11.168348 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.168484 (+ 136us) log.cc:844] Serialized 762 byte log entry
0617 07:53:11.189142 (+ 20658us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.189782 (+ 640us) write_op.cc:301] APPLY: starting
0617 07:53:11.189792 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.189823 (+ 31us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.189850 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.189916 (+ 66us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.189945 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:11.189952 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:11.190007 (+ 55us) log.cc:844] Serialized 29 byte log entry
0617 07:53:11.190049 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.190062 (+ 13us) write_op.cc:454] Released schema lock
0617 07:53:11.190066 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.190125 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.190128 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":602,"apply.run_cpu_time_us":339,"apply.run_wall_time_us":340,"num_ops":2,"prepare.queue_time_us":88,"prepare.run_cpu_time_us":586,"prepare.run_wall_time_us":586,"raft.queue_time_us":912,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":9,"replication_time_us":20777}]]}
I20260617 07:53:11.192735 455 master_service.cc:960] ReplaceTablet: received request to replace tablet e55d63a25a2845dbbcce20e560361007 from {username='slave'} at 127.0.0.1:33390
W20260617 07:53:11.193008 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 956eefc9ac3147bb857a448563c6fb6f consensus state has no leader
I20260617 07:53:11.193739 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 4e3b5cb887da4d86bdc3d69f350fdb40 (table default.Table_76ba66e135e34c4cab87ecfb9db4d2f5 [id=408ae87558644eb799bec6ab8d1ad2c1]) successfully deleted
I20260617 07:53:11.194041 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.194435 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.195716 461 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:33390 (request call id 31) took 1087 ms. Trace:
I20260617 07:53:11.195856 461 rpcz_store.cc:276] 0617 07:53:10.108091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.161778 (+1053687us) service_pool.cc:224] Handling call
0617 07:53:11.162550 (+ 772us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 07:53:11.163023 (+ 473us) catalog_manager.cc:2172] Created new table and tablet info
0617 07:53:11.195421 (+ 32398us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 07:53:11.195554 (+ 133us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 07:53:11.195666 (+ 112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.163825 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.163947 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.163954 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:11.163957 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:11.164043 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.164051 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.164056 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:11.164119 (+ 63us) tablet.cc:701] Row locks acquired
0617 07:53:11.164122 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:11.164151 (+ 29us) write_op.cc:270] Start()
0617 07:53:11.164175 (+ 24us) write_op.cc:276] Timestamp: P: 1781682791164088 usec, L: 0
0617 07:53:11.164179 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.164336 (+ 157us) log.cc:844] Serialized 433 byte log entry
0617 07:53:11.189073 (+ 24737us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.189269 (+ 196us) write_op.cc:301] APPLY: starting
0617 07:53:11.189281 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.189319 (+ 38us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.189341 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.189449 (+ 108us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.189481 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 07:53:11.189487 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:11.189551 (+ 64us) log.cc:844] Serialized 29 byte log entry
0617 07:53:11.189606 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.189620 (+ 14us) write_op.cc:454] Released schema lock
0617 07:53:11.189626 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.189688 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.189692 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":153,"apply.run_cpu_time_us":411,"apply.run_wall_time_us":411,"num_ops":2,"prepare.queue_time_us":366,"prepare.run_cpu_time_us":597,"prepare.run_wall_time_us":597,"raft.queue_time_us":1368,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":24847}]]}
I20260617 07:53:11.196918 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_91e4899e1bee4435b0ada003489fc9dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.197588 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91e4899e1bee4435b0ada003489fc9dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.199179 1170 ts_tablet_manager.cc:1929] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:11.199314 1170 log.cc:1199] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/82cf9c672f3b4567b63e878a6ab11334
I20260617 07:53:11.199766 1170 ts_tablet_manager.cc:1950] T 82cf9c672f3b4567b63e878a6ab11334 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:11.199995 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 4e3b5cb887da4d86bdc3d69f350fdb40 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:11.200795 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 82cf9c672f3b4567b63e878a6ab11334 (table default.Table_109a002e502a44d99c0e775b394e5c38 [id=6f5f5cfa42c54ca3964df6f9e25f18ae]) successfully deleted
I20260617 07:53:11.201470 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c35a3ed8e6204960bfd8de4797c65873"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.202008 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c35a3ed8e6204960bfd8de4797c65873 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.203048 1170 tablet_replica.cc:333] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.203315 1170 raft_consensus.cc:2243] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:11.203577 1170 pending_rounds.cc:70] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:11.203660 1170 pending_rounds.cc:77] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772709995397120 op_type: NO_OP noop_request { }
I20260617 07:53:11.203778 1170 raft_consensus.cc:2889] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:11.203915 1170 raft_consensus.cc:2272] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.206543 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_7074bb8dadc643a6bdbd6cc8f86f4032"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.207157 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7074bb8dadc643a6bdbd6cc8f86f4032 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.207721 1170 ts_tablet_manager.cc:1916] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:11.212183 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
I20260617 07:53:11.212496 1171 raft_consensus.cc:359] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.212718 1171 raft_consensus.cc:385] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 07:53:11.212817 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
I20260617 07:53:11.212826 1171 raft_consensus.cc:740] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.213056 1171 consensus_queue.cc:260] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.213522 1178 ts_tablet_manager.cc:1434] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20260617 07:53:11.218477 1171 ts_tablet_manager.cc:1434] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260617 07:53:11.218590 1178 tablet_bootstrap.cc:492] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:11.218829 1171 tablet_bootstrap.cc:492] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:11.220608 1178 tablet_bootstrap.cc:654] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.225067 1876 consensus_queue.cc:1048] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.232831 1898 raft_consensus.cc:493] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.232999 1898 raft_consensus.cc:515] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.233665 1898 leader_election.cc:290] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:11.238922 713 consensus_peers.cc:597] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5203534569bd4da18bc06751f094735f. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:11.239014 988 consensus_peers.cc:597] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.239482 1172 tablet_bootstrap.cc:492] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
W20260617 07:53:11.234249 851 consensus_peers.cc:597] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7309d2b22c849ce980fd263a29ac77f. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.239666 1172 ts_tablet_manager.cc:1403] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.172s user 0.004s sys 0.023s
I20260617 07:53:11.240477 1171 tablet_bootstrap.cc:654] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.240592 1172 raft_consensus.cc:359] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.240796 1172 raft_consensus.cc:385] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.240908 1172 raft_consensus.cc:740] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.241186 1172 consensus_queue.cc:260] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.242862 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5bbdbcf3044128a4cb274f83d5d29b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:11.243103 1047 raft_consensus.cc:2468] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:11.245548 988 leader_election.cc:304] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:11.247692 1170 ts_tablet_manager.cc:1929] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:11.247817 1170 log.cc:1199] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/df705c2300064db680bec1fefab08d2f
I20260617 07:53:11.248274 1170 ts_tablet_manager.cc:1950] T df705c2300064db680bec1fefab08d2f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:11.252354 1751 raft_consensus.cc:2804] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:11.252499 1751 raft_consensus.cc:697] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:11.252765 1751 consensus_queue.cc:237] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.265285 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e85510ab21154a9d9c9461d1a0491a56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.266095 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e85510ab21154a9d9c9461d1a0491a56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.270855 1172 ts_tablet_manager.cc:1434] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20260617 07:53:11.271224 1172 tablet_bootstrap.cc:492] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.272051 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 4d9ace137c4e496fafac4e729718577f from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:11.274168 1172 tablet_bootstrap.cc:654] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.275085 1876 consensus_queue.cc:1048] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.276981 1178 tablet_bootstrap.cc:492] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.277128 1178 ts_tablet_manager.cc:1403] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.005s
I20260617 07:53:11.278127 1178 raft_consensus.cc:359] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.278322 1178 raft_consensus.cc:385] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.278421 1178 raft_consensus.cc:740] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.278628 1178 consensus_queue.cc:260] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.278995 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet df705c2300064db680bec1fefab08d2f (table default.Table_5d59656f1cf74e4dbea879fb08583021 [id=e6636bb52b0b42028b8a92ebeee0a41d]) successfully deleted
I20260617 07:53:11.282102 1178 ts_tablet_manager.cc:1434] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:11.282400 1170 tablet_replica.cc:333] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.282713 1170 raft_consensus.cc:2243] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:11.282924 851 leader_election.cc:304] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:11.283043 1178 tablet_bootstrap.cc:492] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:11.284632 1170 pending_rounds.cc:70] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 2 pending ops.
I20260617 07:53:11.286027 1876 raft_consensus.cc:2804] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:11.286201 1876 raft_consensus.cc:493] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:11.286356 1876 raft_consensus.cc:3060] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.289016 1876 raft_consensus.cc:515] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.289767 1876 leader_election.cc:290] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:11.291108 1170 pending_rounds.cc:77] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7297772709679194112 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "cc84665c7849469aa27e6505dbed1516" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_64457de2b58244afa9932a32a979774d" dest_uuid: "dc3bec007846459a9da0c7b8211e477b" new_extra_config { } }
W20260617 07:53:11.291385 1170 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34090: Aborted: Op aborted
W20260617 07:53:11.291949 445 catalog_manager.cc:5106] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): alter failed for tablet cc84665c7849469aa27e6505dbed1516 (table default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]): Aborted: Op aborted
I20260617 07:53:11.292375 1170 pending_rounds.cc:77] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772707724804096 op_type: NO_OP noop_request { }
I20260617 07:53:11.292559 1170 raft_consensus.cc:2889] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:11.292734 1170 raft_consensus.cc:2272] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.293597 1170 ts_tablet_manager.cc:1916] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.300966 1171 tablet_bootstrap.cc:492] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:11.301330 1171 ts_tablet_manager.cc:1403] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.005s
I20260617 07:53:11.302176 1171 raft_consensus.cc:359] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.302341 1178 tablet_bootstrap.cc:654] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.302399 1171 raft_consensus.cc:385] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.302486 1171 raft_consensus.cc:740] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.302572 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 53108a2d6c8b4398a568c14df8e0a23e
I20260617 07:53:11.303167 458 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 32) took 1194 ms. Trace:
I20260617 07:53:11.303488 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.303287 458 rpcz_store.cc:276] 0617 07:53:10.108182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.165085 (+1056903us) service_pool.cc:224] Handling call
0617 07:53:11.165923 (+ 838us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:11.166065 (+ 142us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:11.166116 (+ 51us) catalog_manager.cc:2849] Locking tablets
0617 07:53:11.268258 (+102142us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:11.302380 (+ 34122us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:11.302473 (+ 93us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:11.302522 (+ 49us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:11.303112 (+ 590us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.291756 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.291944 (+ 188us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.291951 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:11.291955 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:11.292128 (+ 173us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.292145 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.292153 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:11.292299 (+ 146us) tablet.cc:701] Row locks acquired
0617 07:53:11.292303 (+ 4us) write_op.cc:260] PREPARE: finished
0617 07:53:11.292345 (+ 42us) write_op.cc:270] Start()
0617 07:53:11.292382 (+ 37us) write_op.cc:276] Timestamp: P: 1781682791292054 usec, L: 0
0617 07:53:11.292388 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.292618 (+ 230us) log.cc:844] Serialized 731 byte log entry
0617 07:53:11.301555 (+ 8937us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.301900 (+ 345us) write_op.cc:301] APPLY: starting
0617 07:53:11.301914 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.301951 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.301975 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.302035 (+ 60us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.302064 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:11.302071 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:11.302131 (+ 60us) log.cc:844] Serialized 29 byte log entry
0617 07:53:11.302191 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.302209 (+ 18us) write_op.cc:454] Released schema lock
0617 07:53:11.302215 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.302281 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.302285 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":288,"apply.run_cpu_time_us":384,"apply.run_wall_time_us":383,"num_ops":2,"prepare.queue_time_us":22743,"prepare.run_cpu_time_us":986,"prepare.run_wall_time_us":1482,"raft.queue_time_us":53,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":9133}]]}
I20260617 07:53:11.304680 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.305424 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet e55d63a25a2845dbbcce20e560361007
I20260617 07:53:11.305938 455 catalog_manager.cc:6784] ReplaceTablet: tablet e55d63a25a2845dbbcce20e560361007 deleted and replaced by tablet adbbe7eb5181431290f57ed9128181a3
I20260617 07:53:11.310276 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.311450 741 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:11.312290 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 53108a2d6c8b4398a568c14df8e0a23e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53108a2d6c8b4398a568c14df8e0a23e already in progress: creating tablet
W20260617 07:53:11.312806 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e55d63a25a2845dbbcce20e560361007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55d63a25a2845dbbcce20e560361007 already in progress: creating tablet
I20260617 07:53:11.314505 1172 tablet_bootstrap.cc:492] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.314674 1172 ts_tablet_manager.cc:1403] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260617 07:53:11.316298 1172 raft_consensus.cc:359] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.316495 1172 raft_consensus.cc:385] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.316606 1172 raft_consensus.cc:740] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.316869 1172 consensus_queue.cc:260] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.312129 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet cc84665c7849469aa27e6505dbed1516 (table default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]) successfully deleted
I20260617 07:53:11.319057 1172 ts_tablet_manager.cc:1434] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260617 07:53:11.320014 1172 tablet_bootstrap.cc:492] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.321583 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 5a547dabaeb742ba941690f4895955bd from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:11.322118 1172 tablet_bootstrap.cc:654] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.329829 1170 ts_tablet_manager.cc:1929] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:11.329972 1170 log.cc:1199] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/cc84665c7849469aa27e6505dbed1516
I20260617 07:53:11.330483 1170 ts_tablet_manager.cc:1950] T cc84665c7849469aa27e6505dbed1516 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:11.331691 445 catalog_manager.cc:5100] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): alter failed for tablet cc84665c7849469aa27e6505dbed1516 (table default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]),no further retry: Not found: Tablet not found: cc84665c7849469aa27e6505dbed1516
I20260617 07:53:11.334095 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet cc84665c7849469aa27e6505dbed1516 (table default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]) successfully deleted
I20260617 07:53:11.334357 1178 tablet_bootstrap.cc:492] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.334570 1178 ts_tablet_manager.cc:1403] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.004s
W20260617 07:53:11.335004 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a2f21861cb6f481eae968edc733e6e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2f21861cb6f481eae968edc733e6e6f already in progress: creating tablet
I20260617 07:53:11.335480 1170 tablet_replica.cc:333] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.335546 1178 raft_consensus.cc:359] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.335732 1170 raft_consensus.cc:2243] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.335902 1170 pending_rounds.cc:70] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:11.336027 1170 pending_rounds.cc:77] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772707514097664 op_type: NO_OP noop_request { }
I20260617 07:53:11.336136 1170 raft_consensus.cc:2889] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:11.336282 1170 raft_consensus.cc:2272] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.336293 1178 raft_consensus.cc:385] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.336354 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5bbdbcf3044128a4cb274f83d5d29b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:11.336463 1178 raft_consensus.cc:740] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.336555 1047 raft_consensus.cc:3060] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.336866 1178 consensus_queue.cc:260] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.337201 1172 tablet_bootstrap.cc:492] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.337368 1172 ts_tablet_manager.cc:1403] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260617 07:53:11.338933 1172 raft_consensus.cc:359] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.339135 1172 raft_consensus.cc:385] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.339213 1172 raft_consensus.cc:740] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.339507 1172 consensus_queue.cc:260] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.339596 1047 raft_consensus.cc:2468] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:11.340215 1172 ts_tablet_manager.cc:1434] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:11.340548 1172 tablet_bootstrap.cc:492] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.340489 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 70610822c57e45c7add7e1f5ce96d889 (DEFAULT_TABLE table=default.Table_c5f15ddabb8041ac80b9ac925dd9cacd [id=4745ecbb860c4e8288a23acc58b93799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.340859 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70610822c57e45c7add7e1f5ce96d889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.342413 1172 tablet_bootstrap.cc:654] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.342908 1171 consensus_queue.cc:260] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.343602 1171 ts_tablet_manager.cc:1434] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260617 07:53:11.346262 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1ecdf060db0649d28c31d222fe25dda1" } new_table_name: "default.Table_022308372ad4427797e380190f5323b8" modify_external_catalogs: true
I20260617 07:53:11.346464 1170 ts_tablet_manager.cc:1916] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.346874 887 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.348459 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.348675 1862 tablet_replica.cc:333] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:11.349064 741 tablet_service.cc:1511] Processing CreateTablet for tablet 70610822c57e45c7add7e1f5ce96d889 (DEFAULT_TABLE table=default.Table_c5f15ddabb8041ac80b9ac925dd9cacd [id=4745ecbb860c4e8288a23acc58b93799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.349248 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.350008 826 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:11.351109 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.351292 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 744736166fa2405082ea3a87ef6b1790 (DEFAULT_TABLE table=default.Table_2d516117840d45a0b36733f1f4cc08d5 [id=31f7f8c45788400eb64081bce24d763f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.351486 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.351670 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744736166fa2405082ea3a87ef6b1790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.351912 887 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.352638 749 tablet_service.cc:1511] Processing CreateTablet for tablet 744736166fa2405082ea3a87ef6b1790 (DEFAULT_TABLE table=default.Table_2d516117840d45a0b36733f1f4cc08d5 [id=31f7f8c45788400eb64081bce24d763f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.352437 887 tablet_service.cc:1511] Processing CreateTablet for tablet 70610822c57e45c7add7e1f5ce96d889 (DEFAULT_TABLE table=default.Table_c5f15ddabb8041ac80b9ac925dd9cacd [id=4745ecbb860c4e8288a23acc58b93799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.353401 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70610822c57e45c7add7e1f5ce96d889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.353470 964 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:11.354107 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_69167a2936fa47a08d1f53dfec14f52b" } modify_external_catalogs: true
I20260617 07:53:11.354560 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_69167a2936fa47a08d1f53dfec14f52b" } modify_external_catalogs: true
W20260617 07:53:11.358078 851 consensus_peers.cc:597] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.358289 851 leader_election.cc:304] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:11.358682 1657 raft_consensus.cc:2804] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:11.359050 1657 raft_consensus.cc:697] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:11.359318 1657 consensus_queue.cc:237] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.360353 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c5f15ddabb8041ac80b9ac925dd9cacd" } modify_external_catalogs: true
I20260617 07:53:11.360575 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c5f15ddabb8041ac80b9ac925dd9cacd" } modify_external_catalogs: true
I20260617 07:53:11.362275 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59acdc64fe9247d28c4c277161b42f4f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:11.362954 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c70f5c41e04ad0b913c15aa315353f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:11.364323 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b83fda0ce74779b4cca2ffd2a9b903" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:11.364980 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5939ce898cc14175961237f56bde80ba" } new_table_name: "default.Table_9c908cf10c5b4e60bf295dc81294ca83" modify_external_catalogs: true
I20260617 07:53:11.366055 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c2ab276e39134bfb97bec45ec6d13aea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.366600 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2ab276e39134bfb97bec45ec6d13aea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.368278 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5bbdbcf3044128a4cb274f83d5d29b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:11.368537 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_fe582a04705248b1bb25e1cc9bc1e653" } modify_external_catalogs: true
I20260617 07:53:11.368773 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_fe582a04705248b1bb25e1cc9bc1e653" } modify_external_catalogs: true
I20260617 07:53:11.369626 753 tablet_service.cc:1511] Processing CreateTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b (DEFAULT_TABLE table=default.Table_912b307c6f95423883dad501646529f4 [id=c0ca0b05fe444d6baeaca00158a9a72b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.369911 1862 raft_consensus.cc:2243] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:11.370548 1862 raft_consensus.cc:2272] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.371475 1171 tablet_bootstrap.cc:492] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:11.372098 771 raft_consensus.cc:3060] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.374550 1862 ts_tablet_manager.cc:1916] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.375180 1172 tablet_bootstrap.cc:492] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.375339 1172 ts_tablet_manager.cc:1403] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.003s
I20260617 07:53:11.376863 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70610822c57e45c7add7e1f5ce96d889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.378199 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5bbdbcf3044128a4cb274f83d5d29b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:11.380596 772 raft_consensus.cc:3060] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.380735 1862 ts_tablet_manager.cc:1929] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:11.380865 1862 log.cc:1199] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/4e3b5cb887da4d86bdc3d69f350fdb40
I20260617 07:53:11.381247 1862 ts_tablet_manager.cc:1950] T 4e3b5cb887da4d86bdc3d69f350fdb40 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:11.382906 1019 tablet_service.cc:1511] Processing CreateTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b (DEFAULT_TABLE table=default.Table_912b307c6f95423883dad501646529f4 [id=c0ca0b05fe444d6baeaca00158a9a72b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:11.383487 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a2f21861cb6f481eae968edc733e6e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2f21861cb6f481eae968edc733e6e6f already in progress: creating tablet
W20260617 07:53:11.384071 988 leader_election.cc:343] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.384224 988 leader_election.cc:304] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:11.384487 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744736166fa2405082ea3a87ef6b1790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.384809 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7cb453c7b647f298a6ebe20fd0e45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.385859 775 raft_consensus.cc:3060] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.386538 1751 raft_consensus.cc:2749] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:11.388365 988 leader_election.cc:343] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.388515 988 leader_election.cc:304] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:11.388885 1751 raft_consensus.cc:2749] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:11.390237 741 tablet_service.cc:1511] Processing CreateTablet for tablet 306742b9da81497991d58947bf3c1ebb (DEFAULT_TABLE table=default.Table_dd16c59e32e542048095a371aaddb95b [id=c12a3c4eaa2342e089d4b405c4d7c304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.390841 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306742b9da81497991d58947bf3c1ebb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:11.390879 988 leader_election.cc:343] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.391047 988 leader_election.cc:304] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:11.391424 1751 raft_consensus.cc:2749] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:11.394232 1172 raft_consensus.cc:359] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.394500 1172 raft_consensus.cc:385] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.395107 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 306742b9da81497991d58947bf3c1ebb (DEFAULT_TABLE table=default.Table_dd16c59e32e542048095a371aaddb95b [id=c12a3c4eaa2342e089d4b405c4d7c304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.396018 1172 raft_consensus.cc:740] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.395943 1782 consensus_queue.cc:1048] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.396281 1172 consensus_queue.cc:260] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.396363 1782 consensus_queue.cc:1048] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.399729 1171 tablet_bootstrap.cc:654] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.400581 1782 consensus_queue.cc:1048] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.404920 1172 ts_tablet_manager.cc:1434] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.021s user 0.001s sys 0.002s
I20260617 07:53:11.405048 1170 ts_tablet_manager.cc:1929] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:11.405151 1170 log.cc:1199] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/4e3b5cb887da4d86bdc3d69f350fdb40
I20260617 07:53:11.405593 1170 ts_tablet_manager.cc:1950] T 4e3b5cb887da4d86bdc3d69f350fdb40 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:11.407536 1098 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:11.409612 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef4f711d1534713b3ebd0862db382a3 (DEFAULT_TABLE table=default.Table_37fb232762ab44cdb03ff6b8cb54866f [id=bf0311e54f774b8587d35475393dfa69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.413578 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 4d9ace137c4e496fafac4e729718577f
I20260617 07:53:11.413635 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 07431acc9208489aaea2f8c4205e46a5 (DEFAULT_TABLE table=default.Table_41ef34e21782488da51b458e095e7bcc [id=05666e345323450596af21c68fa06dad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.414106 456 catalog_manager.cc:6784] ReplaceTablet: tablet 4d9ace137c4e496fafac4e729718577f deleted and replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20
W20260617 07:53:11.414183 852 consensus_peers.cc:597] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7392ca4ba6a140e19c57e962a26162af. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.414650 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:11.415632 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 4681e8e3f1174b299d89ec541ca8e6b3 consensus state has no leader
I20260617 07:53:11.418967 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 70610822c57e45c7add7e1f5ce96d889
W20260617 07:53:11.419862 852 consensus_peers.cc:597] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:11.422214 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a900aecf46e4430cb7ccdecd54376193 consensus state has no leader
W20260617 07:53:11.422369 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 56c70f5c41e04ad0b913c15aa315353f consensus state has no leader
W20260617 07:53:11.423053 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4d8542262864a0ab9d763528502bcbb consensus state has no leader
I20260617 07:53:11.423791 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 51e757e6f4ce4c6eb8223c4b6955245e
W20260617 07:53:11.424889 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 301bd4d6faec429ba71ce354c23d0f75 (table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 301bd4d6faec429ba71ce354c23d0f75 consensus state has no leader
I20260617 07:53:11.426229 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.426710 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa (DEFAULT_TABLE table=default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.427235 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9a4021cad24b99b391e99e8b46cd9e (DEFAULT_TABLE table=default.Table_a2a2da44081f4fb694da113bdbae780c [id=5defaae270d744ff8dfc5ac3348d2a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.427485 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.428326 1782 consensus_queue.cc:1048] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.426936 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_704289c2a96943cb8eefe02205ef161a" } new_table_name: "default.Table_8e323273bd9943bbb9f3492e85db62e7" modify_external_catalogs: true
I20260617 07:53:11.428818 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_10dfdc64b49347fcaf5a117f196588ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:11.428148 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c918313039f74feabcd522092350ffa1" } new_table_name: "default.Table_f0b12a6999e7444cb768e6f57b809481" modify_external_catalogs: true
W20260617 07:53:11.429147 852 leader_election.cc:343] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:11.428530 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e897b111e65c497591c7daaa81d783c7 consensus state has no leader
W20260617 07:53:11.429352 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10dfdc64b49347fcaf5a117f196588ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:11.429517 852 consensus_peers.cc:597] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.429987 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a0dbb3e035514253b4f61f11d26da473" } new_table_name: "default.Table_deda97e12ba647f29d61a0ab49f6d3a7" modify_external_catalogs: true
I20260617 07:53:11.430894 1782 consensus_queue.cc:1048] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:11.431525 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 5ec425bb523a449d9fe16d3ea3a0d7ae consensus state has no leader
W20260617 07:53:11.432278 852 leader_election.cc:343] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:11.432649 852 consensus_peers.cc:597] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:11.435837 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet e55d63a25a2845dbbcce20e560361007 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e55d63a25a2845dbbcce20e560361007 consensus state has no leader
I20260617 07:53:11.442289 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef4f711d1534713b3ebd0862db382a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.449553 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 4e3b5cb887da4d86bdc3d69f350fdb40 (table default.Table_76ba66e135e34c4cab87ecfb9db4d2f5 [id=408ae87558644eb799bec6ab8d1ad2c1]) successfully deleted
W20260617 07:53:11.449930 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
W20260617 07:53:11.450150 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
W20260617 07:53:11.450349 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 53108a2d6c8b4398a568c14df8e0a23e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53108a2d6c8b4398a568c14df8e0a23e already in progress: creating tablet
W20260617 07:53:11.450549 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e55d63a25a2845dbbcce20e560361007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55d63a25a2845dbbcce20e560361007 already in progress: creating tablet
I20260617 07:53:11.450659 1171 tablet_bootstrap.cc:492] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:11.450742 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4d9ace137c4e496fafac4e729718577f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9ace137c4e496fafac4e729718577f already in progress: creating tablet
I20260617 07:53:11.450805 1171 ts_tablet_manager.cc:1403] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.079s user 0.001s sys 0.003s
W20260617 07:53:11.450928 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because the tablet was not found. No further retry: Not found: Tablet not found: 70610822c57e45c7add7e1f5ce96d889
W20260617 07:53:11.451144 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e757e6f4ce4c6eb8223c4b6955245e already in progress: creating tablet
I20260617 07:53:11.451617 1171 raft_consensus.cc:359] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.451833 1171 raft_consensus.cc:385] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.451920 1171 raft_consensus.cc:740] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.453423 1782 consensus_queue.cc:1048] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.454286 1172 tablet_bootstrap.cc:492] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.455279 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 4e3b5cb887da4d86bdc3d69f350fdb40 (table default.Table_76ba66e135e34c4cab87ecfb9db4d2f5 [id=408ae87558644eb799bec6ab8d1ad2c1]) successfully deleted
W20260617 07:53:11.456092 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
W20260617 07:53:11.456559 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
W20260617 07:53:11.457056 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 53108a2d6c8b4398a568c14df8e0a23e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53108a2d6c8b4398a568c14df8e0a23e already in progress: creating tablet
W20260617 07:53:11.459092 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e55d63a25a2845dbbcce20e560361007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55d63a25a2845dbbcce20e560361007 already in progress: creating tablet
I20260617 07:53:11.460760 1171 consensus_queue.cc:260] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:11.460846 986 consensus_peers.cc:597] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.461920 887 tablet_service.cc:1511] Processing CreateTablet for tablet 744736166fa2405082ea3a87ef6b1790 (DEFAULT_TABLE table=default.Table_2d516117840d45a0b36733f1f4cc08d5 [id=31f7f8c45788400eb64081bce24d763f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.463304 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 744736166fa2405082ea3a87ef6b1790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.466807 1171 ts_tablet_manager.cc:1434] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.016s user 0.001s sys 0.002s
I20260617 07:53:11.467754 898 tablet_service.cc:1511] Processing CreateTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b (DEFAULT_TABLE table=default.Table_912b307c6f95423883dad501646529f4 [id=c0ca0b05fe444d6baeaca00158a9a72b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.468144 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7cb453c7b647f298a6ebe20fd0e45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.472297 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7cb453c7b647f298a6ebe20fd0e45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.472667 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9a4021cad24b99b391e99e8b46cd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.475014 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.475260 898 tablet_service.cc:1511] Processing CreateTablet for tablet 306742b9da81497991d58947bf3c1ebb (DEFAULT_TABLE table=default.Table_dd16c59e32e542048095a371aaddb95b [id=c12a3c4eaa2342e089d4b405c4d7c304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.475610 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306742b9da81497991d58947bf3c1ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.478462 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e8f7118aaf4c6a9b9caab5abc030fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.482934 1171 tablet_bootstrap.cc:492] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:11.484790 1171 tablet_bootstrap.cc:654] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.484805 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07431acc9208489aaea2f8c4205e46a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.485708 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306742b9da81497991d58947bf3c1ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.485868 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:11.489043 1920 log.cc:927] Time spent T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: Append to log took a long time: real 0.106s user 0.000s sys 0.000s
I20260617 07:53:11.490020 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef4f711d1534713b3ebd0862db382a3 (DEFAULT_TABLE table=default.Table_37fb232762ab44cdb03ff6b8cb54866f [id=bf0311e54f774b8587d35475393dfa69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.490419 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef4f711d1534713b3ebd0862db382a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.496928 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.497741 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.497699 1172 tablet_bootstrap.cc:654] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.498342 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.498872 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.501839 894 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.502411 894 tablet_service.cc:1558] Processing DeleteTablet for tablet d9968c8179c14d1b9bc9a2c2779fb86e with delete_type TABLET_DATA_DELETED (replaced by tablet f4d8542262864a0ab9d763528502bcbb) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.503217 894 tablet_service.cc:1511] Processing CreateTablet for tablet 07431acc9208489aaea2f8c4205e46a5 (DEFAULT_TABLE table=default.Table_41ef34e21782488da51b458e095e7bcc [id=05666e345323450596af21c68fa06dad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.503660 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07431acc9208489aaea2f8c4205e46a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:11.511371 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c58bbdbf59c7426c8adbbbe3f0aafaed consensus state has no leader
I20260617 07:53:11.514519 897 tablet_service.cc:1511] Processing CreateTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa (DEFAULT_TABLE table=default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.514936 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e8f7118aaf4c6a9b9caab5abc030fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:11.514791 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet ce1cb2c879e6451886c55907678792de consensus state has no leader
I20260617 07:53:11.517760 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:11.519062 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 763581e2baeb46149bfb38d81301b9c5 consensus state has no leader
I20260617 07:53:11.521386 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef4f711d1534713b3ebd0862db382a3 (DEFAULT_TABLE table=default.Table_37fb232762ab44cdb03ff6b8cb54866f [id=bf0311e54f774b8587d35475393dfa69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.521858 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef4f711d1534713b3ebd0862db382a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.525256 1849 raft_consensus.cc:493] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.525425 1849 raft_consensus.cc:515] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:11.525957 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_91f0347cdea645c393589810a50ca778 [id=e2e28ecbf16446ae9e53e20ff4537b7d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7934f5fa0287427cb45fe568f0de8758 consensus state has no leader
I20260617 07:53:11.520377 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 301bd4d6faec429ba71ce354c23d0f75
W20260617 07:53:11.528767 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 233cae2480ed457bbab22ead8c0bde2c consensus state has no leader
W20260617 07:53:11.530179 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 58ba8963530d49a89fe4eb626225377d consensus state has no leader
W20260617 07:53:11.530498 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 706373f1f5d44edf81ed04183a8bdf89 consensus state has no leader
W20260617 07:53:11.536823 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet d8b83fda0ce74779b4cca2ffd2a9b903 consensus state has no leader
W20260617 07:53:11.538559 452 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet eb75a965740344c2bd0b68a8dda28be5 consensus state has no leader
W20260617 07:53:11.539124 452 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 49f0f68dcef34228a1b2a018e8aa329e consensus state has no leader
W20260617 07:53:11.539753 452 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 2735f7dd40e54aec9004b9b38702607c consensus state has no leader
W20260617 07:53:11.541548 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 consensus state has no leader
I20260617 07:53:11.542044 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.542388 1170 tablet_replica.cc:333] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.542636 1170 raft_consensus.cc:2243] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.542824 1170 raft_consensus.cc:2272] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.543390 1170 ts_tablet_manager.cc:1916] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.545261 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.545534 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3c03bf27d19849b7a595ecc26c80f3ab" } modify_external_catalogs: true
I20260617 07:53:11.545879 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3c03bf27d19849b7a595ecc26c80f3ab" } modify_external_catalogs: true
I20260617 07:53:11.546108 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.546752 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.547148 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_899f77e8e1154e7fb9f0983ba586ce47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:11.547448 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:11.547870 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_899f77e8e1154e7fb9f0983ba586ce47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.548700 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.549362 1849 leader_election.cc:290] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:11.549439 1170 ts_tablet_manager.cc:1929] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:11.549250 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.549530 1170 log.cc:1199] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/301bd4d6faec429ba71ce354c23d0f75
I20260617 07:53:11.550275 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:11.550798 713 leader_election.cc:343] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: cc84665c7849469aa27e6505dbed1516
I20260617 07:53:11.551218 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet d9968c8179c14d1b9bc9a2c2779fb86e with delete_type TABLET_DATA_DELETED (replaced by tablet f4d8542262864a0ab9d763528502bcbb) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.551994 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.552414 1170 ts_tablet_manager.cc:1950] T 301bd4d6faec429ba71ce354c23d0f75 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:11.553262 1170 tablet_replica.cc:333] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.553450 1170 raft_consensus.cc:2243] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.553611 1170 raft_consensus.cc:2272] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.553758 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 301bd4d6faec429ba71ce354c23d0f75 (table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012]) successfully deleted
W20260617 07:53:11.554059 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 11794aa70824476e9751a41ab305cc80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11794aa70824476e9751a41ab305cc80 already in progress: creating tablet
I20260617 07:53:11.554179 1170 ts_tablet_manager.cc:1916] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:11.554347 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 63bf519b83c445798bddda3120b542ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bf519b83c445798bddda3120b542ce already in progress: creating tablet
I20260617 07:53:11.554600 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:11.556730 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e3275c99834f404f84b96fcc7944cd00 consensus state has no leader
W20260617 07:53:11.557233 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 69f5b567da0e4baab53c00c55923e920 consensus state has no leader
W20260617 07:53:11.558053 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 9b2af44d9ab34e4bbea24d6c7d95748b consensus state has no leader
W20260617 07:53:11.558251 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet ee5ddac997834e97a2d6c9b1855ee4e8 consensus state has no leader
W20260617 07:53:11.558707 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet cbc79cfa11e342bd87da1aa03847c3cb consensus state has no leader
W20260617 07:53:11.558890 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3aa1c1fdede041d28570b85e63c401b7 consensus state has no leader
W20260617 07:53:11.559079 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 7ca402543247461aa5384abb65fff364 consensus state has no leader
W20260617 07:53:11.559839 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2777cf575a914f59b3459f3ce96f5d9a consensus state has no leader
W20260617 07:53:11.560081 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 4d9ace137c4e496fafac4e729718577f (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 4d9ace137c4e496fafac4e729718577f consensus state has no leader
I20260617 07:53:11.559072 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.562140 882 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.562320 1751 raft_consensus.cc:493] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.562592 1751 raft_consensus.cc:515] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.562855 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.563009 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 950c1c44020a4586b3197f5f68a38963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.563189 892 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.563237 1751 leader_election.cc:290] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.564158 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.564520 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet d7309d2b22c849ce980fd263a29ac77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.564937 1862 tablet_replica.cc:333] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:11.565115 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.565148 1862 raft_consensus.cc:2243] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:11.565614 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.565691 1862 raft_consensus.cc:2272] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.565968 883 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.566550 1862 ts_tablet_manager.cc:1916] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.566763 883 tablet_service.cc:1558] Processing DeleteTablet for tablet d7309d2b22c849ce980fd263a29ac77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.571058 1657 consensus_queue.cc:1048] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.571869 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.572408 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:11.573618 716 leader_election.cc:343] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: cc84665c7849469aa27e6505dbed1516
I20260617 07:53:11.573801 716 leader_election.cc:304] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:11.574011 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:11.574254 716 consensus_peers.cc:597] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5203534569bd4da18bc06751f094735f. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.574980 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be14a95f458d440e86133ef65c484571" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:11.575606 1849 raft_consensus.cc:2749] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:11.575886 1170 ts_tablet_manager.cc:1929] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:11.575999 1170 log.cc:1199] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/cb95639e16ed423fbe60b15a1bcdf5a6
W20260617 07:53:11.576246 986 leader_election.cc:343] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.576309 1170 ts_tablet_manager.cc:1950] T cb95639e16ed423fbe60b15a1bcdf5a6 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:11.576485 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.576756 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 006b71a3287240a5b15bfd489f514f4c with delete_type TABLET_DATA_DELETED (replaced by tablet 11794aa70824476e9751a41ab305cc80) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:11.579275 457 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 301bd4d6faec429ba71ce354c23d0f75 (table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 301bd4d6faec429ba71ce354c23d0f75 consensus state has no leader
I20260617 07:53:11.579895 1751 raft_consensus.cc:493] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.580080 1751 raft_consensus.cc:515] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.580919 1751 leader_election.cc:290] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.581934 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4d21f9ad9543b0b90fc66f1a6e3b13" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:11.582648 986 leader_election.cc:343] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.586935 1170 tablet_replica.cc:333] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.579493 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet cb95639e16ed423fbe60b15a1bcdf5a6 (table default.Table_1e6b5c822e34499dac5e7bda83d587b2 [id=f2f2591e0ed7444d87b0149a964ba958]) successfully deleted
W20260617 07:53:11.590301 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae9261c0ac94defaecfc7d14ba1ae61 already in progress: creating tablet
I20260617 07:53:11.596328 1178 ts_tablet_manager.cc:1434] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.262s user 0.002s sys 0.000s
I20260617 07:53:11.597867 1178 tablet_bootstrap.cc:492] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:11.599047 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet cc84665c7849469aa27e6505dbed1516 with delete_type TABLET_DATA_DELETED (replaced by tablet 71e8f7118aaf4c6a9b9caab5abc030fa) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.599313 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.599555 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.599690 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.599802 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.599913 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.600078 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8388648475499db50cc16a7c36775a with delete_type TABLET_DATA_DELETED (replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.600178 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.600261 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.600514 1178 tablet_bootstrap.cc:654] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.600512 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.601020 1657 raft_consensus.cc:493] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.601204 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.601204 1657 raft_consensus.cc:515] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.601517 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.601676 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 with delete_type TABLET_DATA_DELETED (replaced by tablet 36ce60b466f7420992ef194d72b5718d) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.602066 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.602262 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet ddc0439f992048358f1de4381516e543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.602562 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a547dabaeb742ba941690f4895955bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.602851 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.603030 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 with delete_type TABLET_DATA_DELETED (replaced by tablet 58ba8963530d49a89fe4eb626225377d) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.603049 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.603343 1657 leader_election.cc:290] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:11.603474 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.603817 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.604027 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.604297 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:11.604710 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92e55be5f28740fba65c1199a571d97a already in progress: creating tablet
W20260617 07:53:11.605027 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 because the tablet was not found. No further retry: Not found: Tablet not found: 4e3b5cb887da4d86bdc3d69f350fdb40
W20260617 07:53:11.605602 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet de030009192748118b388eec555d90da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de030009192748118b388eec555d90da already in progress: creating tablet
W20260617 07:53:11.605854 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d9968c8179c14d1b9bc9a2c2779fb86e because the tablet was not found. No further retry: Not found: Tablet not found: d9968c8179c14d1b9bc9a2c2779fb86e
W20260617 07:53:11.606120 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c7343400555f447b8a1721ba36d7766d because the tablet was not found. No further retry: Not found: Tablet not found: c7343400555f447b8a1721ba36d7766d
W20260617 07:53:11.606307 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a38bb8a140ef4bcab65aaa03bdb79040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a38bb8a140ef4bcab65aaa03bdb79040 already in progress: creating tablet
W20260617 07:53:11.606560 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 already in progress: creating tablet
W20260617 07:53:11.606763 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d7309d2b22c849ce980fd263a29ac77f because the tablet was not found. No further retry: Not found: Tablet not found: d7309d2b22c849ce980fd263a29ac77f
W20260617 07:53:11.607046 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
I20260617 07:53:11.607535 1751 raft_consensus.cc:493] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.607669 1751 raft_consensus.cc:515] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.608217 1751 leader_election.cc:290] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.608520 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.608896 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2684f3200e604bb6bf37a2f97a193eff" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:11.609411 986 leader_election.cc:343] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.611985 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 with delete_type TABLET_DATA_DELETED (replaced by tablet 58ba8963530d49a89fe4eb626225377d) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.612391 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a547dabaeb742ba941690f4895955bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.612465 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.612782 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.612982 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.613127 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.613377 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.613768 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 570ae1e189a64da6bad10156b401ec46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.613772 883 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9a4021cad24b99b391e99e8b46cd9e (DEFAULT_TABLE table=default.Table_a2a2da44081f4fb694da113bdbae780c [id=5defaae270d744ff8dfc5ac3348d2a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.614228 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 245cff69d83b43e98b1c72b8d3011347 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.614382 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.614677 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.614739 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.615036 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.615075 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.615375 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.615677 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.616153 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.616590 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 5203534569bd4da18bc06751f094735f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.616920 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.617116 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.617417 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.617784 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.618094 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.618387 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.618592 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:11.622684 459 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1f6264adc3994c22864ea73106ba2320 consensus state has no leader
I20260617 07:53:11.623739 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.624140 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.624508 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.624817 892 tablet_service.cc:1558] Processing DeleteTablet for tablet cc84665c7849469aa27e6505dbed1516 with delete_type TABLET_DATA_DELETED (replaced by tablet 71e8f7118aaf4c6a9b9caab5abc030fa) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.625161 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.626003 749 tablet_service.cc:1511] Processing CreateTablet for tablet 07431acc9208489aaea2f8c4205e46a5 (DEFAULT_TABLE table=default.Table_41ef34e21782488da51b458e095e7bcc [id=05666e345323450596af21c68fa06dad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.626137 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.626538 892 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.626746 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07431acc9208489aaea2f8c4205e46a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.626942 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:11.627704 851 consensus_peers.cc:597] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82d682ae37d74b4b967da0f8e2de6301. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:11.628474 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 57350.8us
I20260617 07:53:11.633119 887 tablet_service.cc:1558] Processing DeleteTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 with delete_type TABLET_DATA_DELETED (replaced by tablet d6ab00c0be9545cc97a0f29d82de4877) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.633517 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.634869 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9a4021cad24b99b391e99e8b46cd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.632560 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_86c3fe6446874d28b25252b953f8c730"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.635902 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86c3fe6446874d28b25252b953f8c730 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.636260 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.638567 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.639168 1935 raft_consensus.cc:493] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.639349 1935 raft_consensus.cc:515] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.640596 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80c2ffcf1b84df0bc6a468ea0929e80" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:11.640645 1170 raft_consensus.cc:2243] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.640810 914 raft_consensus.cc:2468] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:11.640947 1170 pending_rounds.cc:70] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:11.640995 1170 pending_rounds.cc:77] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772708394176512 op_type: NO_OP noop_request { }
I20260617 07:53:11.641079 1170 raft_consensus.cc:2889] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:11.641160 1170 raft_consensus.cc:2272] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.641263 716 leader_election.cc:304] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:11.641551 1849 raft_consensus.cc:2804] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:11.641646 1849 raft_consensus.cc:493] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:11.641734 1849 raft_consensus.cc:3060] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.642657 1862 ts_tablet_manager.cc:1929] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:11.642763 1862 log.cc:1199] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/950c1c44020a4586b3197f5f68a38963
I20260617 07:53:11.643550 1170 ts_tablet_manager.cc:1916] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.643241 1862 ts_tablet_manager.cc:1950] T 950c1c44020a4586b3197f5f68a38963 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:11.645143 1935 leader_election.cc:290] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:11.646215 713 leader_election.cc:343] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: d80c2ffcf1b84df0bc6a468ea0929e80
I20260617 07:53:11.647529 753 tablet_service.cc:1511] Processing CreateTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa (DEFAULT_TABLE table=default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.648061 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e8f7118aaf4c6a9b9caab5abc030fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.648342 1171 tablet_bootstrap.cc:492] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:11.648532 1171 ts_tablet_manager.cc:1403] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.166s user 0.005s sys 0.001s
I20260617 07:53:11.649416 1171 raft_consensus.cc:359] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:11.650069 457 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c019792d23484fb789378bf377547415 consensus state has no leader
W20260617 07:53:11.652462 457 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:57237 (request call id 189) took 1242 ms (client timeout 1000 ms). Trace:
W20260617 07:53:11.652661 457 rpcz_store.cc:269] 0617 07:53:10.410135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.493737 (+ 83602us) service_pool.cc:224] Handling call
0617 07:53:10.619527 (+125790us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:11.652420 (+1032893us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.188186 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.188289 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.188295 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:11.188298 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:11.188382 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.188391 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.188396 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:11.188446 (+ 50us) tablet.cc:701] Row locks acquired
0617 07:53:11.188449 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:11.188476 (+ 27us) write_op.cc:270] Start()
0617 07:53:11.188502 (+ 26us) write_op.cc:276] Timestamp: P: 1781682791188199 usec, L: 0
0617 07:53:11.188506 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.188683 (+ 177us) log.cc:844] Serialized 533 byte log entry
0617 07:53:11.254188 (+ 65505us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.254358 (+ 170us) write_op.cc:301] APPLY: starting
0617 07:53:11.254459 (+ 101us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.254508 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.254572 (+ 64us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.254645 (+ 73us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.254698 (+ 53us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:11.254709 (+ 11us) write_op.cc:312] APPLY: finished
0617 07:53:11.254827 (+ 118us) log.cc:844] Serialized 23 byte log entry
0617 07:53:11.254900 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.254922 (+ 22us) write_op.cc:454] Released schema lock
0617 07:53:11.254931 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.255023 (+ 92us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.255028 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":60725,"reported_tablets":176,"spinlock_wait_cycles":268395776,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":649,"apply.run_wall_time_us":649,"num_ops":1,"prepare.queue_time_us":3273,"prepare.run_cpu_time_us":618,"prepare.run_wall_time_us":25045,"raft.queue_time_us":515,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":65647,"spinlock_wait_cycles":14208}]]}
I20260617 07:53:11.653224 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.655138 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.655628 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.655874 760 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.656230 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.656581 760 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.656710 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.657101 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.657332 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.657681 751 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.657853 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.658095 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.658403 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.658610 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.658942 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.659425 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d7309d2b22c849ce980fd263a29ac77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.659536 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.659844 1846 tablet_replica.cc:333] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:11.659861 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.660115 1846 raft_consensus.cc:2243] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.660220 751 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.660331 1846 raft_consensus.cc:2272] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.660447 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.660794 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 19f8525046964950884b0f9aa515ec81 with delete_type TABLET_DATA_DELETED (replaced by tablet 9cddb9e82c354f26b3abe56ebdefd008) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.661008 1846 ts_tablet_manager.cc:1916] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.661180 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.661530 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.661875 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.663920 759 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9a4021cad24b99b391e99e8b46cd9e (DEFAULT_TABLE table=default.Table_a2a2da44081f4fb694da113bdbae780c [id=5defaae270d744ff8dfc5ac3348d2a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.664837 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.664988 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9a4021cad24b99b391e99e8b46cd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.666070 1172 tablet_bootstrap.cc:492] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.666220 1172 ts_tablet_manager.cc:1403] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.213s user 0.019s sys 0.014s
I20260617 07:53:11.666179 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 with delete_type TABLET_DATA_DELETED (replaced by tablet 58ba8963530d49a89fe4eb626225377d) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.666565 748 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8388648475499db50cc16a7c36775a with delete_type TABLET_DATA_DELETED (replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.667575 1172 raft_consensus.cc:359] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.667909 1172 raft_consensus.cc:385] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.667989 1172 raft_consensus.cc:740] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.668236 1172 consensus_queue.cc:260] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:11.671367 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 has no consensus state
I20260617 07:53:11.676846 1172 ts_tablet_manager.cc:1434] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260617 07:53:11.682669 1172 tablet_bootstrap.cc:492] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.684823 1172 tablet_bootstrap.cc:654] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.692030 760 tablet_service.cc:1558] Processing DeleteTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 with delete_type TABLET_DATA_DELETED (replaced by tablet d6ab00c0be9545cc97a0f29d82de4877) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.692404 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a547dabaeb742ba941690f4895955bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.692639 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d9968c8179c14d1b9bc9a2c2779fb86e with delete_type TABLET_DATA_DELETED (replaced by tablet f4d8542262864a0ab9d763528502bcbb) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:11.693533 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4d9ace137c4e496fafac4e729718577f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9ace137c4e496fafac4e729718577f already in progress: creating tablet
I20260617 07:53:11.694437 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 950c1c44020a4586b3197f5f68a38963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:11.694866 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70610822c57e45c7add7e1f5ce96d889 already in progress: creating tablet
I20260617 07:53:11.698482 1170 ts_tablet_manager.cc:1929] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:11.698625 1170 log.cc:1199] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0c21efcad98348ebabcee4821dc4682e
I20260617 07:53:11.699050 1170 ts_tablet_manager.cc:1950] T 0c21efcad98348ebabcee4821dc4682e P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:11.694934 1178 tablet_bootstrap.cc:492] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.703025 751 tablet_service.cc:1558] Processing DeleteTablet for tablet a882ae04eeb94276bb78ded81fbea708 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.704378 1172 tablet_bootstrap.cc:492] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.704552 1172 ts_tablet_manager.cc:1403] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.003s
I20260617 07:53:11.704636 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.704682 1849 raft_consensus.cc:515] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.705336 1172 raft_consensus.cc:359] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.705530 1172 raft_consensus.cc:385] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 07:53:11.705495 459 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:46601 (request call id 212) took 1391 ms (client timeout 1000 ms). Trace:
I20260617 07:53:11.705585 1172 raft_consensus.cc:740] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.705843 1172 consensus_queue.cc:260] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:11.705642 459 rpcz_store.cc:269] 0617 07:53:10.313532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.319667 (+ 6135us) service_pool.cc:224] Handling call
0617 07:53:10.342833 (+ 23166us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:11.705449 (+1362616us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:10.743605 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:10.743725 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:10.743732 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:10.743736 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:10.743916 (+ 180us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:10.743928 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:10.743933 (+ 5us) tablet.cc:685] Acquiring locks for 3 operations
0617 07:53:10.744053 (+ 120us) tablet.cc:701] Row locks acquired
0617 07:53:10.744056 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:10.744098 (+ 42us) write_op.cc:270] Start()
0617 07:53:10.744133 (+ 35us) write_op.cc:276] Timestamp: P: 1781682790744074 usec, L: 0
0617 07:53:10.744136 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:10.744344 (+ 208us) log.cc:844] Serialized 1293 byte log entry
0617 07:53:10.759789 (+ 15445us) op_driver.cc:464] REPLICATION: finished
0617 07:53:10.761063 (+ 1274us) write_op.cc:301] APPLY: starting
0617 07:53:10.761078 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:10.761142 (+ 64us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:10.761202 (+ 60us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:10.761335 (+ 133us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:10.761371 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0617 07:53:10.761377 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:10.761516 (+ 139us) log.cc:844] Serialized 35 byte log entry
0617 07:53:10.761588 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.761610 (+ 22us) write_op.cc:454] Released schema lock
0617 07:53:10.761619 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:10.761692 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:10.761695 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":180,"spinlock_wait_cycles":41977216,"child_traces":[["op",{"apply.queue_time_us":1200,"apply.run_cpu_time_us":624,"apply.run_wall_time_us":625,"num_ops":3,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":837,"prepare.run_wall_time_us":838,"raft.queue_time_us":1529,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":15626}]]}
I20260617 07:53:11.707418 1849 leader_election.cc:290] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:11.707561 1935 raft_consensus.cc:493] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:11.687501 851 leader_election.cc:343] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 301bd4d6faec429ba71ce354c23d0f75
I20260617 07:53:11.708818 1172 ts_tablet_manager.cc:1434] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:11.709327 1172 tablet_bootstrap.cc:492] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.712321 1172 tablet_bootstrap.cc:654] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.702683 1862 tablet_replica.cc:333] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:11.705889 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.706508 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80c2ffcf1b84df0bc6a468ea0929e80" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:11.713886 914 raft_consensus.cc:3060] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.707309 897 tablet_service.cc:1558] Processing DeleteTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.707502 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.718087 1862 raft_consensus.cc:2243] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:11.718531 1862 raft_consensus.cc:2272] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.719138 1178 ts_tablet_manager.cc:1403] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.105s user 0.004s sys 0.000s
W20260617 07:53:11.728112 452 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:33527 (request call id 143) took 1380 ms (client timeout 1000 ms). Trace:
I20260617 07:53:11.729424 1172 tablet_bootstrap.cc:492] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.729483 757 tablet_service.cc:1558] Processing DeleteTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 with delete_type TABLET_DATA_DELETED (replaced by tablet 36ce60b466f7420992ef194d72b5718d) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.729581 1172 ts_tablet_manager.cc:1403] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.003s
I20260617 07:53:11.729784 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.730544 1172 raft_consensus.cc:359] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.730732 1172 raft_consensus.cc:385] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.730791 1172 raft_consensus.cc:740] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.731009 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.730973 1172 consensus_queue.cc:260] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.731560 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.731563 1751 raft_consensus.cc:493] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.731674 1751 raft_consensus.cc:515] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.732169 755 tablet_service.cc:1558] Processing DeleteTablet for tablet cc84665c7849469aa27e6505dbed1516 with delete_type TABLET_DATA_DELETED (replaced by tablet 71e8f7118aaf4c6a9b9caab5abc030fa) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.732308 1751 leader_election.cc:290] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.732295 744 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.732658 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:11.732996 1172 ts_tablet_manager.cc:1434] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260617 07:53:11.733199 986 leader_election.cc:343] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.733265 1172 tablet_bootstrap.cc:492] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:11.728507 452 rpcz_store.cc:269] 0617 07:53:10.347412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:10.416117 (+ 68705us) service_pool.cc:224] Handling call
0617 07:53:10.439270 (+ 23153us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:11.728046 (+1288776us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":187,"spinlock_wait_cycles":44730624}
I20260617 07:53:11.733824 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 0c21efcad98348ebabcee4821dc4682e (table default.Table_754536afb14d459c82f275ef52707a7f [id=878537b828364bd29c9b6c93591acea6]) successfully deleted
I20260617 07:53:11.734012 1170 tablet_replica.cc:333] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.734203 1170 raft_consensus.cc:2243] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.734331 1170 raft_consensus.cc:2272] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:11.734380 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet f030d59f4e124f64bb62d05f0bb0f560 because the tablet was not found. No further retry: Not found: Tablet not found: f030d59f4e124f64bb62d05f0bb0f560
W20260617 07:53:11.734702 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
I20260617 07:53:11.734818 1170 ts_tablet_manager.cc:1916] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.735030 1172 tablet_bootstrap.cc:654] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.735529 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f9db8a986b344548e435b77edc14cb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 63bf519b83c445798bddda3120b542ce) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:11.737102 747 tablet_service.cc:1558] Processing DeleteTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.737265 745 tablet_service.cc:1558] Processing DeleteTablet for tablet d21f61a35ca544568bcfca1a6230deca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.737380 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:11.737761 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 006b71a3287240a5b15bfd489f514f4c because the tablet was not found. No further retry: Not found: Tablet not found: 006b71a3287240a5b15bfd489f514f4c
W20260617 07:53:11.738056 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet cc84665c7849469aa27e6505dbed1516 because the tablet was not found. No further retry: Not found: Tablet not found: cc84665c7849469aa27e6505dbed1516
W20260617 07:53:11.738358 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66140c5d364f453a8089f143cc96ede8 already in progress: creating tablet
I20260617 07:53:11.743860 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:11.748358 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e757e6f4ce4c6eb8223c4b6955245e already in progress: creating tablet
W20260617 07:53:11.748660 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 63bf519b83c445798bddda3120b542ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bf519b83c445798bddda3120b542ce already in progress: creating tablet
W20260617 07:53:11.748848 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 301bd4d6faec429ba71ce354c23d0f75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 301bd4d6faec429ba71ce354c23d0f75 already in progress: creating tablet
W20260617 07:53:11.749061 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cb95639e16ed423fbe60b15a1bcdf5a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb95639e16ed423fbe60b15a1bcdf5a6 already in progress: creating tablet
W20260617 07:53:11.749246 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0fd8cedb539748dc917128511325bbcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd8cedb539748dc917128511325bbcc already in progress: creating tablet
W20260617 07:53:11.749432 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e9488e8a501e404f85540fb045d8916f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9488e8a501e404f85540fb045d8916f already in progress: creating tablet
W20260617 07:53:11.749647 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 18f9bace06e34602acc7fcd7501b3671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18f9bace06e34602acc7fcd7501b3671 already in progress: creating tablet
I20260617 07:53:11.749840 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4d518b1a10fb4d86ada299b76be8b2b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.750258 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
W20260617 07:53:11.749787 713 leader_election.cc:343] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: d80c2ffcf1b84df0bc6a468ea0929e80
W20260617 07:53:11.750487 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 already in progress: creating tablet
W20260617 07:53:11.750758 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 84f498f551ff4767bd16628b03f55ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84f498f551ff4767bd16628b03f55ae2 already in progress: creating tablet
W20260617 07:53:11.750952 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae9261c0ac94defaecfc7d14ba1ae61 already in progress: creating tablet
W20260617 07:53:11.750497 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d518b1a10fb4d86ada299b76be8b2b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.751994 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.752231 741 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.752401 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f9db8a986b344548e435b77edc14cb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 63bf519b83c445798bddda3120b542ce) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.752547 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.752718 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.752872 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.752822 1935 raft_consensus.cc:515] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.753046 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.753203 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.753376 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 570ae1e189a64da6bad10156b401ec46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.753526 1935 leader_election.cc:290] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:11.754587 713 leader_election.cc:343] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 3f51c76d93674a91b5ada7821393020a
I20260617 07:53:11.754652 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f51c76d93674a91b5ada7821393020a" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:11.755014 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 7392ca4ba6a140e19c57e962a26162af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.755054 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.755336 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 4996cde4d1514aa081257c802339abe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.755535 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.755692 743 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.755869 743 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.755975 716 leader_election.cc:304] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:11.756198 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.756390 748 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.756594 748 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.755342 749 tablet_service.cc:1558] Processing DeleteTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.756778 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 5203534569bd4da18bc06751f094735f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.756889 749 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.756958 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.757032 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.757112 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.757266 750 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.757390 1935 raft_consensus.cc:2749] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:11.757429 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.756062 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.757704 1945 tablet.cc:1724] T b7d9354c81df42fb9756045e659be26d P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:11.757869 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.758039 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.759105 1172 tablet_bootstrap.cc:492] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.759241 1172 ts_tablet_manager.cc:1403] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260617 07:53:11.759977 1172 raft_consensus.cc:359] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.760143 1172 raft_consensus.cc:385] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.760195 1172 raft_consensus.cc:740] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.760339 1178 raft_consensus.cc:359] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.760376 1172 consensus_queue.cc:260] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.760535 1178 raft_consensus.cc:385] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.760633 1178 raft_consensus.cc:740] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.760857 1178 consensus_queue.cc:260] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.761425 1178 ts_tablet_manager.cc:1434] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260617 07:53:11.761766 1178 tablet_bootstrap.cc:492] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:11.763798 1178 tablet_bootstrap.cc:654] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.764665 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.764845 760 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.765313 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.765504 754 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.765651 747 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.765796 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.765935 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.765988 1172 ts_tablet_manager.cc:1434] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 07:53:11.766069 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.766223 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.766321 1172 tablet_bootstrap.cc:492] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.766809 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.767032 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.768353 1172 tablet_bootstrap.cc:654] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.770195 1171 raft_consensus.cc:385] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.771965 1171 raft_consensus.cc:740] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.772697 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_cff9a95917094a97b6cbcaf1fdabdc2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.773344 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cff9a95917094a97b6cbcaf1fdabdc2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.772269 898 tablet_service.cc:1558] Processing DeleteTablet for tablet d21f61a35ca544568bcfca1a6230deca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.774085 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.774233 883 tablet_service.cc:1558] Processing DeleteTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 with delete_type TABLET_DATA_DELETED (replaced by tablet 36ce60b466f7420992ef194d72b5718d) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.774777 1171 consensus_queue.cc:260] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.775801 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_dc82c567bed447868fae8b372c777c13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.776479 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc82c567bed447868fae8b372c777c13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.776675 1862 ts_tablet_manager.cc:1916] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.778203 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b3755d8ef424425f8833079bc13b60f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.778986 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3755d8ef424425f8833079bc13b60f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.780567 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_21f38a23f6964cf1acdf47d110725c9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:11.781265 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21f38a23f6964cf1acdf47d110725c9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.783854 1846 ts_tablet_manager.cc:1929] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:11.784037 1846 log.cc:1199] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d7309d2b22c849ce980fd263a29ac77f
I20260617 07:53:11.784435 1846 ts_tablet_manager.cc:1950] T d7309d2b22c849ce980fd263a29ac77f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:11.785179 914 raft_consensus.cc:2468] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:11.787220 716 leader_election.cc:304] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:11.787866 1935 raft_consensus.cc:2804] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:11.788017 1935 raft_consensus.cc:697] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:11.788285 1935 consensus_queue.cc:237] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:11.795825 851 consensus_peers.cc:597] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c21efcad98348ebabcee4821dc4682e. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.795892 1172 tablet_bootstrap.cc:492] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.796041 1172 ts_tablet_manager.cc:1403] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260617 07:53:11.796550 1951 tablet.cc:1724] T b7d9354c81df42fb9756045e659be26d P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:11.796851 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 7392ca4ba6a140e19c57e962a26162af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.797571 1171 ts_tablet_manager.cc:1434] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.149s user 0.000s sys 0.003s
I20260617 07:53:11.797852 1178 tablet_bootstrap.cc:492] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.797952 1171 tablet_bootstrap.cc:492] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:11.798022 1178 ts_tablet_manager.cc:1403] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.001s
I20260617 07:53:11.799126 1178 raft_consensus.cc:359] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.796844 1172 raft_consensus.cc:359] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.799510 1172 raft_consensus.cc:385] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.799650 1171 tablet_bootstrap.cc:654] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.799644 1172 raft_consensus.cc:740] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.799991 1172 consensus_queue.cc:260] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.800283 1178 raft_consensus.cc:385] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.800392 1178 raft_consensus.cc:740] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.800472 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.800750 1178 consensus_queue.cc:260] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.800871 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.801319 1172 ts_tablet_manager.cc:1434] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:11.802502 1178 ts_tablet_manager.cc:1434] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260617 07:53:11.802642 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 245cff69d83b43e98b1c72b8d3011347 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.802898 1172 tablet_bootstrap.cc:492] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.803960 1178 tablet_bootstrap.cc:492] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:11.806248 1172 tablet_bootstrap.cc:654] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.807953 1178 tablet_bootstrap.cc:654] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.809593 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f9db8a986b344548e435b77edc14cb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 63bf519b83c445798bddda3120b542ce) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.810057 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.810642 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 245cff69d83b43e98b1c72b8d3011347 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:11.813446 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 570ae1e189a64da6bad10156b401ec46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.813939 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.814306 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.814810 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.815155 892 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.815496 892 tablet_service.cc:1558] Processing DeleteTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.815801 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.816193 892 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.817167 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 4996cde4d1514aa081257c802339abe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.817646 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.818099 892 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.820854 892 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.821251 892 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.821578 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.821905 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.822283 892 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8388648475499db50cc16a7c36775a with delete_type TABLET_DATA_DELETED (replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.822620 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.822969 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.828190 892 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.828694 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.829165 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.829638 892 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.830626 892 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.831068 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:11.831700 1172 tablet_bootstrap.cc:492] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.831884 1172 ts_tablet_manager.cc:1403] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.006s
I20260617 07:53:11.832145 1751 consensus_queue.cc:1048] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.832700 1172 raft_consensus.cc:359] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.832847 1172 raft_consensus.cc:385] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.832916 1172 raft_consensus.cc:740] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.833103 1172 consensus_queue.cc:260] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.833588 1172 ts_tablet_manager.cc:1434] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260617 07:53:11.837498 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 11794aa70824476e9751a41ab305cc80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11794aa70824476e9751a41ab305cc80 already in progress: creating tablet
I20260617 07:53:11.837904 1172 tablet_bootstrap.cc:492] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:11.838441 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65bf5384ec244d36ba3d4e781c5eb8a3 already in progress: creating tablet
I20260617 07:53:11.839440 1172 tablet_bootstrap.cc:654] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:11.839442 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4d9ace137c4e496fafac4e729718577f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9ace137c4e496fafac4e729718577f already in progress: creating tablet
W20260617 07:53:11.839933 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
W20260617 07:53:11.840327 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92e55be5f28740fba65c1199a571d97a already in progress: creating tablet
W20260617 07:53:11.840726 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 63bf519b83c445798bddda3120b542ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bf519b83c445798bddda3120b542ce already in progress: creating tablet
I20260617 07:53:11.841028 1178 tablet_bootstrap.cc:492] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.841183 1178 ts_tablet_manager.cc:1403] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.004s
W20260617 07:53:11.841161 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet de030009192748118b388eec555d90da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de030009192748118b388eec555d90da already in progress: creating tablet
W20260617 07:53:11.841739 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d9968c8179c14d1b9bc9a2c2779fb86e because the tablet was not found. No further retry: Not found: Tablet not found: d9968c8179c14d1b9bc9a2c2779fb86e
W20260617 07:53:11.842453 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70610822c57e45c7add7e1f5ce96d889 already in progress: creating tablet
I20260617 07:53:11.842361 1178 raft_consensus.cc:359] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.842607 1178 raft_consensus.cc:385] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.842729 1178 raft_consensus.cc:740] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
W20260617 07:53:11.843873 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a38bb8a140ef4bcab65aaa03bdb79040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a38bb8a140ef4bcab65aaa03bdb79040 already in progress: creating tablet
W20260617 07:53:11.844347 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 already in progress: creating tablet
I20260617 07:53:11.843041 1178 consensus_queue.cc:260] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.845120 1178 ts_tablet_manager.cc:1434] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:11.845242 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301bd4d6faec429ba71ce354c23d0f75" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:11.845439 1178 tablet_bootstrap.cc:492] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:11.848476 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 950c1c44020a4586b3197f5f68a38963 (table default.Table_45c63267e23f435fbd339cff71a43d48 [id=025ad5e64ed3429b8844117f5ddec194]) successfully deleted
I20260617 07:53:11.850423 1171 tablet_bootstrap.cc:492] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:11.850651 1171 ts_tablet_manager.cc:1403] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.002s
I20260617 07:53:11.852106 1171 raft_consensus.cc:359] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.852351 1171 raft_consensus.cc:385] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.852494 1171 raft_consensus.cc:740] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.852764 1171 consensus_queue.cc:260] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.853193 1178 tablet_bootstrap.cc:654] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.853559 1171 ts_tablet_manager.cc:1434] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:11.861215 1846 tablet_replica.cc:333] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:11.861457 1846 raft_consensus.cc:2243] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.861662 1846 raft_consensus.cc:2272] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.862403 1846 ts_tablet_manager.cc:1916] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.863857 1032 tablet_service.cc:1511] Processing CreateTablet for tablet d4afe4a3d708447fa7ab8bf53614c4ba (DEFAULT_TABLE table=default.Table_7074bb8dadc643a6bdbd6cc8f86f4032 [id=28ca3bcf4d34455bb2121bd1a7e1254e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.866101 1170 ts_tablet_manager.cc:1929] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:11.866225 1170 log.cc:1199] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/89783bab2e584fe9a8eda963f78bf3ec
I20260617 07:53:11.866572 1170 ts_tablet_manager.cc:1950] T 89783bab2e584fe9a8eda963f78bf3ec P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:11.869589 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d7309d2b22c849ce980fd263a29ac77f (table default.Table_37dfd90d2dcb4616afb087ae9ebfa366 [id=f67703f0a40745f8982b89d83a3ecdea]) successfully deleted
W20260617 07:53:11.870035 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 already in progress: creating tablet
W20260617 07:53:11.870293 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a38bb8a140ef4bcab65aaa03bdb79040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a38bb8a140ef4bcab65aaa03bdb79040 already in progress: creating tablet
W20260617 07:53:11.870481 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
I20260617 07:53:11.870594 1172 tablet_bootstrap.cc:492] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.870718 1172 ts_tablet_manager.cc:1403] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20260617 07:53:11.871037 741 tablet_service.cc:1511] Processing CreateTablet for tablet d4afe4a3d708447fa7ab8bf53614c4ba (DEFAULT_TABLE table=default.Table_7074bb8dadc643a6bdbd6cc8f86f4032 [id=28ca3bcf4d34455bb2121bd1a7e1254e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.871239 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4afe4a3d708447fa7ab8bf53614c4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.871417 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4afe4a3d708447fa7ab8bf53614c4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.871582 1172 raft_consensus.cc:359] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.871734 1172 raft_consensus.cc:385] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.871776 1172 raft_consensus.cc:740] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.871963 1172 consensus_queue.cc:260] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.872447 1172 ts_tablet_manager.cc:1434] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:11.872691 1172 tablet_bootstrap.cc:492] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.879463 1751 raft_consensus.cc:493] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.879611 1751 raft_consensus.cc:515] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.880223 1751 leader_election.cc:290] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.881855 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934f5fa0287427cb45fe568f0de8758" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:11.882534 1172 tablet_bootstrap.cc:654] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:11.882499 986 leader_election.cc:343] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.887092 1171 tablet_bootstrap.cc:492] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:11.889150 1171 tablet_bootstrap.cc:654] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.890867 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_aa455a7a9315480c83c1505ae065ebcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:11.891563 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_00d654600a8a474d84c1678c529d4489" } modify_external_catalogs: true
I20260617 07:53:11.891780 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_00d654600a8a474d84c1678c529d4489" } modify_external_catalogs: true
W20260617 07:53:11.891563 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa455a7a9315480c83c1505ae065ebcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:11.892373 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_91f0347cdea645c393589810a50ca778" } new_table_name: "default.Table_ec9f51e614dd4d61ab97ab2bcaec742f" modify_external_catalogs: true
I20260617 07:53:11.895287 771 raft_consensus.cc:3060] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:11.896324 851 consensus_peers.cc:597] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f51c76d93674a91b5ada7821393020a. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.898027 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_50c9e41224614d21a12eac5dea96559c" } modify_external_catalogs: true
I20260617 07:53:11.898293 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_50c9e41224614d21a12eac5dea96559c" } modify_external_catalogs: true
I20260617 07:53:11.902483 1657 raft_consensus.cc:493] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.902665 1657 raft_consensus.cc:515] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.903285 1657 leader_election.cc:290] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:11.904579 1751 raft_consensus.cc:493] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.904716 1751 raft_consensus.cc:515] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.905267 1780 raft_consensus.cc:493] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.905357 1751 leader_election.cc:290] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:11.905411 1780 raft_consensus.cc:515] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.906072 1780 leader_election.cc:290] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:11.906848 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ab8e93e3fe475ba9c7b5fce390a8ab" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:11.907397 986 leader_election.cc:343] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:11.907892 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4d21f9ad9543b0b90fc66f1a6e3b13" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:11.908075 1050 raft_consensus.cc:2468] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:11.908488 851 leader_election.cc:304] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:11.908779 1780 raft_consensus.cc:2804] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:11.908874 1780 raft_consensus.cc:493] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:11.908990 1780 raft_consensus.cc:3060] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.914430 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0a73e0c5eead4482b2f6747fec27846f" } modify_external_catalogs: true
I20260617 07:53:11.914666 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0a73e0c5eead4482b2f6747fec27846f" } modify_external_catalogs: true
I20260617 07:53:11.918058 1172 tablet_bootstrap.cc:492] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.918017 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ed9a99cdcbb74a3fb74654a26716a1c9 (DEFAULT_TABLE table=default.Table_0276ca256ddc491e93325794b1ff6d2f [id=df75990a4b94463f8e92ab98e77b8384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.918200 1172 ts_tablet_manager.cc:1403] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s
I20260617 07:53:11.918494 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9a99cdcbb74a3fb74654a26716a1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.918937 1172 raft_consensus.cc:359] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.919096 1172 raft_consensus.cc:385] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.919147 1172 raft_consensus.cc:740] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.919340 1172 consensus_queue.cc:260] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.918969 741 tablet_service.cc:1511] Processing CreateTablet for tablet ed9a99cdcbb74a3fb74654a26716a1c9 (DEFAULT_TABLE table=default.Table_0276ca256ddc491e93325794b1ff6d2f [id=df75990a4b94463f8e92ab98e77b8384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.919859 1172 ts_tablet_manager.cc:1434] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260617 07:53:11.922473 852 consensus_peers.cc:597] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:11.923084 1172 tablet_bootstrap.cc:492] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.924896 1172 tablet_bootstrap.cc:654] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.930557 759 tablet_service.cc:1511] Processing CreateTablet for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (DEFAULT_TABLE table=default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.931778 1022 tablet_service.cc:1511] Processing CreateTablet for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (DEFAULT_TABLE table=default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.931779 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4a8b06f77643dcb28f0c3136510253 (DEFAULT_TABLE table=default.Table_c35a3ed8e6204960bfd8de4797c65873 [id=57a0963f9a80400db9efabb1af8210fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.932384 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4a8b06f77643dcb28f0c3136510253 (DEFAULT_TABLE table=default.Table_c35a3ed8e6204960bfd8de4797c65873 [id=57a0963f9a80400db9efabb1af8210fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.932883 751 tablet_service.cc:1511] Processing CreateTablet for tablet cc26e46cd03d47099015ddbac0d17688 (DEFAULT_TABLE table=default.Table_91e4899e1bee4435b0ada003489fc9dd [id=272b65dec17f4d59820fe19f1fdff20c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.933000 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.937964 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4a8b06f77643dcb28f0c3136510253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.939103 1172 tablet_bootstrap.cc:492] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.939255 1172 ts_tablet_manager.cc:1403] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260617 07:53:11.939683 1657 consensus_queue.cc:1048] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:11.940253 1172 raft_consensus.cc:359] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.940460 1172 raft_consensus.cc:385] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.940521 1172 raft_consensus.cc:740] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.940759 1172 consensus_queue.cc:260] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.941251 1172 ts_tablet_manager.cc:1434] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:11.941511 1172 tablet_bootstrap.cc:492] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.943161 1172 tablet_bootstrap.cc:654] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.946645 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:11.949366 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:11.951512 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:11.951925 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]). Expected version 3 got 0
I20260617 07:53:11.952240 458 catalog_manager.cc:5696] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:11.953763 458 catalog_manager.cc:5696] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:11.956961 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:11.957670 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_91f0347cdea645c393589810a50ca778 [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 1 got 0
I20260617 07:53:11.958273 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_022308372ad4427797e380190f5323b8 [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 4 got 0
I20260617 07:53:11.958559 1170 tablet_replica.cc:333] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:11.958740 1170 raft_consensus.cc:2243] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:11.958880 1170 raft_consensus.cc:2272] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:11.959329 1172 tablet_bootstrap.cc:492] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:11.959507 1172 ts_tablet_manager.cc:1403] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260617 07:53:11.959784 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89783bab2e584fe9a8eda963f78bf3ec" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:11.960251 1172 raft_consensus.cc:359] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.960390 1172 raft_consensus.cc:385] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.960433 1172 raft_consensus.cc:740] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.960611 1172 consensus_queue.cc:260] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:11.960966 1935 raft_consensus.cc:493] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:11.961153 1172 ts_tablet_manager.cc:1434] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:11.961115 1935 raft_consensus.cc:515] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.962177 1935 leader_election.cc:290] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:11.962387 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21f61a35ca544568bcfca1a6230deca" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:11.962685 914 raft_consensus.cc:2468] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 0.
I20260617 07:53:11.963192 716 leader_election.cc:304] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:11.963514 1935 raft_consensus.cc:2804] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:11.963629 1935 raft_consensus.cc:493] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:11.963712 1935 raft_consensus.cc:3060] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.959372 1170 ts_tablet_manager.cc:1916] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:11.966514 1172 tablet_bootstrap.cc:492] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:11.964555 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 89783bab2e584fe9a8eda963f78bf3ec (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]) successfully deleted
W20260617 07:53:11.968379 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7f7611958cf143438497c93f5f2bc098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7611958cf143438497c93f5f2bc098 already in progress: creating tablet
W20260617 07:53:11.968590 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 36ce60b466f7420992ef194d72b5718d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ce60b466f7420992ef194d72b5718d already in progress: creating tablet
W20260617 07:53:11.968787 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 82d682ae37d74b4b967da0f8e2de6301 because the tablet was not found. No further retry: Not found: Tablet not found: 82d682ae37d74b4b967da0f8e2de6301
W20260617 07:53:11.968938 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ab8388648475499db50cc16a7c36775a because the tablet was not found. No further retry: Not found: Tablet not found: ab8388648475499db50cc16a7c36775a
I20260617 07:53:11.969261 756 tablet_service.cc:1511] Processing CreateTablet for tablet 903a8bd5b4bc49d6bb080362e684ee5e (DEFAULT_TABLE table=default.Table_ec014388c38a4b7ebbbb7c1bccde17c5 [id=b76b40fb9dac481f9e3140e1f779ea6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.969808 755 tablet_service.cc:1511] Processing CreateTablet for tablet d2304939c17648a6962f702524aa9b76 (DEFAULT_TABLE table=default.Table_c2ab276e39134bfb97bec45ec6d13aea [id=81a5b37a105e475f8885e6da7da07255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.970017 458 catalog_manager.cc:5696] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:11.970283 744 tablet_service.cc:1511] Processing CreateTablet for tablet 561c8bf9e5c840628ab1c8cf91dc2d93 (DEFAULT_TABLE table=default.Table_b3c6dc341bb4497186428c46a5d6c0d2 [id=ff0f5a6dbcc04dbd9d2a0a5984f34e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.970700 1178 tablet_bootstrap.cc:492] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:11.970875 1178 ts_tablet_manager.cc:1403] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.125s user 0.009s sys 0.010s
I20260617 07:53:11.970927 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_8eb9043c09274769aecb39dee134ba7e [id=9726df7d693441359861876ae1179b4d]). Expected version 3 got 0
I20260617 07:53:11.971325 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d]). Expected version 2 got 0
I20260617 07:53:11.971590 747 tablet_service.cc:1511] Processing CreateTablet for tablet 3460a7f9f9bf4ea4950f878a56cfc13e (DEFAULT_TABLE table=default.Table_2d4094e6462248ce8997e5c441d4211b [id=b2b609eced484f8e9b6335ee607b8031]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.971691 1172 tablet_bootstrap.cc:654] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.971758 1178 raft_consensus.cc:359] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.971961 1178 raft_consensus.cc:385] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:11.972064 1178 raft_consensus.cc:740] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:11.972067 754 tablet_service.cc:1511] Processing CreateTablet for tablet adbbe7eb5181431290f57ed9128181a3 (DEFAULT_TABLE table=default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.972328 1178 consensus_queue.cc:260] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.973764 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:11.973953 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_50c9e41224614d21a12eac5dea96559c [id=121feb8666fe4cb5b796fecf0bf1f8b0]). Expected version 2 got 0
I20260617 07:53:11.974205 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 561c8bf9e5c840628ab1c8cf91dc2d93 (DEFAULT_TABLE table=default.Table_b3c6dc341bb4497186428c46a5d6c0d2 [id=ff0f5a6dbcc04dbd9d2a0a5984f34e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.974416 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:11.974642 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 3460a7f9f9bf4ea4950f878a56cfc13e (DEFAULT_TABLE table=default.Table_2d4094e6462248ce8997e5c441d4211b [id=b2b609eced484f8e9b6335ee607b8031]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.974691 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet b7d9354c81df42fb9756045e659be26d (table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c]). Expected version 2 got 0
I20260617 07:53:11.974819 1178 ts_tablet_manager.cc:1434] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:11.975145 1178 tablet_bootstrap.cc:492] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:11.975260 1018 tablet_service.cc:1511] Processing CreateTablet for tablet adbbe7eb5181431290f57ed9128181a3 (DEFAULT_TABLE table=default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:11.975383 713 leader_election.cc:343] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: d21f61a35ca544568bcfca1a6230deca
I20260617 07:53:11.976660 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
W20260617 07:53:11.976675 851 leader_election.cc:343] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: Tablet not RUNNING: SHUTDOWN
I20260617 07:53:11.976858 1178 tablet_bootstrap.cc:654] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:11.977037 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet e897b111e65c497591c7daaa81d783c7 (table default.Table_9c908cf10c5b4e60bf295dc81294ca83 [id=5a3a690ecbb34b44a83b177bca7926aa]). Expected version 1 got 0
I20260617 07:53:11.977120 1780 raft_consensus.cc:515] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:11.977763 458 catalog_manager.cc:5696] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:11.977979 1780 leader_election.cc:290] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:11.978246 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]). Expected version 2 got 0
I20260617 07:53:11.978605 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4d21f9ad9543b0b90fc66f1a6e3b13" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:11.978536 458 catalog_manager.cc:5696] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:11.978760 1052 raft_consensus.cc:3060] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:11.978905 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]). Expected version 1 got 0
I20260617 07:53:11.979375 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:11.984755 1020 tablet_service.cc:1511] Processing CreateTablet for tablet d2304939c17648a6962f702524aa9b76 (DEFAULT_TABLE table=default.Table_c2ab276e39134bfb97bec45ec6d13aea [id=81a5b37a105e475f8885e6da7da07255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.986068 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.979614 458 catalog_manager.cc:5696] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:11.986654 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:11.986747 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc26e46cd03d47099015ddbac0d17688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.986863 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:11.987161 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 2 got 0
I20260617 07:53:11.987236 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3460a7f9f9bf4ea4950f878a56cfc13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.987314 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:11.988327 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbbe7eb5181431290f57ed9128181a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.988894 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 561c8bf9e5c840628ab1c8cf91dc2d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.989250 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:11.989322 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4a8b06f77643dcb28f0c3136510253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.989763 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2304939c17648a6962f702524aa9b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.990186 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903a8bd5b4bc49d6bb080362e684ee5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:11.990500 1019 tablet_service.cc:1511] Processing CreateTablet for tablet ca400838f5214d1a8f57e72c5068f0f9 (DEFAULT_TABLE table=default.Table_e85510ab21154a9d9c9461d1a0491a56 [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.992092 745 tablet_service.cc:1511] Processing CreateTablet for tablet ca400838f5214d1a8f57e72c5068f0f9 (DEFAULT_TABLE table=default.Table_e85510ab21154a9d9c9461d1a0491a56 [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.992163 1030 tablet_service.cc:1511] Processing CreateTablet for tablet df5224716de249e9be9d7239407579a9 (DEFAULT_TABLE table=default.Table_66b270e872d540d693beb8d8493416ce [id=19b27e1499f246d8aeace932d20e1d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.992900 760 tablet_service.cc:1511] Processing CreateTablet for tablet df5224716de249e9be9d7239407579a9 (DEFAULT_TABLE table=default.Table_66b270e872d540d693beb8d8493416ce [id=19b27e1499f246d8aeace932d20e1d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.992920 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 2 got 0
I20260617 07:53:11.992990 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (DEFAULT_TABLE table=default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.993283 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:11.993579 746 tablet_service.cc:1511] Processing CreateTablet for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (DEFAULT_TABLE table=default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.994426 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 903a8bd5b4bc49d6bb080362e684ee5e (DEFAULT_TABLE table=default.Table_ec014388c38a4b7ebbbb7c1bccde17c5 [id=b76b40fb9dac481f9e3140e1f779ea6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:11.996356 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:11.996860 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:11.997859 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:11.999181 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:11.999359 1171 tablet_bootstrap.cc:492] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:11.999547 1171 ts_tablet_manager.cc:1403] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.113s user 0.000s sys 0.008s
I20260617 07:53:11.999961 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21]). Expected version 1 got 0
I20260617 07:53:12.000453 1171 raft_consensus.cc:359] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.000676 1171 raft_consensus.cc:385] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.000732 1171 raft_consensus.cc:740] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.001930 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:12.002303 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:12.002650 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]). Expected version 1 got 0
I20260617 07:53:12.003988 1171 consensus_queue.cc:260] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.004391 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:12.004628 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:12.006498 1172 tablet_bootstrap.cc:492] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.006680 1172 ts_tablet_manager.cc:1403] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.008s
I20260617 07:53:12.007431 1172 raft_consensus.cc:359] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.007634 1172 raft_consensus.cc:385] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.007719 1172 raft_consensus.cc:740] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.007938 1172 consensus_queue.cc:260] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.008440 1172 ts_tablet_manager.cc:1434] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:12.010618 1171 ts_tablet_manager.cc:1434] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.002s
I20260617 07:53:12.010744 1178 tablet_bootstrap.cc:492] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:12.010910 1178 ts_tablet_manager.cc:1403] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260617 07:53:12.011062 1172 tablet_bootstrap.cc:492] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.013310 1172 tablet_bootstrap.cc:654] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.022893 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca400838f5214d1a8f57e72c5068f0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.024044 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a61124fa6f846a6be1a208f2eaa7c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.027278 1849 raft_consensus.cc:493] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc3bec007846459a9da0c7b8211e477b)
I20260617 07:53:12.027451 1849 raft_consensus.cc:515] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:12.029131 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 88826.3us
I20260617 07:53:12.029855 1178 raft_consensus.cc:359] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.030368 1849 leader_election.cc:290] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:12.030558 716 leader_election.cc:343] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 8fa23bb0929440b1820afdce4b9e8d8c
W20260617 07:53:12.030661 852 consensus_peers.cc:597] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:12.030841 852 leader_election.cc:343] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.030967 852 leader_election.cc:304] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:12.031423 713 leader_election.cc:343] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 8fa23bb0929440b1820afdce4b9e8d8c
I20260617 07:53:12.031551 713 leader_election.cc:304] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:12.032327 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5224716de249e9be9d7239407579a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.032668 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9a99cdcbb74a3fb74654a26716a1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.032684 1849 raft_consensus.cc:2749] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260617 07:53:12.033850 852 consensus_peers.cc:597] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:12.034808 1178 raft_consensus.cc:385] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.042598 1172 tablet_bootstrap.cc:492] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.042732 1172 ts_tablet_manager.cc:1403] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.001s
I20260617 07:53:12.043448 1172 raft_consensus.cc:359] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.043602 1172 raft_consensus.cc:385] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.043644 1172 raft_consensus.cc:740] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.043824 1172 consensus_queue.cc:260] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.044240 1172 ts_tablet_manager.cc:1434] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 07:53:12.044503 1172 tablet_bootstrap.cc:492] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.046916 1172 tablet_bootstrap.cc:654] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.049286 1178 raft_consensus.cc:740] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.051632 1178 consensus_queue.cc:260] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.053182 1178 ts_tablet_manager.cc:1434] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.041s user 0.000s sys 0.003s
I20260617 07:53:12.054365 1178 tablet_bootstrap.cc:492] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:12.056618 1178 tablet_bootstrap.cc:654] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.061813 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 561c8bf9e5c840628ab1c8cf91dc2d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.062330 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbbe7eb5181431290f57ed9128181a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.062714 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca400838f5214d1a8f57e72c5068f0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.063082 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5224716de249e9be9d7239407579a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.063144 1935 raft_consensus.cc:515] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.063446 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a61124fa6f846a6be1a208f2eaa7c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.063807 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3460a7f9f9bf4ea4950f878a56cfc13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.064308 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2304939c17648a6962f702524aa9b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.064337 1935 leader_election.cc:290] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.064764 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903a8bd5b4bc49d6bb080362e684ee5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:12.065160 713 leader_election.cc:343] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: d21f61a35ca544568bcfca1a6230deca
I20260617 07:53:12.065794 1052 raft_consensus.cc:2468] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:12.068403 1178 tablet_bootstrap.cc:492] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:12.068565 1178 ts_tablet_manager.cc:1403] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260617 07:53:12.069422 1178 raft_consensus.cc:359] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.069626 1178 raft_consensus.cc:385] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.069702 1178 raft_consensus.cc:740] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.073807 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]). Expected version 1 got 0
I20260617 07:53:12.073997 1172 tablet_bootstrap.cc:492] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.074162 1172 ts_tablet_manager.cc:1403] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.009s
I20260617 07:53:12.075102 1172 raft_consensus.cc:359] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.075317 1172 raft_consensus.cc:385] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.075398 1172 raft_consensus.cc:740] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.075619 1172 consensus_queue.cc:260] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.076200 1172 ts_tablet_manager.cc:1434] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:12.076478 1172 tablet_bootstrap.cc:492] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.078629 1172 tablet_bootstrap.cc:654] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.073261 1178 consensus_queue.cc:260] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.080392 1178 ts_tablet_manager.cc:1434] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260617 07:53:12.081315 1849 raft_consensus.cc:493] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.081480 1849 raft_consensus.cc:515] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.082137 1849 leader_election.cc:290] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.082605 1178 tablet_bootstrap.cc:492] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:12.088066 1178 tablet_bootstrap.cc:654] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.088846 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_8eb9043c09274769aecb39dee134ba7e [id=9726df7d693441359861876ae1179b4d]). Expected version 3 got 0
I20260617 07:53:12.089057 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_022308372ad4427797e380190f5323b8 [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 4 got 0
I20260617 07:53:12.091795 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:12.092068 456 catalog_manager.cc:5696] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:12.092615 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:12.092811 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:12.093132 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
I20260617 07:53:12.093321 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e897b111e65c497591c7daaa81d783c7 (table default.Table_9c908cf10c5b4e60bf295dc81294ca83 [id=5a3a690ecbb34b44a83b177bca7926aa]). Expected version 1 got 0
I20260617 07:53:12.094741 1172 tablet_bootstrap.cc:492] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.094884 1172 ts_tablet_manager.cc:1403] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.003s
I20260617 07:53:12.095634 1172 raft_consensus.cc:359] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.095798 1172 raft_consensus.cc:385] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.095852 1172 raft_consensus.cc:740] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.096057 1172 consensus_queue.cc:260] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.096555 1172 ts_tablet_manager.cc:1434] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:12.096838 1172 tablet_bootstrap.cc:492] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.098766 1172 tablet_bootstrap.cc:654] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.101486 1178 tablet_bootstrap.cc:492] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:12.101676 1178 ts_tablet_manager.cc:1403] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20260617 07:53:12.103303 1178 raft_consensus.cc:359] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.103566 1178 raft_consensus.cc:385] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.103686 1178 raft_consensus.cc:740] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.103977 1178 consensus_queue.cc:260] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.105849 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_91f0347cdea645c393589810a50ca778 [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 1 got 0
I20260617 07:53:12.106515 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet b7d9354c81df42fb9756045e659be26d (table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c]). Expected version 2 got 0
I20260617 07:53:12.106863 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:12.107111 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:12.107311 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_50c9e41224614d21a12eac5dea96559c [id=121feb8666fe4cb5b796fecf0bf1f8b0]). Expected version 2 got 0
I20260617 07:53:12.107522 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d]). Expected version 2 got 0
I20260617 07:53:12.108716 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d9354c81df42fb9756045e659be26d" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:12.110313 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:12.111075 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]). Expected version 3 got 0
I20260617 07:53:12.111449 1846 ts_tablet_manager.cc:1929] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:12.111681 1846 log.cc:1199] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/19f8525046964950884b0f9aa515ec81
I20260617 07:53:12.112143 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:12.112192 1846 ts_tablet_manager.cc:1950] T 19f8525046964950884b0f9aa515ec81 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:12.112736 1849 raft_consensus.cc:493] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.112991 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]). Expected version 2 got 0
I20260617 07:53:12.112926 1849 raft_consensus.cc:515] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.113130 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:12.113579 1849 leader_election.cc:290] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.113669 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 2 got 0
I20260617 07:53:12.113698 1178 ts_tablet_manager.cc:1434] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260617 07:53:12.114987 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9db8a986b344548e435b77edc14cb6" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:12.113866 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:12.115620 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:12.116161 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:12.116760 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 2 got 0
I20260617 07:53:12.117463 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:12.118149 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:12.035672 1780 raft_consensus.cc:2749] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:12.118906 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:12.119201 1657 consensus_queue.cc:1048] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.075s
I20260617 07:53:12.119335 1782 consensus_queue.cc:1048] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.082s
I20260617 07:53:12.120692 1178 tablet_bootstrap.cc:492] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:12.121685 1751 raft_consensus.cc:493] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.121861 1751 raft_consensus.cc:515] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.122391 1751 leader_election.cc:290] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.123142 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f5b567da0e4baab53c00c55923e920" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.123519 1178 tablet_bootstrap.cc:654] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:12.123615 986 leader_election.cc:343] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.124328 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21]). Expected version 1 got 0
I20260617 07:53:12.124694 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:12.125020 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:12.125265 1172 tablet_bootstrap.cc:492] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.125267 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:12.125440 1172 ts_tablet_manager.cc:1403] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260617 07:53:12.125643 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:12.126282 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:12.126292 1172 raft_consensus.cc:359] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.126480 1172 raft_consensus.cc:385] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.126551 1172 raft_consensus.cc:740] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.126768 1172 consensus_queue.cc:260] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.126860 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:12.127314 1172 ts_tablet_manager.cc:1434] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:12.127892 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]). Expected version 1 got 0
I20260617 07:53:12.128582 1172 tablet_bootstrap.cc:492] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:12.129606 986 consensus_peers.cc:597] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:12.131129 1172 tablet_bootstrap.cc:654] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.139467 1172 tablet_bootstrap.cc:492] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.139443 851 leader_election.cc:304] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:12.139626 1172 ts_tablet_manager.cc:1403] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260617 07:53:12.140264 1171 tablet_bootstrap.cc:492] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:12.140537 1172 raft_consensus.cc:359] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.140741 1172 raft_consensus.cc:385] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.140774 1657 raft_consensus.cc:2804] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:12.140834 1172 raft_consensus.cc:740] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.141078 1172 consensus_queue.cc:260] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.142108 1172 ts_tablet_manager.cc:1434] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:12.142465 1172 tablet_bootstrap.cc:492] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.144037 1172 tablet_bootstrap.cc:654] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.151018 1751 raft_consensus.cc:493] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.151167 1751 raft_consensus.cc:515] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.151754 1751 leader_election.cc:290] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.153330 1751 raft_consensus.cc:493] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.153475 1751 raft_consensus.cc:515] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.154013 1751 leader_election.cc:290] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.155803 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 19f8525046964950884b0f9aa515ec81 (table default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]) successfully deleted
I20260617 07:53:12.157676 1172 tablet_bootstrap.cc:492] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.157862 1172 ts_tablet_manager.cc:1403] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260617 07:53:12.158645 1172 raft_consensus.cc:359] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.158826 1172 raft_consensus.cc:385] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.158891 1172 raft_consensus.cc:740] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.159438 1846 tablet_replica.cc:333] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:12.159453 1172 consensus_queue.cc:260] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.159922 1172 ts_tablet_manager.cc:1434] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:12.160221 1172 tablet_bootstrap.cc:492] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.161512 1846 raft_consensus.cc:2243] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:12.161747 1846 raft_consensus.cc:2272] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:12.163766 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df37ed81b17d4178adeb6057491b4cc9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.164332 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5ddac997834e97a2d6c9b1855ee4e8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.166239 1846 ts_tablet_manager.cc:1916] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:12.181777 1032 tablet_service.cc:1511] Processing CreateTablet for tablet cc26e46cd03d47099015ddbac0d17688 (DEFAULT_TABLE table=default.Table_91e4899e1bee4435b0ada003489fc9dd [id=272b65dec17f4d59820fe19f1fdff20c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.189246 1172 tablet_bootstrap.cc:654] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:12.192402 986 leader_election.cc:343] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:12.196432 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2777cf575a914f59b3459f3ce96f5d9a consensus state has no leader
I20260617 07:53:12.196688 1170 ts_tablet_manager.cc:1929] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:12.196933 1170 log.cc:1199] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/be14a95f458d440e86133ef65c484571
I20260617 07:53:12.196946 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc26e46cd03d47099015ddbac0d17688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.201218 1170 ts_tablet_manager.cc:1950] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:12.202751 1170 tablet_replica.cc:333] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:12.211411 986 leader_election.cc:343] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.213815 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet be14a95f458d440e86133ef65c484571 (table default.Table_868af3e5fa6c43ab8593b4e6a0073a62 [id=16ff2f9be38e41fc81466c55286f0b42]) successfully deleted
W20260617 07:53:12.214357 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5dcfb101cf51487692ef9a6a17f40804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dcfb101cf51487692ef9a6a17f40804 already in progress: creating tablet
W20260617 07:53:12.214752 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
W20260617 07:53:12.215328 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 82cf9c672f3b4567b63e878a6ab11334 because the tablet was not found. No further retry: Not found: Tablet not found: 82cf9c672f3b4567b63e878a6ab11334
W20260617 07:53:12.215723 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3f51c76d93674a91b5ada7821393020a because the tablet was not found. No further retry: Not found: Tablet not found: 3f51c76d93674a91b5ada7821393020a
W20260617 07:53:12.216238 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c7e43e1a3df54efe992a86dd0bd0c149 because the tablet was not found. No further retry: Not found: Tablet not found: c7e43e1a3df54efe992a86dd0bd0c149
W20260617 07:53:12.216676 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d9e473fd444efa6ab63cc51dbb2bd already in progress: creating tablet
W20260617 07:53:12.217159 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ddc0439f992048358f1de4381516e543 because the tablet was not found. No further retry: Not found: Tablet not found: ddc0439f992048358f1de4381516e543
I20260617 07:53:12.217996 1751 raft_consensus.cc:493] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.218199 1751 raft_consensus.cc:515] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.219051 1751 leader_election.cc:290] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.219844 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfb98aecc4546c88371436fcfbf8e86" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.220794 1751 raft_consensus.cc:493] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.220991 1751 raft_consensus.cc:515] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:12.221088 986 leader_election.cc:343] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.221782 1751 leader_election.cc:290] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.222391 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53108a2d6c8b4398a568c14df8e0a23e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:12.223199 986 leader_election.cc:343] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.228642 1172 tablet_bootstrap.cc:492] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.229122 1172 ts_tablet_manager.cc:1403] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.003s
I20260617 07:53:12.230010 1172 raft_consensus.cc:359] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.230237 1172 raft_consensus.cc:385] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.230355 1172 raft_consensus.cc:740] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.230643 1172 consensus_queue.cc:260] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.231674 1172 ts_tablet_manager.cc:1434] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:12.231942 1178 tablet_bootstrap.cc:492] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:12.232136 1178 ts_tablet_manager.cc:1403] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.112s user 0.004s sys 0.019s
I20260617 07:53:12.232924 1178 raft_consensus.cc:359] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.233141 1178 raft_consensus.cc:385] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.232743 1172 tablet_bootstrap.cc:492] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.233222 1178 raft_consensus.cc:740] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.233521 1178 consensus_queue.cc:260] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.237229 1178 ts_tablet_manager.cc:1434] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:12.238477 1178 tablet_bootstrap.cc:492] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:12.238744 1172 tablet_bootstrap.cc:654] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.240561 1178 tablet_bootstrap.cc:654] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.249521 1170 raft_consensus.cc:2243] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:12.250128 1170 pending_rounds.cc:70] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:12.250211 1170 pending_rounds.cc:77] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772711413764096 op_type: NO_OP noop_request { }
W20260617 07:53:12.250195 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 85196.8us
I20260617 07:53:12.250324 1170 raft_consensus.cc:2889] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:12.250429 1170 raft_consensus.cc:2272] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:12.251550 852 consensus_peers.cc:597] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:12.251791 852 consensus_peers.cc:597] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:12.253434 1862 ts_tablet_manager.cc:1929] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:12.256601 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21f61a35ca544568bcfca1a6230deca" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:12.258985 1178 tablet_bootstrap.cc:492] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:12.259151 1178 ts_tablet_manager.cc:1403] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.001s
I20260617 07:53:12.259917 1178 raft_consensus.cc:359] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.260093 1178 raft_consensus.cc:385] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.260180 1178 raft_consensus.cc:740] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.260399 1178 consensus_queue.cc:260] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.261272 1172 tablet_bootstrap.cc:492] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.261458 1172 ts_tablet_manager.cc:1403] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.001s
I20260617 07:53:12.262154 1172 raft_consensus.cc:359] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.262358 1172 raft_consensus.cc:385] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.262449 1172 raft_consensus.cc:740] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.262670 1172 consensus_queue.cc:260] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.263121 1172 ts_tablet_manager.cc:1434] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:12.263442 1172 tablet_bootstrap.cc:492] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.265174 1172 tablet_bootstrap.cc:654] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.267498 1178 ts_tablet_manager.cc:1434] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 07:53:12.268682 1178 tablet_bootstrap.cc:492] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:12.270263 1178 tablet_bootstrap.cc:654] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.273244 1172 tablet_bootstrap.cc:492] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.273404 1172 ts_tablet_manager.cc:1403] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.003s
I20260617 07:53:12.274114 1172 raft_consensus.cc:359] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.274286 1172 raft_consensus.cc:385] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.274396 1172 raft_consensus.cc:740] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.274631 1172 consensus_queue.cc:260] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.275211 1172 ts_tablet_manager.cc:1434] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:12.275487 1172 tablet_bootstrap.cc:492] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.277138 1172 tablet_bootstrap.cc:654] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.278895 1178 tablet_bootstrap.cc:492] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:12.279050 1178 ts_tablet_manager.cc:1403] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260617 07:53:12.279974 1178 raft_consensus.cc:359] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.280164 1178 raft_consensus.cc:385] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.280228 1178 raft_consensus.cc:740] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.280458 1178 consensus_queue.cc:260] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.281877 1178 ts_tablet_manager.cc:1434] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260617 07:53:12.282864 1751 raft_consensus.cc:493] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.283015 1751 raft_consensus.cc:515] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.283614 1751 leader_election.cc:290] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.283957 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3275c99834f404f84b96fcc7944cd00" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:12.284453 986 leader_election.cc:343] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.286567 1172 tablet_bootstrap.cc:492] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.286726 1172 ts_tablet_manager.cc:1403] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20260617 07:53:12.287544 1172 raft_consensus.cc:359] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.287755 1172 raft_consensus.cc:385] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.287916 1172 raft_consensus.cc:740] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.288200 1172 consensus_queue.cc:260] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.288676 1172 ts_tablet_manager.cc:1434] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:12.290643 1170 ts_tablet_manager.cc:1916] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:12.294858 1972 consensus_queue.cc:1048] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260617 07:53:12.295296 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d9354c81df42fb9756045e659be26d" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:12.295825 1961 log.cc:927] Time spent T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: Append to log took a long time: real 0.220s user 0.000s sys 0.000s
I20260617 07:53:12.295857 1178 tablet_bootstrap.cc:492] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:12.296355 914 raft_consensus.cc:3060] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.296568 716 leader_election.cc:304] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:12.296880 1849 raft_consensus.cc:2749] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:12.296327 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9db8a986b344548e435b77edc14cb6" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.297937 716 leader_election.cc:304] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:12.298198 1849 raft_consensus.cc:2749] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:12.300004 1171 tablet_bootstrap.cc:654] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.302943 1862 log.cc:1199] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/c7343400555f447b8a1721ba36d7766d
I20260617 07:53:12.303977 1862 ts_tablet_manager.cc:1950] T c7343400555f447b8a1721ba36d7766d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:12.305140 1862 tablet_replica.cc:333] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:12.305372 1178 tablet_bootstrap.cc:654] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.305366 1862 raft_consensus.cc:2243] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:12.305567 1862 raft_consensus.cc:2272] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:12.306139 1862 ts_tablet_manager.cc:1916] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:12.322997 1172 tablet_bootstrap.cc:492] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.324405 1172 tablet_bootstrap.cc:654] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.337662 1172 tablet_bootstrap.cc:492] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.337811 1172 ts_tablet_manager.cc:1403] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.004s
I20260617 07:53:12.338541 1172 raft_consensus.cc:359] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.338696 1172 raft_consensus.cc:385] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.338737 1172 raft_consensus.cc:740] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.338968 1172 consensus_queue.cc:260] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.340117 1751 raft_consensus.cc:493] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.341571 1751 raft_consensus.cc:515] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.342974 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e90ad3b80f24bc7aeb2e92ba5c84b63" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:12.343487 986 leader_election.cc:343] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:12.343498 851 consensus_peers.cc:597] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7e43e1a3df54efe992a86dd0bd0c149. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:12.345150 1751 leader_election.cc:290] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.351457 1172 ts_tablet_manager.cc:1434] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260617 07:53:12.351892 1172 tablet_bootstrap.cc:492] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.354008 1172 tablet_bootstrap.cc:654] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.355072 1170 ts_tablet_manager.cc:1929] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:12.355183 1170 log.cc:1199] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5a547dabaeb742ba941690f4895955bd
I20260617 07:53:12.356069 1846 ts_tablet_manager.cc:1929] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:12.356221 1846 log.cc:1199] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/80f67a6c1dcf4a69842452c371a9c078
I20260617 07:53:12.360661 1178 tablet_bootstrap.cc:492] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
W20260617 07:53:12.363833 716 consensus_peers.cc:597] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:12.365975 1178 ts_tablet_manager.cc:1403] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.082s user 0.005s sys 0.001s
I20260617 07:53:12.367439 1178 raft_consensus.cc:359] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.369191 1178 raft_consensus.cc:385] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.369360 1178 raft_consensus.cc:740] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.369704 1178 consensus_queue.cc:260] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.370632 1172 tablet_bootstrap.cc:492] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.370782 1172 ts_tablet_manager.cc:1403] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
W20260617 07:53:12.371294 851 consensus_peers.cc:597] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:12.372000 1178 ts_tablet_manager.cc:1434] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 07:53:12.372057 1172 raft_consensus.cc:359] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.372231 1172 raft_consensus.cc:385] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.372293 1172 raft_consensus.cc:740] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.372475 1172 consensus_queue.cc:260] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.372951 1172 ts_tablet_manager.cc:1434] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:12.373226 1172 tablet_bootstrap.cc:492] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.374670 1178 tablet_bootstrap.cc:492] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:12.380057 1172 tablet_bootstrap.cc:654] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.386047 1178 tablet_bootstrap.cc:654] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.389043 1657 raft_consensus.cc:697] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:12.389431 1657 consensus_queue.cc:237] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.390867 1997 raft_consensus.cc:493] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.391052 1997 raft_consensus.cc:515] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:12.391690 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 139659us
I20260617 07:53:12.391922 1997 leader_election.cc:290] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.392755 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e05a97a4ab4ed7bff523d1fb1c59ae" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:12.393314 986 leader_election.cc:343] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.394609 1997 raft_consensus.cc:493] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.394732 1997 raft_consensus.cc:515] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.395272 1751 raft_consensus.cc:493] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.395390 1751 raft_consensus.cc:515] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.395767 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464cf1effff241608f4a7255f2646b04" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.395910 1751 leader_election.cc:290] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.396889 1972 raft_consensus.cc:493] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:12.396943 986 leader_election.cc:343] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.395279 1997 leader_election.cc:290] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.397027 1972 raft_consensus.cc:515] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.397459 771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38bb8a140ef4bcab65aaa03bdb79040" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.397567 1972 leader_election.cc:290] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:12.397918 986 leader_election.cc:343] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.398615 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c70f5c41e04ad0b913c15aa315353f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:12.398766 1052 raft_consensus.cc:2468] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:12.399315 851 leader_election.cc:304] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:12.399608 1972 raft_consensus.cc:2804] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:12.399685 1972 raft_consensus.cc:493] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:12.399751 1972 raft_consensus.cc:3060] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.407662 1987 raft_consensus.cc:493] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.407819 1987 raft_consensus.cc:515] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.408496 1987 leader_election.cc:290] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.412812 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b83fda0ce74779b4cca2ffd2a9b903" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:12.413044 1052 raft_consensus.cc:2468] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:12.414100 851 leader_election.cc:304] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:12.415107 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4d21f9ad9543b0b90fc66f1a6e3b13" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.415164 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be14a95f458d440e86133ef65c484571" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.415732 1987 raft_consensus.cc:2804] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:12.415927 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2684f3200e604bb6bf37a2f97a193eff" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.416613 1987 raft_consensus.cc:493] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:12.416693 1987 raft_consensus.cc:3060] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.416882 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.422585 1849 raft_consensus.cc:493] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.422799 1849 raft_consensus.cc:515] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.423636 1849 leader_election.cc:290] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.424078 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ab8e93e3fe475ba9c7b5fce390a8ab" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.424518 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5bbdbcf3044128a4cb274f83d5d29b" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.425201 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5ddac997834e97a2d6c9b1855ee4e8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.425498 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934f5fa0287427cb45fe568f0de8758" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.425637 917 raft_consensus.cc:2468] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:12.425668 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5bbdbcf3044128a4cb274f83d5d29b" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:12.425904 1052 raft_consensus.cc:2393] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6438857e0a7741ceaadf84cb9dc979e7 in current term 1: Already voted for candidate 8b7080d37ca245fe914d3dc90f17e3ba in this term.
I20260617 07:53:12.425873 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f5b567da0e4baab53c00c55923e920" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.426481 713 leader_election.cc:304] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:12.426949 1849 raft_consensus.cc:3060] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.427630 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df37ed81b17d4178adeb6057491b4cc9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.427991 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfb98aecc4546c88371436fcfbf8e86" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.430037 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53108a2d6c8b4398a568c14df8e0a23e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.430862 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3275c99834f404f84b96fcc7944cd00" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.431604 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e90ad3b80f24bc7aeb2e92ba5c84b63" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.433295 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e05a97a4ab4ed7bff523d1fb1c59ae" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.434005 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464cf1effff241608f4a7255f2646b04" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.435604 1178 tablet_bootstrap.cc:492] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:12.435812 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38bb8a140ef4bcab65aaa03bdb79040" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.436751 964 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:12.438115 1178 ts_tablet_manager.cc:1403] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.064s user 0.005s sys 0.000s
I20260617 07:53:12.439724 771 raft_consensus.cc:3060] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.440891 1171 tablet_bootstrap.cc:492] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:12.441116 1171 ts_tablet_manager.cc:1403] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.387s user 0.007s sys 0.007s
I20260617 07:53:12.442202 1171 raft_consensus.cc:359] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.442426 1171 raft_consensus.cc:385] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.442516 1171 raft_consensus.cc:740] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.442795 1171 consensus_queue.cc:260] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.443313 1171 ts_tablet_manager.cc:1434] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:12.443606 1171 tablet_bootstrap.cc:492] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:12.444588 773 raft_consensus.cc:3060] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.446312 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89783bab2e584fe9a8eda963f78bf3ec" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:12.459932 2005 log.cc:927] Time spent T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260617 07:53:12.467624 1172 tablet_bootstrap.cc:492] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.467803 1172 ts_tablet_manager.cc:1403] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.095s user 0.031s sys 0.051s
I20260617 07:53:12.468700 1172 raft_consensus.cc:359] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.468874 1172 raft_consensus.cc:385] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.468928 1172 raft_consensus.cc:740] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.469141 1172 consensus_queue.cc:260] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.469604 1172 ts_tablet_manager.cc:1434] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:12.470710 1172 tablet_bootstrap.cc:492] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.473496 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4d21f9ad9543b0b90fc66f1a6e3b13" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:12.476429 446 consensus_peers.cc:597] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f -> Peer 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505): Couldn't send request to peer 29a94ff9f875443ab6aeac00922cda0d. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260617 07:53:12.477617 1171 tablet_bootstrap.cc:654] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.478785 1846 ts_tablet_manager.cc:1950] T 80f67a6c1dcf4a69842452c371a9c078 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:12.479197 1170 ts_tablet_manager.cc:1950] T 5a547dabaeb742ba941690f4895955bd P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:12.480618 1170 tablet_replica.cc:333] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:12.480788 1170 raft_consensus.cc:2243] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:12.480909 1170 raft_consensus.cc:2272] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:12.481662 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 5a547dabaeb742ba941690f4895955bd (table default.Table_e63db29973b24c64be400ecb2982e867 [id=361b241d29f5458b9bfec6e97c3f37dc]) successfully deleted
I20260617 07:53:12.481963 1172 tablet_bootstrap.cc:654] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:12.482021 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 28e1fd7f91f94221884be2166f0cc793 because the tablet was not found. No further retry: Not found: Tablet not found: 28e1fd7f91f94221884be2166f0cc793
W20260617 07:53:12.482208 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 6ddfb822b5af4bb6b664936c769d9625 because the tablet was not found. No further retry: Not found: Tablet not found: 6ddfb822b5af4bb6b664936c769d9625
I20260617 07:53:12.482506 914 raft_consensus.cc:2468] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:12.482831 1170 ts_tablet_manager.cc:1916] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:12.483201 1999 log.cc:927] Time spent T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260617 07:53:12.487396 716 leader_election.cc:304] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:12.490727 1994 raft_consensus.cc:493] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.490851 1994 raft_consensus.cc:515] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.491024 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet c7343400555f447b8a1721ba36d7766d (table default.Table_b106b0223948469da9ef0246aceeed0d [id=4aac4497cee840e0a0d0c88abfdc229f]) successfully deleted
I20260617 07:53:12.475061 1178 raft_consensus.cc:359] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.491611 1178 raft_consensus.cc:385] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.491699 1178 raft_consensus.cc:740] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.491969 1178 consensus_queue.cc:260] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.494812 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4d21f9ad9543b0b90fc66f1a6e3b13" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:12.496232 770 raft_consensus.cc:3060] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.497025 769 raft_consensus.cc:3060] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.498960 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b83fda0ce74779b4cca2ffd2a9b903" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.499568 1994 leader_election.cc:290] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.500245 988 leader_election.cc:304] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.500881 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c70f5c41e04ad0b913c15aa315353f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:12.501112 988 leader_election.cc:343] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.501221 988 leader_election.cc:304] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.502112 892 tablet_service.cc:1511] Processing CreateTablet for tablet d4afe4a3d708447fa7ab8bf53614c4ba (DEFAULT_TABLE table=default.Table_7074bb8dadc643a6bdbd6cc8f86f4032 [id=28ca3bcf4d34455bb2121bd1a7e1254e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.502689 883 tablet_service.cc:1511] Processing CreateTablet for tablet ed9a99cdcbb74a3fb74654a26716a1c9 (DEFAULT_TABLE table=default.Table_0276ca256ddc491e93325794b1ff6d2f [id=df75990a4b94463f8e92ab98e77b8384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.502810 880 tablet_service.cc:1511] Processing CreateTablet for tablet 3460a7f9f9bf4ea4950f878a56cfc13e (DEFAULT_TABLE table=default.Table_2d4094e6462248ce8997e5c441d4211b [id=b2b609eced484f8e9b6335ee607b8031]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.503232 897 tablet_service.cc:1511] Processing CreateTablet for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (DEFAULT_TABLE table=default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.503690 898 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4a8b06f77643dcb28f0c3136510253 (DEFAULT_TABLE table=default.Table_c35a3ed8e6204960bfd8de4797c65873 [id=57a0963f9a80400db9efabb1af8210fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.504170 887 tablet_service.cc:1511] Processing CreateTablet for tablet cc26e46cd03d47099015ddbac0d17688 (DEFAULT_TABLE table=default.Table_91e4899e1bee4435b0ada003489fc9dd [id=272b65dec17f4d59820fe19f1fdff20c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.504698 894 tablet_service.cc:1511] Processing CreateTablet for tablet 903a8bd5b4bc49d6bb080362e684ee5e (DEFAULT_TABLE table=default.Table_ec014388c38a4b7ebbbb7c1bccde17c5 [id=b76b40fb9dac481f9e3140e1f779ea6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.505189 886 tablet_service.cc:1511] Processing CreateTablet for tablet d2304939c17648a6962f702524aa9b76 (DEFAULT_TABLE table=default.Table_c2ab276e39134bfb97bec45ec6d13aea [id=81a5b37a105e475f8885e6da7da07255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.505510 885 tablet_service.cc:1511] Processing CreateTablet for tablet adbbe7eb5181431290f57ed9128181a3 (DEFAULT_TABLE table=default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.505548 882 tablet_service.cc:1511] Processing CreateTablet for tablet 561c8bf9e5c840628ab1c8cf91dc2d93 (DEFAULT_TABLE table=default.Table_b3c6dc341bb4497186428c46a5d6c0d2 [id=ff0f5a6dbcc04dbd9d2a0a5984f34e63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.506211 879 tablet_service.cc:1511] Processing CreateTablet for tablet ca400838f5214d1a8f57e72c5068f0f9 (DEFAULT_TABLE table=default.Table_e85510ab21154a9d9c9461d1a0491a56 [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.506669 881 tablet_service.cc:1511] Processing CreateTablet for tablet df5224716de249e9be9d7239407579a9 (DEFAULT_TABLE table=default.Table_66b270e872d540d693beb8d8493416ce [id=19b27e1499f246d8aeace932d20e1d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.506996 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:12.507191 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]). Expected version 1 got 0
I20260617 07:53:12.507525 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:12.507720 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:12.507783 884 tablet_service.cc:1511] Processing CreateTablet for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (DEFAULT_TABLE table=default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.507942 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:12.508082 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:12.508383 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:12.508826 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
W20260617 07:53:12.509123 988 raft_consensus.cc:2686] T be14a95f458d440e86133ef65c484571 P dc3bec007846459a9da0c7b8211e477b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 07:53:12.510162 1998 raft_consensus.cc:2749] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:12.510370 1998 consensus_queue.cc:1048] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:12.510162 988 leader_election.cc:343] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.514858 988 leader_election.cc:304] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.515129 1998 raft_consensus.cc:2749] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:12.515311 988 leader_election.cc:343] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.515448 988 leader_election.cc:304] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.515672 1998 raft_consensus.cc:2749] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:12.515923 988 leader_election.cc:343] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.516045 988 leader_election.cc:304] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.516239 1998 raft_consensus.cc:2749] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:12.516367 988 leader_election.cc:343] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.516466 988 leader_election.cc:304] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.516687 1998 raft_consensus.cc:2749] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:12.516814 988 leader_election.cc:304] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:12.517491 1998 raft_consensus.cc:2804] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:12.517581 1998 raft_consensus.cc:493] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:12.517654 1998 raft_consensus.cc:3060] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:12.517858 988 leader_election.cc:343] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.517998 988 leader_election.cc:304] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.518225 1997 raft_consensus.cc:2749] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:12.518533 988 leader_election.cc:343] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.518884 988 leader_election.cc:304] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.519464 1997 raft_consensus.cc:2749] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:12.519835 988 leader_election.cc:343] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.520634 988 leader_election.cc:304] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.527721 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebafc920ed34216be5fb115f9bc6f7f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.527959 914 raft_consensus.cc:2468] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
W20260617 07:53:12.529645 852 leader_election.cc:343] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.529794 852 leader_election.cc:304] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:12.530033 1898 raft_consensus.cc:2749] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:12.535895 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3460a7f9f9bf4ea4950f878a56cfc13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.536113 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbbe7eb5181431290f57ed9128181a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.536556 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a61124fa6f846a6be1a208f2eaa7c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.536537 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:12.536836 1862 ts_tablet_manager.cc:1929] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:12.536931 1862 log.cc:1199] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0dc0676db18c42259efb1ad7dbd140c8
I20260617 07:53:12.537077 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]). Expected version 3 got 0
I20260617 07:53:12.537277 1862 ts_tablet_manager.cc:1950] T 0dc0676db18c42259efb1ad7dbd140c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:12.537443 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 561c8bf9e5c840628ab1c8cf91dc2d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.537842 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5224716de249e9be9d7239407579a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.538193 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2304939c17648a6962f702524aa9b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.538515 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4a8b06f77643dcb28f0c3136510253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.538460 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_91f0347cdea645c393589810a50ca778 [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 1 got 0
I20260617 07:53:12.538657 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_022308372ad4427797e380190f5323b8 [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 4 got 0
I20260617 07:53:12.538854 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_8eb9043c09274769aecb39dee134ba7e [id=9726df7d693441359861876ae1179b4d]). Expected version 3 got 0
I20260617 07:53:12.538955 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903a8bd5b4bc49d6bb080362e684ee5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.539110 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet b7d9354c81df42fb9756045e659be26d (table default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c]). Expected version 2 got 0
I20260617 07:53:12.539413 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.539501 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:12.539809 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9a99cdcbb74a3fb74654a26716a1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.540007 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:12.540202 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc26e46cd03d47099015ddbac0d17688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.540611 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca400838f5214d1a8f57e72c5068f0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.540612 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:12.540963 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4afe4a3d708447fa7ab8bf53614c4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.540905 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]). Expected version 1 got 0
I20260617 07:53:12.542096 1849 raft_consensus.cc:2749] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:12.542320 1849 raft_consensus.cc:2804] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:12.542443 1849 raft_consensus.cc:697] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Running, Role: LEADER
I20260617 07:53:12.542682 1849 consensus_queue.cc:237] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.548848 1972 raft_consensus.cc:515] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.552462 1972 leader_election.cc:290] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.571528 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
I20260617 07:53:12.571779 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e897b111e65c497591c7daaa81d783c7 (table default.Table_9c908cf10c5b4e60bf295dc81294ca83 [id=5a3a690ecbb34b44a83b177bca7926aa]). Expected version 1 got 0
I20260617 07:53:12.572418 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d]). Expected version 2 got 0
I20260617 07:53:12.573181 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:12.574236 1172 tablet_bootstrap.cc:492] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.574383 1172 ts_tablet_manager.cc:1403] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.104s user 0.009s sys 0.005s
I20260617 07:53:12.575189 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]). Expected version 2 got 0
I20260617 07:53:12.575441 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:12.575901 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 2 got 0
I20260617 07:53:12.576082 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:12.576524 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:12.576782 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:12.577100 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 2 got 0
I20260617 07:53:12.577486 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:12.581307 1997 raft_consensus.cc:2749] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:12.581650 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 61776.8us
W20260617 07:53:12.581979 988 leader_election.cc:343] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.582089 988 leader_election.cc:304] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:12.582890 988 leader_election.cc:343] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.582978 988 leader_election.cc:304] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.583247 1997 raft_consensus.cc:2749] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:12.583309 988 leader_election.cc:343] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.583397 988 leader_election.cc:304] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.583423 1997 raft_consensus.cc:2749] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:12.583539 988 raft_consensus.cc:2686] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 07:53:12.583870 1751 consensus_queue.cc:1048] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:12.583941 1172 raft_consensus.cc:359] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.584123 1172 raft_consensus.cc:385] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.584179 1172 raft_consensus.cc:740] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.584380 1172 consensus_queue.cc:260] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.584976 1172 ts_tablet_manager.cc:1434] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260617 07:53:12.585299 1172 tablet_bootstrap.cc:492] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.587718 1172 tablet_bootstrap.cc:654] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.589357 2012 raft_consensus.cc:493] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.589505 2012 raft_consensus.cc:515] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } }
I20260617 07:53:12.590368 2012 leader_election.cc:290] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.592854 1751 raft_consensus.cc:493] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.592988 1751 raft_consensus.cc:515] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.593070 1997 raft_consensus.cc:493] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.593235 1997 raft_consensus.cc:515] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.593571 1751 leader_election.cc:290] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.593693 1751 raft_consensus.cc:493] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.593797 1751 raft_consensus.cc:515] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.593912 1997 leader_election.cc:290] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.594223 1751 leader_election.cc:290] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.594527 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:12.594807 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:12.595022 1998 raft_consensus.cc:515] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.595743 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21]). Expected version 1 got 0
I20260617 07:53:12.595840 1998 leader_election.cc:290] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.596370 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
W20260617 07:53:12.600433 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75f32eb8ec894e029a428bbd62caa0f5 consensus state has no leader
I20260617 07:53:12.600708 453 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 54) took 1218 ms. Trace:
I20260617 07:53:12.600816 453 rpcz_store.cc:276] 0617 07:53:11.382219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.424327 (+ 42108us) service_pool.cc:224] Handling call
0617 07:53:11.429912 (+ 5585us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bfb956 00007f1440659146 00007f1440658e75 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:11.533188 (+103276us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:11.533439 (+ 251us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:11.533638 (+ 199us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:11.533734 (+ 96us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:11.704277 (+170543us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:12.600622 (+896345us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.698958 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.699097 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.699102 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:11.699104 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:11.699206 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.699220 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.699225 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:11.699288 (+ 63us) tablet.cc:701] Row locks acquired
0617 07:53:11.699290 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:11.699328 (+ 38us) write_op.cc:270] Start()
0617 07:53:11.699362 (+ 34us) write_op.cc:276] Timestamp: P: 1781682791699307 usec, L: 0
0617 07:53:11.699366 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.699710 (+ 344us) log.cc:844] Serialized 405 byte log entry
0617 07:53:11.703302 (+ 3592us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.703509 (+ 207us) write_op.cc:301] APPLY: starting
0617 07:53:11.703526 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.703573 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.703601 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.703654 (+ 53us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.703688 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:11.703695 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:11.703773 (+ 78us) log.cc:844] Serialized 23 byte log entry
0617 07:53:11.703835 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.703858 (+ 23us) write_op.cc:454] Released schema lock
0617 07:53:11.703865 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.730372 (+ 26507us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.730382 (+ 10us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":12279040,"child_traces":[["op",{"apply.queue_time_us":155,"apply.run_cpu_time_us":420,"apply.run_wall_time_us":420,"num_ops":1,"prepare.queue_time_us":164778,"prepare.run_cpu_time_us":805,"prepare.run_wall_time_us":31397,"raft.queue_time_us":82,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":226,"replication_time_us":3902}]]}
I20260617 07:53:12.602641 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2da085a4502d4943857234839bbbf9d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.603384 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2da085a4502d4943857234839bbbf9d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.605697 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 737e9344fc824714a2c2596170637158
I20260617 07:53:12.605958 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 121339ab4842432e9fb7bc357750f8ad
I20260617 07:53:12.606859 454 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 56) took 1210 ms. Trace:
I20260617 07:53:12.606989 452 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 65) took 1100 ms. Trace:
I20260617 07:53:12.607115 452 rpcz_store.cc:276] 0617 07:53:11.506677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.841022 (+334345us) service_pool.cc:224] Handling call
0617 07:53:11.897942 (+ 56920us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bfa6b6 00007f1440657486 00007f14406571b5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:11.906043 (+ 8101us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:11.906265 (+ 222us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:11.906340 (+ 75us) catalog_manager.cc:2849] Locking tablets
0617 07:53:12.196749 (+290409us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:12.210611 (+ 13862us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:12.210691 (+ 80us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:12.605871 (+395180us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:12.606939 (+ 1068us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:12.197652 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:12.197810 (+ 158us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:12.197818 (+ 8us) write_op.cc:435] Acquired schema lock
0617 07:53:12.197822 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:12.197955 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:12.197970 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:12.197977 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:12.198116 (+ 139us) tablet.cc:701] Row locks acquired
0617 07:53:12.198120 (+ 4us) write_op.cc:260] PREPARE: finished
0617 07:53:12.198157 (+ 37us) write_op.cc:270] Start()
0617 07:53:12.198191 (+ 34us) write_op.cc:276] Timestamp: P: 1781682792198140 usec, L: 0
0617 07:53:12.198197 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:12.198396 (+ 199us) log.cc:844] Serialized 762 byte log entry
0617 07:53:12.209925 (+ 11529us) op_driver.cc:464] REPLICATION: finished
0617 07:53:12.210090 (+ 165us) write_op.cc:301] APPLY: starting
0617 07:53:12.210106 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:12.210152 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:12.210188 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:12.210249 (+ 61us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:12.210283 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:12.210290 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:12.210360 (+ 70us) log.cc:844] Serialized 29 byte log entry
0617 07:53:12.210412 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:12.210442 (+ 30us) write_op.cc:454] Released schema lock
0617 07:53:12.210448 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:12.210509 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:12.210513 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":123837312,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":412,"apply.run_wall_time_us":411,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":879,"prepare.run_wall_time_us":879,"raft.queue_time_us":396,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":222,"replication_time_us":11697}]]}
I20260617 07:53:12.608134 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:12.608171 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7934f5fa0287427cb45fe568f0de8758 consensus state has no leader
I20260617 07:53:12.608346 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 121339ab4842432e9fb7bc357750f8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:12.608326 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a324b6c42b014d8c97cc1dec8d9d8ca6" } new_table_name: "default.Table_0548ac2c93a44a47b27c0d3e662dd0f2" modify_external_catalogs: true
I20260617 07:53:12.608673 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9c908cf10c5b4e60bf295dc81294ca83" } modify_external_catalogs: true
I20260617 07:53:12.608882 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9c908cf10c5b4e60bf295dc81294ca83" } modify_external_catalogs: true
I20260617 07:53:12.609894 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 596ef68705c84791b54f07e03b219b4c
I20260617 07:53:12.610805 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_55ac8726e90c485f9bf12cacf476e6e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.611449 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55ac8726e90c485f9bf12cacf476e6e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.611964 1172 tablet_bootstrap.cc:492] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.612120 1172 ts_tablet_manager.cc:1403] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260617 07:53:12.612865 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 0be19ece3a0a4a51abad7b8e2f3b2420
I20260617 07:53:12.613440 1172 raft_consensus.cc:359] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.613616 1172 raft_consensus.cc:385] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.613664 1172 raft_consensus.cc:740] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.613679 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8e5edb393db8438abed9a541c820e07a" } new_table_name: "default.Table_0c3bb1ff748948298d93736f1a8583e4" modify_external_catalogs: true
W20260617 07:53:12.614607 988 leader_election.cc:343] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.614729 988 leader_election.cc:304] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.614998 1994 raft_consensus.cc:2749] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:12.615077 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cdf8f714539449d8862cd2a2336fbe9 consensus state has no leader
I20260617 07:53:12.615226 461 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 55) took 1232 ms. Trace:
W20260617 07:53:12.615550 988 leader_election.cc:343] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.615636 988 leader_election.cc:304] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.615392 461 rpcz_store.cc:276] 0617 07:53:11.382352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.427975 (+ 45623us) service_pool.cc:224] Handling call
0617 07:53:11.522577 (+ 94602us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:11.522805 (+ 228us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:11.523035 (+ 230us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:11.523126 (+ 91us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:11.660625 (+137499us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:12.615189 (+954564us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.634401 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.634647 (+ 246us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.634655 (+ 8us) write_op.cc:435] Acquired schema lock
0617 07:53:11.634659 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:11.634776 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.634788 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.634792 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:11.634867 (+ 75us) tablet.cc:701] Row locks acquired
0617 07:53:11.634869 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:11.634904 (+ 35us) write_op.cc:270] Start()
0617 07:53:11.634935 (+ 31us) write_op.cc:276] Timestamp: P: 1781682791634579 usec, L: 0
0617 07:53:11.634938 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.635116 (+ 178us) log.cc:844] Serialized 405 byte log entry
0617 07:53:11.659891 (+ 24775us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.660097 (+ 206us) write_op.cc:301] APPLY: starting
0617 07:53:11.660114 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.660161 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.660195 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.660252 (+ 57us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.660287 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:11.660297 (+ 10us) write_op.cc:312] APPLY: finished
0617 07:53:11.660383 (+ 86us) log.cc:844] Serialized 23 byte log entry
0617 07:53:11.660463 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.660486 (+ 23us) write_op.cc:454] Released schema lock
0617 07:53:11.660493 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.663921 (+ 3428us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.663927 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":146,"apply.run_cpu_time_us":465,"apply.run_wall_time_us":465,"num_ops":1,"prepare.queue_time_us":110745,"prepare.run_cpu_time_us":889,"prepare.run_wall_time_us":29512,"raft.queue_time_us":330,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":274,"replication_time_us":24919}]]}
I20260617 07:53:12.615867 1994 raft_consensus.cc:2749] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:12.616147 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a109162a61eb408c80979471592ad6b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.616671 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a109162a61eb408c80979471592ad6b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:12.616739 988 leader_election.cc:343] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.616833 988 leader_election.cc:304] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:12.617093 1994 raft_consensus.cc:2749] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:12.626112 1172 consensus_queue.cc:260] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.626773 1172 ts_tablet_manager.cc:1434] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260617 07:53:12.627090 1172 tablet_bootstrap.cc:492] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.628932 1172 tablet_bootstrap.cc:654] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.631234 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:12.607036 454 rpcz_store.cc:276] 0617 07:53:11.395955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.520924 (+124969us) service_pool.cc:224] Handling call
0617 07:53:11.545458 (+ 24534us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bfa6b6 00007f1440657486 00007f14406571b5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:11.546009 (+ 551us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:11.546139 (+ 130us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:11.546201 (+ 62us) catalog_manager.cc:2849] Locking tablets
0617 07:53:11.862091 (+315890us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:11.909255 (+ 47164us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:11.909366 (+ 111us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:12.605618 (+696252us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:12.606680 (+ 1062us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.865824 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:11.865940 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:11.865946 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:11.865949 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:11.866082 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:11.866096 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:11.866101 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:11.866218 (+ 117us) tablet.cc:701] Row locks acquired
0617 07:53:11.866222 (+ 4us) write_op.cc:260] PREPARE: finished
0617 07:53:11.866270 (+ 48us) write_op.cc:270] Start()
0617 07:53:11.866309 (+ 39us) write_op.cc:276] Timestamp: P: 1781682791866228 usec, L: 0
0617 07:53:11.866312 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.890835 (+ 24523us) log.cc:844] Serialized 731 byte log entry
0617 07:53:11.891047 (+ 212us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f1441cd3f22 00007f14430b5305 00007f14430b3e29 00007f14430bc250 00007f14430bc05d 0000000000aa681c 00007f1435d0ff6f 00007f1435d1328b 00007f1435d13108 0000000000aa681c
0617 07:53:11.907973 (+ 16926us) op_driver.cc:464] REPLICATION: finished
0617 07:53:11.908635 (+ 662us) write_op.cc:301] APPLY: starting
0617 07:53:11.908657 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:11.908710 (+ 53us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:11.908715 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:11.908799 (+ 84us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:11.908844 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:11.908855 (+ 11us) write_op.cc:312] APPLY: finished
0617 07:53:11.908948 (+ 93us) log.cc:844] Serialized 29 byte log entry
0617 07:53:11.909024 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.909049 (+ 25us) write_op.cc:454] Released schema lock
0617 07:53:11.909059 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:11.909142 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:11.909147 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":55799168,"child_traces":[["op",{"apply.queue_time_us":581,"apply.run_cpu_time_us":502,"apply.run_wall_time_us":502,"num_ops":2,"prepare.queue_time_us":2919,"prepare.run_cpu_time_us":1428,"prepare.run_wall_time_us":25306,"raft.queue_time_us":523,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":359,"replication_time_us":41618,"spinlock_wait_cycles":55867008}]]}
I20260617 07:53:12.631451 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:12.631757 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e33a84b1d8554d62aebbf2f6ffb338d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:12.632298 1994 raft_consensus.cc:493] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:12.632406 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e33a84b1d8554d62aebbf2f6ffb338d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.632417 1994 raft_consensus.cc:515] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.633023 1994 leader_election.cc:290] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.634682 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2ef5d5b6d55d4cd0adc070cfdf8209a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.635195 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ef5d5b6d55d4cd0adc070cfdf8209a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:12.645102 852 consensus_peers.cc:597] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:12.645150 1170 ts_tablet_manager.cc:1929] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:12.645268 1170 log.cc:1199] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/7e90ad3b80f24bc7aeb2e92ba5c84b63
I20260617 07:53:12.645561 1170 ts_tablet_manager.cc:1950] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:12.645818 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 115625us
I20260617 07:53:12.600189 1178 ts_tablet_manager.cc:1434] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.162s user 0.001s sys 0.005s
W20260617 07:53:12.646898 852 leader_election.cc:343] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.650072 1178 tablet_bootstrap.cc:492] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:12.650574 852 leader_election.cc:343] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.650314 1935 raft_consensus.cc:493] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc3bec007846459a9da0c7b8211e477b)
I20260617 07:53:12.651340 1935 raft_consensus.cc:515] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.652298 1935 leader_election.cc:290] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.651161 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 37) took 1090 ms. Trace:
W20260617 07:53:12.653743 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5053b7c24964dee880890fbb803ce7b consensus state has no leader
I20260617 07:53:12.653776 1862 rpcz_store.cc:276] 0617 07:53:11.561202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.561251 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:12.305031 (+743780us) ts_tablet_manager.cc:1151] Deleting tablet 0dc0676db18c42259efb1ad7dbd140c8
0617 07:53:12.305043 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.387190 (+ 82147us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.535936 (+148746us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.651127 (+115191us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":740742}
I20260617 07:53:12.654204 1862 tablet_replica.cc:333] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:12.654382 1862 raft_consensus.cc:2243] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:12.655591 1862 raft_consensus.cc:2272] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:12.656121 1862 ts_tablet_manager.cc:1916] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:12.657033 1987 raft_consensus.cc:515] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.657857 1987 leader_election.cc:290] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.660382 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_77e3d12071b343569fe1fc74b25e5f18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.661096 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77e3d12071b343569fe1fc74b25e5f18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.668028 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9b594fbaf62341f38eab394ea0f77d79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.668767 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b594fbaf62341f38eab394ea0f77d79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.678864 1178 tablet_bootstrap.cc:654] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:12.684249 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 770a5216299842b890d483ca37b0ee86 consensus state has no leader
I20260617 07:53:12.690037 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet e897b111e65c497591c7daaa81d783c7
I20260617 07:53:12.691982 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet e897b111e65c497591c7daaa81d783c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:12.695641 1098 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:12.699047 1994 raft_consensus.cc:493] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.699324 1994 raft_consensus.cc:515] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.700385 1994 leader_election.cc:290] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.703758 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9e7b6c33248348bdba38f8555f67a3d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:12.704685 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_6059c873bed34cf5aad6dc245f4bb700"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:12.705331 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e39af9602cd746f3995e8ccb1f0a95d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.705776 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e39af9602cd746f3995e8ccb1f0a95d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:12.706871 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6059c873bed34cf5aad6dc245f4bb700 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:12.708402 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e7b6c33248348bdba38f8555f67a3d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.716141 1172 tablet_bootstrap.cc:492] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:12.724254 1172 ts_tablet_manager.cc:1403] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.097s user 0.006s sys 0.000s
I20260617 07:53:12.732749 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 74) took 1129 ms. Trace:
I20260617 07:53:12.733947 1170 rpcz_store.cc:276] 0617 07:53:11.603257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.603438 (+ 181us) service_pool.cc:224] Handling call
0617 07:53:12.480573 (+877135us) ts_tablet_manager.cc:1151] Deleting tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
0617 07:53:12.480578 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.540640 (+ 60062us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.645078 (+104438us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.732723 (+ 87645us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":877021}
I20260617 07:53:12.734795 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 (table default.Table_3e98977b52da4e3d825559a506774b17 [id=b7cea59369de444397139db78c303ea5]) successfully deleted
I20260617 07:53:12.735183 1170 tablet_replica.cc:333] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:12.735419 1170 raft_consensus.cc:2243] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:12.735733 1170 pending_rounds.cc:70] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:12.735831 1170 pending_rounds.cc:77] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772712973697024 op_type: NO_OP noop_request { }
I20260617 07:53:12.736006 1170 raft_consensus.cc:2889] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:12.736137 1170 raft_consensus.cc:2272] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:12.736764 1170 ts_tablet_manager.cc:1916] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:12.739264 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 61777.9us
W20260617 07:53:12.740548 852 leader_election.cc:343] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.743893 1987 raft_consensus.cc:493] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.744109 1987 raft_consensus.cc:515] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.744997 1987 leader_election.cc:290] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.748145 1022 tablet_service.cc:1511] Processing CreateTablet for tablet e48c2b2b8d7246ff8466337e104017f4 (DEFAULT_TABLE table=default.Table_b3755d8ef424425f8833079bc13b60f3 [id=cb3692785248483b9029d99aea7ab463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.748739 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 8c76bfcbd22e4bfb97346a1b56f68dab (DEFAULT_TABLE table=default.Table_aa455a7a9315480c83c1505ae065ebcf [id=ed9c0eecb73c4c529138cdb71267fba1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:12.748842 852 leader_election.cc:343] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.750388 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c70f5c41e04ad0b913c15aa315353f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:12.750540 1050 raft_consensus.cc:3060] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.729568 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 46) took 1068 ms. Trace:
I20260617 07:53:12.752256 1846 rpcz_store.cc:276] 0617 07:53:11.661079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.661120 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:12.158867 (+497747us) ts_tablet_manager.cc:1151] Deleting tablet 80f67a6c1dcf4a69842452c371a9c078
0617 07:53:12.158879 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.252319 (+ 93440us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.355948 (+103629us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.729518 (+373570us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":495450}
I20260617 07:53:12.752686 1846 tablet_replica.cc:333] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:12.752876 1846 raft_consensus.cc:2243] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:12.753018 1846 raft_consensus.cc:2272] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:12.753537 1846 ts_tablet_manager.cc:1916] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:12.745335 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 257958us
I20260617 07:53:12.755218 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.755489 918 raft_consensus.cc:2468] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6438857e0a7741ceaadf84cb9dc979e7 in term 1.
I20260617 07:53:12.756325 2010 raft_consensus.cc:493] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:12.756494 2010 raft_consensus.cc:515] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.757484 2010 leader_election.cc:290] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.764037 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2af44d9ab34e4bbea24d6c7d95748b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.764257 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4a3aea221f46d3a7265bd757616bfe" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.764796 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934f5fa0287427cb45fe568f0de8758" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:12.765004 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de030009192748118b388eec555d90da" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.765224 1172 raft_consensus.cc:359] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.765400 1172 raft_consensus.cc:385] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.765455 1172 raft_consensus.cc:740] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.765684 1172 consensus_queue.cc:260] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.766263 1172 ts_tablet_manager.cc:1434] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.032s user 0.001s sys 0.000s
I20260617 07:53:12.766592 1172 tablet_bootstrap.cc:492] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:12.770211 1751 raft_consensus.cc:493] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.770335 1751 raft_consensus.cc:515] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.770565 764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4f9101deaa4e6ebddacbce14f32810" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.770874 1751 leader_election.cc:290] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.775291 1052 raft_consensus.cc:1275] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:12.779738 1172 tablet_bootstrap.cc:654] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.780441 1751 raft_consensus.cc:493] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.780555 1751 raft_consensus.cc:515] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.781136 1751 leader_election.cc:290] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.784518 1171 tablet_bootstrap.cc:492] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:12.784664 1171 ts_tablet_manager.cc:1403] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.341s user 0.005s sys 0.022s
I20260617 07:53:12.785619 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0dc0676db18c42259efb1ad7dbd140c8 (table default.Table_54be22b2fb3540f292a5ffa5ab372d0a [id=fc566654678945ea95c7d40693557ac2]) successfully deleted
I20260617 07:53:12.786697 1171 raft_consensus.cc:359] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.786872 1171 raft_consensus.cc:385] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.786921 1171 raft_consensus.cc:740] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.787094 1171 consensus_queue.cc:260] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.787667 1171 ts_tablet_manager.cc:1434] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:12.788113 1171 tablet_bootstrap.cc:492] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:12.788498 1050 raft_consensus.cc:2468] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:12.789944 1171 tablet_bootstrap.cc:654] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.794368 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48c2b2b8d7246ff8466337e104017f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.795013 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c76bfcbd22e4bfb97346a1b56f68dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.796630 1751 raft_consensus.cc:493] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.796795 1751 raft_consensus.cc:515] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.797583 1751 leader_election.cc:290] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.798856 1171 tablet_bootstrap.cc:492] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:12.799105 1171 ts_tablet_manager.cc:1403] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.003s
I20260617 07:53:12.800083 1171 raft_consensus.cc:359] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.800384 1171 raft_consensus.cc:385] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.800470 1171 raft_consensus.cc:740] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.800758 1171 consensus_queue.cc:260] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.801594 1171 ts_tablet_manager.cc:1434] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:12.802016 1171 tablet_bootstrap.cc:492] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:12.804389 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_30348a000daf4ff5b621f97ed5766bd6" } new_table_name: "default.Table_b485a517852246719a7d540a004646d8" modify_external_catalogs: true
I20260617 07:53:12.807381 1171 tablet_bootstrap.cc:654] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:12.812400 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1382fc75785e4b07bf1688fa5385500a consensus state has no leader
I20260617 07:53:12.814663 1171 tablet_bootstrap.cc:492] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:12.815460 1178 tablet_bootstrap.cc:492] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:12.815460 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:12.818113 1171 ts_tablet_manager.cc:1403] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260617 07:53:12.814868 1862 ts_tablet_manager.cc:1929] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:12.818612 1862 log.cc:1199] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/f030d59f4e124f64bb62d05f0bb0f560
I20260617 07:53:12.819684 1171 raft_consensus.cc:359] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.823702 1178 ts_tablet_manager.cc:1403] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.177s user 0.000s sys 0.004s
I20260617 07:53:12.823714 1171 raft_consensus.cc:385] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.823815 1171 raft_consensus.cc:740] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.824574 1171 consensus_queue.cc:260] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.826515 1171 ts_tablet_manager.cc:1434] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 07:53:12.827677 1862 ts_tablet_manager.cc:1950] T f030d59f4e124f64bb62d05f0bb0f560 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:12.828445 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 40) took 1263 ms. Trace:
I20260617 07:53:12.828608 1862 rpcz_store.cc:276] 0617 07:53:11.564808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.564856 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:12.654154 (+1089298us) ts_tablet_manager.cc:1151] Deleting tablet f030d59f4e124f64bb62d05f0bb0f560
0617 07:53:12.654164 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.733020 (+ 78856us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.814805 (+ 81785us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.828424 (+ 13619us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":945,"tablet-delete.queue_time_us":1088080}
I20260617 07:53:12.829157 1862 tablet_replica.cc:333] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:12.830050 1862 raft_consensus.cc:2243] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:12.831475 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9b594fbaf62341f38eab394ea0f77d79" } modify_external_catalogs: true
I20260617 07:53:12.831673 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9b594fbaf62341f38eab394ea0f77d79" } modify_external_catalogs: true
I20260617 07:53:12.834961 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_da5430a09e3e44e48bafd3678bf638a2" } modify_external_catalogs: true
I20260617 07:53:12.835125 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b485a517852246719a7d540a004646d8" } new_table_name: "default.Table_d4662c1ccdd2449f84a550db4c839b28" modify_external_catalogs: true
I20260617 07:53:12.835237 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_da5430a09e3e44e48bafd3678bf638a2" } modify_external_catalogs: true
I20260617 07:53:12.835979 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_aa455a7a9315480c83c1505ae065ebcf" } new_table_name: "default.Table_3b87923865964ae78caae0e8d9231e27" modify_external_catalogs: true
I20260617 07:53:12.836582 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_fc5f3ba5ab8a45c7bab81747fe42b662" } modify_external_catalogs: true
I20260617 07:53:12.836818 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_fc5f3ba5ab8a45c7bab81747fe42b662" } modify_external_catalogs: true
I20260617 07:53:12.839295 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 80f67a6c1dcf4a69842452c371a9c078 (table default.Table_b5d4a0688a8d434ca0fa18d5b7bbde35 [id=0552acfce4294af484ccd1f88c42c4cb]) successfully deleted
I20260617 07:53:12.841877 1170 ts_tablet_manager.cc:1929] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:12.842046 1170 log.cc:1199] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:12.842448 1170 ts_tablet_manager.cc:1950] T 9cddb9e82c354f26b3abe56ebdefd008 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:12.842502 1862 pending_rounds.cc:70] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:12.842757 1862 pending_rounds.cc:77] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772709362130944 op_type: NO_OP noop_request { }
I20260617 07:53:12.842869 1862 raft_consensus.cc:2889] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:12.842931 453 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 659f920e8beb4d509b6e4bcc99ba5cbf
I20260617 07:53:12.842975 1862 raft_consensus.cc:2272] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:12.842985 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebafc920ed34216be5fb115f9bc6f7f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.843442 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b4e56877f98d44cf897d768d1058f5d5" } modify_external_catalogs: true
I20260617 07:53:12.843640 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b4e56877f98d44cf897d768d1058f5d5" } modify_external_catalogs: true
I20260617 07:53:12.843721 1862 ts_tablet_manager.cc:1916] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:12.845626 2010 raft_consensus.cc:493] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.845839 2010 raft_consensus.cc:515] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.846537 2010 leader_election.cc:290] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.846701 2010 raft_consensus.cc:493] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.846818 2010 raft_consensus.cc:515] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.847406 2010 leader_election.cc:290] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.847548 2010 raft_consensus.cc:493] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.847693 2010 raft_consensus.cc:515] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.848241 2010 leader_election.cc:290] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:12.850108 1171 tablet_bootstrap.cc:492] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:12.850407 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ae1e189a64da6bad10156b401ec46" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.850821 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b83fda0ce74779b4cca2ffd2a9b903" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:12.851017 1050 raft_consensus.cc:3060] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.852347 1171 tablet_bootstrap.cc:654] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.853961 1050 raft_consensus.cc:2468] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:12.855255 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1382fc75785e4b07bf1688fa5385500a consensus state has no leader
I20260617 07:53:12.854892 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:12.858268 770 raft_consensus.cc:3060] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:12.858676 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_44474dc1c911457d832d458ce32ec14c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.859364 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44474dc1c911457d832d458ce32ec14c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.866211 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706373f1f5d44edf81ed04183a8bdf89" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.866613 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d657fbccb4af40558033a971aab7f3e4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.866645 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a547dabaeb742ba941690f4895955bd" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.866833 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 4de8df5e15cb43c0b95ec5af3110db66
I20260617 07:53:12.867285 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ce60b466f7420992ef194d72b5718d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:12.867574 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 71e8f7118aaf4c6a9b9caab5abc030fa from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:12.867818 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 121339ab4842432e9fb7bc357750f8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:12.868872 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:12.871618 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:12.872355 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:12.872800 741 tablet_service.cc:1558] Processing DeleteTablet for tablet e897b111e65c497591c7daaa81d783c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:12.873785 741 tablet_service.cc:1511] Processing CreateTablet for tablet 8c76bfcbd22e4bfb97346a1b56f68dab (DEFAULT_TABLE table=default.Table_aa455a7a9315480c83c1505ae065ebcf [id=ed9c0eecb73c4c529138cdb71267fba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.874270 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c76bfcbd22e4bfb97346a1b56f68dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.879084 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 99ec78c123d448329b8442a0de0140d3
I20260617 07:53:12.882014 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ec78c123d448329b8442a0de0140d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:12.883539 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9937bd83b783442697ef53db3d660fb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.884243 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9937bd83b783442697ef53db3d660fb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.890798 1171 tablet_bootstrap.cc:492] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:12.891860 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c76bfcbd22e4bfb97346a1b56f68dab consensus state has no leader
I20260617 07:53:12.894069 1171 ts_tablet_manager.cc:1403] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.002s
I20260617 07:53:12.825529 1846 ts_tablet_manager.cc:1929] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:12.895015 1846 log.cc:1199] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/82cf9c672f3b4567b63e878a6ab11334
I20260617 07:53:12.895133 1171 raft_consensus.cc:359] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.895362 1171 raft_consensus.cc:385] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.895437 1171 raft_consensus.cc:740] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.895696 1171 consensus_queue.cc:260] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.895816 1846 ts_tablet_manager.cc:1950] T 82cf9c672f3b4567b63e878a6ab11334 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:12.896315 1171 ts_tablet_manager.cc:1434] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:12.896656 1171 tablet_bootstrap.cc:492] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:12.897244 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 47) took 1235 ms. Trace:
I20260617 07:53:12.897447 1846 rpcz_store.cc:276] 0617 07:53:11.661402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.661441 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:12.752620 (+1091179us) ts_tablet_manager.cc:1151] Deleting tablet 82cf9c672f3b4567b63e878a6ab11334
0617 07:53:12.752630 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.788938 (+ 36308us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.825444 (+ 36506us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.897056 (+ 71612us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1090990}
I20260617 07:53:12.898063 1846 tablet_replica.cc:333] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:12.898279 986 leader_election.cc:343] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.898568 1846 raft_consensus.cc:2243] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:12.898679 986 leader_election.cc:343] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.899757 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_022308372ad4427797e380190f5323b8" } new_table_name: "default.Table_1349be0f5c284db08f696236a83d4fcd" modify_external_catalogs: true
I20260617 07:53:12.905292 1862 ts_tablet_manager.cc:1929] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:12.905436 1862 log.cc:1199] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d7309d2b22c849ce980fd263a29ac77f
I20260617 07:53:12.906397 2049 tablet.cc:1724] T 763581e2baeb46149bfb38d81301b9c5 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:12.906952 1862 ts_tablet_manager.cc:1950] T d7309d2b22c849ce980fd263a29ac77f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:12.907866 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 1f6264adc3994c22864ea73106ba2320
I20260617 07:53:12.907356 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 41) took 1340 ms. Trace:
I20260617 07:53:12.908358 1862 rpcz_store.cc:276] 0617 07:53:11.566582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.566630 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:12.829098 (+1262468us) ts_tablet_manager.cc:1151] Deleting tablet d7309d2b22c849ce980fd263a29ac77f
0617 07:53:12.829110 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.848244 (+ 19134us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.905205 (+ 56961us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.907338 (+ 2133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1258712}
I20260617 07:53:12.908914 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 42) took 1336 ms. Trace:
I20260617 07:53:12.909021 1862 rpcz_store.cc:276] 0617 07:53:11.572180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.572227 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:12.908755 (+1336528us) ts_tablet_manager.cc:1151] Deleting tablet 630e540a77374c11895ab5a0e394b3bb
0617 07:53:12.908768 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.908897 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1336232}
I20260617 07:53:12.909333 1862 tablet_replica.cc:333] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:12.909555 1862 raft_consensus.cc:2243] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:12.909755 1862 raft_consensus.cc:2272] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:12.909989 986 leader_election.cc:343] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.910274 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:12.910348 986 leader_election.cc:343] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.910416 1862 ts_tablet_manager.cc:1916] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:12.910658 986 leader_election.cc:343] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:12.910977 986 leader_election.cc:343] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.911540 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b7746239c54ab6828299968d18628d" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.912741 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e43e1a3df54efe992a86dd0bd0c149" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.913302 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_27991162221746b7a1f8513217cc15e8" } new_table_name: "default.Table_73a149c5190c4fe38934f947932e0d6c" modify_external_catalogs: true
I20260617 07:53:12.914188 1780 consensus_queue.cc:1048] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:12.923949 1171 tablet_bootstrap.cc:654] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.924172 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1669fc1629774d918c478aa955e8df7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.925158 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1669fc1629774d918c478aa955e8df7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.927543 1846 raft_consensus.cc:2272] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:12.929203 1846 ts_tablet_manager.cc:1916] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:12.929066 1856 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 07:53:12.929550 1856 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 07:53:12.929765 1856 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260617 07:53:12.930787 1171 tablet_bootstrap.cc:492] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:12.930931 1171 ts_tablet_manager.cc:1403] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.004s
I20260617 07:53:12.931620 1171 raft_consensus.cc:359] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.931763 1171 raft_consensus.cc:385] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.931810 1171 raft_consensus.cc:740] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.932017 1171 consensus_queue.cc:260] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.934764 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 71e8f7118aaf4c6a9b9caab5abc030fa
I20260617 07:53:12.935305 452 catalog_manager.cc:6784] ReplaceTablet: tablet 71e8f7118aaf4c6a9b9caab5abc030fa deleted and replaced by tablet 52af94bd46c941b8a27136ca0506e744
I20260617 07:53:12.937057 1171 ts_tablet_manager.cc:1434] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:12.937338 1171 tablet_bootstrap.cc:492] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:12.937356 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa with delete_type TABLET_DATA_DELETED (replaced by tablet 52af94bd46c941b8a27136ca0506e744) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:12.938591 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3edd5bcee7e04d8c8974fe2880a5d2d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:12.939237 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3edd5bcee7e04d8c8974fe2880a5d2d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:12.939383 1171 tablet_bootstrap.cc:654] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:12.940089 1751 raft_consensus.cc:493] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.940232 1751 raft_consensus.cc:515] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.940899 1751 leader_election.cc:290] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:12.943255 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 75) took 1339 ms. Trace:
I20260617 07:53:12.943583 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:12.944566 851 leader_election.cc:304] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:12.944921 1987 raft_consensus.cc:2804] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:12.945206 1987 raft_consensus.cc:697] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:12.945536 1987 consensus_queue.cc:237] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.901139 741 tablet_service.cc:1511] Processing CreateTablet for tablet e48c2b2b8d7246ff8466337e104017f4 (DEFAULT_TABLE table=default.Table_b3755d8ef424425f8833079bc13b60f3 [id=cb3692785248483b9029d99aea7ab463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.924860 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:12.941985 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ec78c123d448329b8442a0de0140d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:12.946054 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48c2b2b8d7246ff8466337e104017f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:12.947788 1856 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260617 07:53:12.947937 1856 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 07:53:12.948057 1856 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 07:53:12.948159 1856 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 07:53:12.948415 1178 raft_consensus.cc:359] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.948698 1178 raft_consensus.cc:385] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.948827 1178 raft_consensus.cc:740] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.952556 1862 ts_tablet_manager.cc:1929] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:12.952682 1862 log.cc:1199] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/82cf9c672f3b4567b63e878a6ab11334
I20260617 07:53:12.953011 1862 ts_tablet_manager.cc:1950] T 82cf9c672f3b4567b63e878a6ab11334 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:12.953315 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 43) took 1379 ms. Trace:
I20260617 07:53:12.953395 1862 rpcz_store.cc:276] 0617 07:53:11.573701 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.573765 (+ 64us) service_pool.cc:224] Handling call
0617 07:53:12.909284 (+1335519us) ts_tablet_manager.cc:1151] Deleting tablet 82cf9c672f3b4567b63e878a6ab11334
0617 07:53:12.909294 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.940909 (+ 31615us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.952495 (+ 11586us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.953298 (+ 803us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1335174}
W20260617 07:53:12.954746 716 leader_election.cc:343] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 69996eb4ab6e40f9b2d97e00d766822a
I20260617 07:53:12.955082 716 leader_election.cc:304] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters:
I20260617 07:53:12.960783 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:12.961205 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 121339ab4842432e9fb7bc357750f8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:12.961541 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:12.961759 1171 tablet_bootstrap.cc:492] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:12.961898 1171 ts_tablet_manager.cc:1403] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260617 07:53:12.961875 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:12.962122 895 tablet_service.cc:1558] Processing DeleteTablet for tablet e897b111e65c497591c7daaa81d783c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:12.963177 1171 raft_consensus.cc:359] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.963343 1171 raft_consensus.cc:385] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:12.963407 1171 raft_consensus.cc:740] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:12.967357 1856 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:37851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:36505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.189
--webserver_port=38635
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 17 Jun 2026 07:43:25 UTC on bdcb31816ec0
build id 12434
ASAN enabled
I20260617 07:53:12.968624 1898 consensus_queue.cc:1048] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:12.969794 1856 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 07:53:12.970372 851 leader_election.cc:304] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:12.970656 1898 raft_consensus.cc:2804] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:12.970791 1898 raft_consensus.cc:697] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:12.971048 1898 consensus_queue.cc:237] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:12.972368 1856 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260617 07:53:12.965637 1171 consensus_queue.cc:260] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.974076 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df705c2300064db680bec1fefab08d2f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:12.974274 918 raft_consensus.cc:2393] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6438857e0a7741ceaadf84cb9dc979e7 in current term 1: Already voted for candidate dc3bec007846459a9da0c7b8211e477b in this term.
I20260617 07:53:12.974750 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 44) took 1399 ms. Trace:
I20260617 07:53:12.975530 1862 rpcz_store.cc:276] 0617 07:53:11.575108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.600799 (+ 25691us) service_pool.cc:224] Handling call
0617 07:53:12.953675 (+1352876us) ts_tablet_manager.cc:1151] Deleting tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
0617 07:53:12.953685 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.974735 (+ 21050us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1350521}
I20260617 07:53:12.976063 1862 tablet_replica.cc:333] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:12.976460 1862 raft_consensus.cc:2243] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:12.976909 1862 raft_consensus.cc:2272] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:12.976994 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_66b270e872d540d693beb8d8493416ce" } modify_external_catalogs: true
I20260617 07:53:12.975394 1171 ts_tablet_manager.cc:1434] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260617 07:53:12.977224 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_66b270e872d540d693beb8d8493416ce" } modify_external_catalogs: true
I20260617 07:53:12.977532 1171 tablet_bootstrap.cc:492] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:12.980780 1862 ts_tablet_manager.cc:1916] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:12.985832 851 leader_election.cc:343] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: cb95639e16ed423fbe60b15a1bcdf5a6
W20260617 07:53:12.954278 986 leader_election.cc:343] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.987766 1171 tablet_bootstrap.cc:654] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:12.987821 986 leader_election.cc:343] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:12.988024 986 leader_election.cc:343] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:12.988197 986 leader_election.cc:343] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:12.988672 1020 tablet_service.cc:1511] Processing CreateTablet for tablet c6cbfa2a77d848fa924d633727e88618 (DEFAULT_TABLE table=default.Table_cff9a95917094a97b6cbcaf1fdabdc2a [id=bb5bdf2a707c4003af418f0264a08fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.989080 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6cbfa2a77d848fa924d633727e88618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:12.987017 1751 raft_consensus.cc:493] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:12.995296 1751 raft_consensus.cc:515] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:12.996141 1751 leader_election.cc:290] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:12.996508 2056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:53:12.996748 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 37b36c91191445478055b78830be9450 (DEFAULT_TABLE table=default.Table_21f38a23f6964cf1acdf47d110725c9a [id=e4997acdbb904f3abc0044fd11805379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:12.997295 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37b36c91191445478055b78830be9450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.004406 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9656e092de4f6e9858d387428fed39 (DEFAULT_TABLE table=default.Table_dc82c567bed447868fae8b372c777c13 [id=9407e61b12e845c884427dedab2065d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.004849 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9656e092de4f6e9858d387428fed39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.004923 2023 raft_consensus.cc:2804] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 07:53:13.005056 2023 raft_consensus.cc:493] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc3bec007846459a9da0c7b8211e477b)
W20260617 07:53:13.005743 2058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:53:13.007697 2061 tablet.cc:1724] T 62b7746239c54ab6828299968d18628d P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:13.009963 1171 tablet_bootstrap.cc:492] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.010125 1171 ts_tablet_manager.cc:1403] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260617 07:53:13.014518 895 tablet_service.cc:1511] Processing CreateTablet for tablet 8c76bfcbd22e4bfb97346a1b56f68dab (DEFAULT_TABLE table=default.Table_aa455a7a9315480c83c1505ae065ebcf [id=ed9c0eecb73c4c529138cdb71267fba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.011132 1171 raft_consensus.cc:359] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.014899 1171 raft_consensus.cc:385] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.014957 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c76bfcbd22e4bfb97346a1b56f68dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.014981 1171 raft_consensus.cc:740] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:13.017514 2063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:53:13.017882 1171 consensus_queue.cc:260] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.020534 2061 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:34090 (request call id 33) took 1595 ms. Trace:
I20260617 07:53:13.020748 2061 rpcz_store.cc:276] 0617 07:53:11.425438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.426936 (+ 1498us) service_pool.cc:224] Handling call
0617 07:53:13.020515 (+1593579us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:11.440329 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0617 07:53:11.440526 (+ 197us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0617 07:53:11.440535 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0617 07:53:11.440542 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0617 07:53:11.440585 (+ 43us) alter_schema_op.cc:128] START. Timestamp: 1781682791440548
0617 07:53:11.440588 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:11.440911 (+ 323us) log.cc:844] Serialized 173 byte log entry
0617 07:53:13.007271 (+1566360us) op_driver.cc:464] REPLICATION: finished
0617 07:53:13.007671 (+ 400us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0617 07:53:13.008119 (+ 448us) log.cc:844] Serialized 5 byte log entry
0617 07:53:13.016960 (+ 8841us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.017210 (+ 250us) log.cc:844] Serialized 14 byte log entry
0617 07:53:13.020474 (+ 3264us) alter_schema_op.cc:73] Released schema lock
0617 07:53:13.020479 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":337,"prepare.queue_time_us":596,"prepare.run_cpu_time_us":5014,"prepare.run_wall_time_us":19112,"raft.queue_time_us":44,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":1566636,"thread_start_us":19136,"threads_started":2,"wal-append.queue_time_us":20190,"wal-append.run_cpu_time_us":604,"wal-append.run_wall_time_us":1006332}]]}
I20260617 07:53:13.022053 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.022763 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ec78c123d448329b8442a0de0140d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.023093 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.023836 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa with delete_type TABLET_DATA_DELETED (replaced by tablet 52af94bd46c941b8a27136ca0506e744) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.023885 1171 ts_tablet_manager.cc:1434] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260617 07:53:13.024191 1171 tablet_bootstrap.cc:492] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.024320 883 tablet_service.cc:1511] Processing CreateTablet for tablet 37b36c91191445478055b78830be9450 (DEFAULT_TABLE table=default.Table_21f38a23f6964cf1acdf47d110725c9a [id=e4997acdbb904f3abc0044fd11805379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.024691 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37b36c91191445478055b78830be9450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.025905 1171 tablet_bootstrap.cc:654] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.025802 1170 rpcz_store.cc:276] 0617 07:53:11.603738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.603786 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:12.735134 (+1131348us) ts_tablet_manager.cc:1151] Deleting tablet 9cddb9e82c354f26b3abe56ebdefd008
0617 07:53:12.735145 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.810686 (+ 75541us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.841813 (+ 31127us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:12.943236 (+101423us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1131213}
I20260617 07:53:13.026033 1862 ts_tablet_manager.cc:1929] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.026132 1862 log.cc:1199] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/6ddfb822b5af4bb6b664936c769d9625
I20260617 07:53:13.026401 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 9cddb9e82c354f26b3abe56ebdefd008 (table default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]) successfully deleted
I20260617 07:53:13.026582 1862 ts_tablet_manager.cc:1950] T 6ddfb822b5af4bb6b664936c769d9625 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.027313 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 46) took 1415 ms. Trace:
I20260617 07:53:13.027406 1862 rpcz_store.cc:276] 0617 07:53:11.611808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.611861 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:12.976020 (+1364159us) ts_tablet_manager.cc:1151] Deleting tablet 6ddfb822b5af4bb6b664936c769d9625
0617 07:53:12.976029 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.984740 (+ 8711us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.025939 (+ 41199us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.027296 (+ 1357us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1363878}
I20260617 07:53:13.027740 1862 tablet_replica.cc:333] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.027900 1862 raft_consensus.cc:2243] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:13.028139 1862 raft_consensus.cc:2272] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.028889 1862 ts_tablet_manager.cc:1916] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:13.029241 854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260617 07:53:13.030469 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 54) took 1439 ms. Trace:
I20260617 07:53:13.030611 1170 rpcz_store.cc:276] 0617 07:53:11.591134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.603994 (+ 12860us) service_pool.cc:224] Handling call
0617 07:53:13.030334 (+1426340us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:13.030344 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.030449 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1426212}
W20260617 07:53:13.031284 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65bf5384ec244d36ba3d4e781c5eb8a3 already in progress: creating tablet
I20260617 07:53:13.031458 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 59) took 1432 ms. Trace:
I20260617 07:53:13.031595 1170 rpcz_store.cc:276] 0617 07:53:11.598765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.604257 (+ 5492us) service_pool.cc:224] Handling call
0617 07:53:13.031264 (+1427007us) ts_tablet_manager.cc:1151] Deleting tablet 84f498f551ff4767bd16628b03f55ae2
0617 07:53:13.031276 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.031373 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1426822}
W20260617 07:53:13.032049 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 84f498f551ff4767bd16628b03f55ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84f498f551ff4767bd16628b03f55ae2 already in progress: creating tablet
I20260617 07:53:13.033653 1856 server_base.cc:1061] running on GCE node
I20260617 07:53:13.034071 2023 raft_consensus.cc:3060] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:13.034703 1856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 07:53:13.035386 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_6b3ef645c2e84944a54aafdcf255ab13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:13.036192 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b3ef645c2e84944a54aafdcf255ab13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.040623 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.040865 1171 tablet_bootstrap.cc:492] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.040951 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.040987 1862 ts_tablet_manager.cc:1929] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.040990 1171 ts_tablet_manager.cc:1403] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260617 07:53:13.041067 880 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.041281 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.041397 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.041560 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 950c1c44020a4586b3197f5f68a38963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.041730 880 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.041814 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.042084 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.042025 1171 raft_consensus.cc:359] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.042233 1171 raft_consensus.cc:385] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.042310 1171 raft_consensus.cc:740] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.042568 1171 consensus_queue.cc:260] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.043181 1171 ts_tablet_manager.cc:1434] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:13.043507 1171 tablet_bootstrap.cc:492] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.046033 1856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 07:53:13.045706 1171 tablet_bootstrap.cc:654] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.048058 883 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9656e092de4f6e9858d387428fed39 (DEFAULT_TABLE table=default.Table_dc82c567bed447868fae8b372c777c13 [id=9407e61b12e845c884427dedab2065d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.048483 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9656e092de4f6e9858d387428fed39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.041079 1862 log.cc:1199] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5a547dabaeb742ba941690f4895955bd
I20260617 07:53:13.048916 1862 ts_tablet_manager.cc:1950] T 5a547dabaeb742ba941690f4895955bd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.049604 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 47) took 1437 ms. Trace:
I20260617 07:53:13.049693 1862 rpcz_store.cc:276] 0617 07:53:11.612291 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.612335 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:13.027701 (+1415366us) ts_tablet_manager.cc:1151] Deleting tablet 5a547dabaeb742ba941690f4895955bd
0617 07:53:13.027709 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.032140 (+ 4431us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.040939 (+ 8799us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.049587 (+ 8648us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1415185}
I20260617 07:53:13.049888 1856 hybrid_clock.cc:648] HybridClock initialized: now 1781682793049794 us; error 88 us; skew 500 ppm
I20260617 07:53:13.050103 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 48) took 1437 ms. Trace:
I20260617 07:53:13.050171 1862 rpcz_store.cc:276] 0617 07:53:11.612667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.612707 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:13.049988 (+1437281us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:13.049998 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.050089 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1437099}
I20260617 07:53:13.050333 1856 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 07:53:13.051146 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 49) took 1438 ms. Trace:
I20260617 07:53:13.051214 1862 rpcz_store.cc:276] 0617 07:53:11.613016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.613074 (+ 58us) service_pool.cc:224] Handling call
0617 07:53:13.050387 (+1437313us) ts_tablet_manager.cc:1151] Deleting tablet 51e757e6f4ce4c6eb8223c4b6955245e
0617 07:53:13.050394 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.051132 (+ 738us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1437159}
I20260617 07:53:13.051756 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 52) took 1437 ms. Trace:
I20260617 07:53:13.051819 1862 rpcz_store.cc:276] 0617 07:53:11.614272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.614315 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:13.051416 (+1437101us) ts_tablet_manager.cc:1151] Deleting tablet 2f8cd6ff8fa44536acdd84a107ab1525
0617 07:53:13.051427 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.051741 (+ 314us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1436914}
I20260617 07:53:13.052155 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 53) took 1437 ms. Trace:
I20260617 07:53:13.052232 1862 rpcz_store.cc:276] 0617 07:53:11.614625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.614664 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:13.052061 (+1437397us) ts_tablet_manager.cc:1151] Deleting tablet 36ce60b466f7420992ef194d72b5718d
0617 07:53:13.052069 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.052141 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1437212}
I20260617 07:53:13.052466 1862 tablet_replica.cc:333] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.052670 1862 raft_consensus.cc:2243] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:13.053012 1862 raft_consensus.cc:2272] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.053485 895 tablet_service.cc:1511] Processing CreateTablet for tablet e48c2b2b8d7246ff8466337e104017f4 (DEFAULT_TABLE table=default.Table_b3755d8ef424425f8833079bc13b60f3 [id=cb3692785248483b9029d99aea7ab463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.053874 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48c2b2b8d7246ff8466337e104017f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:13.058324 458 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:46601 (request call id 213) took 1640 ms (client timeout 1000 ms). Trace:
I20260617 07:53:13.058827 1172 tablet_bootstrap.cc:492] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:13.059003 1172 ts_tablet_manager.cc:1403] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.292s user 0.017s sys 0.019s
I20260617 07:53:13.060022 1998 raft_consensus.cc:493] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.060178 1998 raft_consensus.cc:515] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.061058 1998 leader_election.cc:290] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.061299 1862 ts_tablet_manager.cc:1916] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.061961 988 leader_election.cc:304] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:13.062252 1998 raft_consensus.cc:2804] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.062400 1998 raft_consensus.cc:493] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.062564 1998 raft_consensus.cc:3060] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.063562 1171 tablet_bootstrap.cc:492] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.063681 1171 ts_tablet_manager.cc:1403] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260617 07:53:13.064375 1171 raft_consensus.cc:359] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.064535 1171 raft_consensus.cc:385] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.064590 1171 raft_consensus.cc:740] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.064803 1171 consensus_queue.cc:260] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.065346 1171 ts_tablet_manager.cc:1434] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:13.065595 1171 tablet_bootstrap.cc:492] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.065689 1998 raft_consensus.cc:515] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.066354 1998 leader_election.cc:290] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.067082 1171 tablet_bootstrap.cc:654] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.067175 1178 consensus_queue.cc:260] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.069605 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_94e77b59e906420289e6014bb64dd340"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:13.070312 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94e77b59e906420289e6014bb64dd340 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.071764 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa with delete_type TABLET_DATA_DELETED (replaced by tablet 52af94bd46c941b8a27136ca0506e744) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.073851 1178 ts_tablet_manager.cc:1434] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.242s user 0.001s sys 0.001s
I20260617 07:53:13.074293 1178 tablet_bootstrap.cc:492] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:13.075615 1171 tablet_bootstrap.cc:492] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.075752 1171 ts_tablet_manager.cc:1403] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260617 07:53:13.076483 1171 raft_consensus.cc:359] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.076665 1171 raft_consensus.cc:385] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.076738 1171 raft_consensus.cc:740] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.076975 1171 consensus_queue.cc:260] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.077399 1172 raft_consensus.cc:359] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.077543 1171 ts_tablet_manager.cc:1434] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:13.077831 1171 tablet_bootstrap.cc:492] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.079097 1172 raft_consensus.cc:385] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.079349 1172 raft_consensus.cc:740] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.079794 2050 tablet.cc:1724] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:13.080240 1171 tablet_bootstrap.cc:654] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.078613 2011 raft_consensus.cc:493] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.081367 1862 ts_tablet_manager.cc:1929] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.081497 1862 log.cc:1199] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/82d682ae37d74b4b967da0f8e2de6301
I20260617 07:53:13.081974 1862 ts_tablet_manager.cc:1950] T 82d682ae37d74b4b967da0f8e2de6301 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.082186 1172 consensus_queue.cc:260] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.082844 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 54) took 1467 ms. Trace:
I20260617 07:53:13.082957 1862 rpcz_store.cc:276] 0617 07:53:11.614971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.615012 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:13.052429 (+1437417us) ts_tablet_manager.cc:1151] Deleting tablet 82d682ae37d74b4b967da0f8e2de6301
0617 07:53:13.052438 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.070292 (+ 17854us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.081316 (+ 11024us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.082784 (+ 1468us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1437268}
I20260617 07:53:13.083340 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 55) took 1459 ms. Trace:
I20260617 07:53:13.083426 1862 rpcz_store.cc:276] 0617 07:53:11.623602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.623656 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:13.083200 (+1459544us) ts_tablet_manager.cc:1151] Deleting tablet 8a4f81daf583464e988521e189ca39b6
0617 07:53:13.083208 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.083294 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1459324}
I20260617 07:53:13.083735 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 56) took 1459 ms. Trace:
I20260617 07:53:13.083817 1862 rpcz_store.cc:276] 0617 07:53:11.624042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.624082 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:13.083620 (+1459538us) ts_tablet_manager.cc:1151] Deleting tablet 66140c5d364f453a8089f143cc96ede8
0617 07:53:13.083627 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.083691 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1459370}
I20260617 07:53:13.084081 1862 tablet_replica.cc:333] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.085515 1862 raft_consensus.cc:2243] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:13.085589 1170 tablet_replica.cc:333] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:13.085801 1170 raft_consensus.cc:2243] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.085831 1862 raft_consensus.cc:2272] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.085968 1170 raft_consensus.cc:2272] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.086488 1170 ts_tablet_manager.cc:1916] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.086520 1862 ts_tablet_manager.cc:1916] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.087023 1856 webserver.cc:533] Webserver started at http://127.0.105.189:38635/ using document root <none> and password file <none>
I20260617 07:53:13.088344 1856 fs_manager.cc:362] Metadata directory not provided
I20260617 07:53:13.088536 1856 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 07:53:13.090739 1171 tablet_bootstrap.cc:492] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.090920 1171 ts_tablet_manager.cc:1403] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260617 07:53:13.091696 1171 raft_consensus.cc:359] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.092067 1171 raft_consensus.cc:385] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.092163 1171 raft_consensus.cc:740] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.092679 1171 consensus_queue.cc:260] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.093197 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4f9101deaa4e6ebddacbce14f32810" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.093171 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2af44d9ab34e4bbea24d6c7d95748b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.094188 1171 ts_tablet_manager.cc:1434] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:13.094506 1171 tablet_bootstrap.cc:492] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.096058 1171 tablet_bootstrap.cc:654] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.098268 769 raft_consensus.cc:3060] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.099387 1862 ts_tablet_manager.cc:1929] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.099509 1862 log.cc:1199] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0c21efcad98348ebabcee4821dc4682e
I20260617 07:53:13.099881 1862 ts_tablet_manager.cc:1950] T 0c21efcad98348ebabcee4821dc4682e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.100626 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 57) took 1476 ms. Trace:
I20260617 07:53:13.100737 1862 rpcz_store.cc:276] 0617 07:53:11.624397 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.624437 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:13.084018 (+1459581us) ts_tablet_manager.cc:1151] Deleting tablet 0c21efcad98348ebabcee4821dc4682e
0617 07:53:13.084025 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.089482 (+ 5457us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.099301 (+ 9819us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.100587 (+ 1286us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1459404}
I20260617 07:53:13.103824 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 58) took 1479 ms. Trace:
I20260617 07:53:13.103938 1862 rpcz_store.cc:276] 0617 07:53:11.624732 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.624769 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:13.103708 (+1478939us) ts_tablet_manager.cc:1151] Deleting tablet cc84665c7849469aa27e6505dbed1516
0617 07:53:13.103717 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.103786 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1478771}
I20260617 07:53:13.104199 1862 tablet_replica.cc:333] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.104396 1862 raft_consensus.cc:2243] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.104539 1862 raft_consensus.cc:2272] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.106904 1171 tablet_bootstrap.cc:492] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.107038 1171 ts_tablet_manager.cc:1403] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.001s
I20260617 07:53:13.107729 1171 raft_consensus.cc:359] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.107904 1171 raft_consensus.cc:385] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.107998 1171 raft_consensus.cc:740] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:13.058449 458 rpcz_store.cc:269] 0617 07:53:11.417538 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.419528 (+ 1990us) service_pool.cc:224] Handling call
0617 07:53:13.058235 (+1638707us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:12.014512 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:12.014656 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:12.014665 (+ 9us) write_op.cc:435] Acquired schema lock
0617 07:53:12.014669 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:12.014914 (+ 245us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:12.014931 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:12.014937 (+ 6us) tablet.cc:685] Acquiring locks for 6 operations
0617 07:53:12.015075 (+ 138us) tablet.cc:701] Row locks acquired
0617 07:53:12.015077 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:12.015117 (+ 40us) write_op.cc:270] Start()
0617 07:53:12.015151 (+ 34us) write_op.cc:276] Timestamp: P: 1781682792015062 usec, L: 0
0617 07:53:12.015154 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:12.015356 (+ 202us) log.cc:844] Serialized 2434 byte log entry
0617 07:53:12.019180 (+ 3824us) op_driver.cc:464] REPLICATION: finished
0617 07:53:12.020355 (+ 1175us) write_op.cc:301] APPLY: starting
0617 07:53:12.020370 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:12.020495 (+ 125us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:12.020558 (+ 63us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:12.020709 (+ 151us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:12.020755 (+ 46us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0617 07:53:12.020763 (+ 8us) write_op.cc:312] APPLY: finished
0617 07:53:12.020857 (+ 94us) log.cc:844] Serialized 53 byte log entry
0617 07:53:12.021091 (+ 234us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:12.021112 (+ 21us) write_op.cc:454] Released schema lock
0617 07:53:12.021118 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:12.021177 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:12.021181 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":272247,"reported_tablets":188,"child_traces":[["op",{"apply.queue_time_us":1109,"apply.run_cpu_time_us":653,"apply.run_wall_time_us":822,"num_ops":6,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":968,"prepare.run_wall_time_us":969,"raft.queue_time_us":923,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":258,"replication_time_us":3998}]]}
I20260617 07:53:13.108547 1171 consensus_queue.cc:260] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.109014 1171 ts_tablet_manager.cc:1434] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:13.109273 1171 tablet_bootstrap.cc:492] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.111248 1171 tablet_bootstrap.cc:654] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.111788 1862 ts_tablet_manager.cc:1916] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.116724 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4a3aea221f46d3a7265bd757616bfe" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.117476 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934f5fa0287427cb45fe568f0de8758" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:13.117738 917 raft_consensus.cc:3060] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.121009 917 raft_consensus.cc:2468] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:13.121599 1862 ts_tablet_manager.cc:1929] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:13.121762 1862 log.cc:1199] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/301bd4d6faec429ba71ce354c23d0f75
I20260617 07:53:13.122133 1862 ts_tablet_manager.cc:1950] T 301bd4d6faec429ba71ce354c23d0f75 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.123471 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de030009192748118b388eec555d90da" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.124344 1171 tablet_bootstrap.cc:492] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.124492 1171 ts_tablet_manager.cc:1403] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260617 07:53:13.125160 1171 raft_consensus.cc:359] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.125332 1171 raft_consensus.cc:385] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.125401 1171 raft_consensus.cc:740] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.125651 1171 consensus_queue.cc:260] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.126242 1171 ts_tablet_manager.cc:1434] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:13.128844 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ae1e189a64da6bad10156b401ec46" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.128942 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ce60b466f7420992ef194d72b5718d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.129110 917 raft_consensus.cc:2468] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:13.129594 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706373f1f5d44edf81ed04183a8bdf89" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.129684 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d657fbccb4af40558033a971aab7f3e4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.130214 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0e12aa4c60457182201a94caecda45" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.087453 2061 tablet.cc:1724] T 763581e2baeb46149bfb38d81301b9c5 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:13.122924 1172 ts_tablet_manager.cc:1434] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.064s user 0.001s sys 0.001s
I20260617 07:53:13.131614 1172 tablet_bootstrap.cc:492] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:13.131556 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c784578a63aa4fdba651212f46ce5bd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:13.132342 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c784578a63aa4fdba651212f46ce5bd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.134016 1172 tablet_bootstrap.cc:654] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.136088 2061 tablet.cc:1724] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:13.140164 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_94f094992132448fa01aa6eebc25e2f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:13.140867 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94f094992132448fa01aa6eebc25e2f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.149183 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c8087e83aff447a8884c16e5473ac750"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.151094 1172 tablet_bootstrap.cc:492] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:13.151247 1172 ts_tablet_manager.cc:1403] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.001s
I20260617 07:53:13.152297 1998 raft_consensus.cc:493] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.152540 1998 raft_consensus.cc:515] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.153403 1998 leader_election.cc:290] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.153940 1172 raft_consensus.cc:359] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.154201 1172 raft_consensus.cc:385] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.154165 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245cff69d83b43e98b1c72b8d3011347" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.154371 1172 raft_consensus.cc:740] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.154433 914 raft_consensus.cc:2468] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:13.154815 1172 consensus_queue.cc:260] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.154964 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf519b83c445798bddda3120b542ce" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.155722 1172 ts_tablet_manager.cc:1434] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:13.159395 1020 tablet_service.cc:1511] Processing CreateTablet for tablet eafcf54494f244f1b978b4b5e39d93bd (DEFAULT_TABLE table=default.Table_10dfdc64b49347fcaf5a117f196588ec [id=6e839c75e501491d91eb715fb91c2359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.159855 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafcf54494f244f1b978b4b5e39d93bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.166788 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 283c08c31718433e83f0cedd799215fe (DEFAULT_TABLE table=default.Table_86c3fe6446874d28b25252b953f8c730 [id=96f65e2c26d247c4acb7fba6a1002cef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.167270 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 283c08c31718433e83f0cedd799215fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:13.169705 851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260617 07:53:13.150447 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:13.176313 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.155630 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet f030d59f4e124f64bb62d05f0bb0f560 (table default.Table_6dd3b32c3f7c4ae58bf47ef40691387e [id=1e5fc863b63b40a384e18985aaba5ab9]) successfully deleted
I20260617 07:53:13.177764 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d7309d2b22c849ce980fd263a29ac77f (table default.Table_37dfd90d2dcb4616afb087ae9ebfa366 [id=f67703f0a40745f8982b89d83a3ecdea]) successfully deleted
W20260617 07:53:13.178027 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
I20260617 07:53:13.178201 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 82cf9c672f3b4567b63e878a6ab11334 (table default.Table_109a002e502a44d99c0e775b394e5c38 [id=6f5f5cfa42c54ca3964df6f9e25f18ae]) successfully deleted
W20260617 07:53:13.178386 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 already in progress: creating tablet
I20260617 07:53:13.178660 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 6ddfb822b5af4bb6b664936c769d9625 (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]) successfully deleted
I20260617 07:53:13.178948 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5a547dabaeb742ba941690f4895955bd (table default.Table_e63db29973b24c64be400ecb2982e867 [id=361b241d29f5458b9bfec6e97c3f37dc]) successfully deleted
W20260617 07:53:13.179157 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7f7611958cf143438497c93f5f2bc098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7611958cf143438497c93f5f2bc098 already in progress: creating tablet
W20260617 07:53:13.179349 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e757e6f4ce4c6eb8223c4b6955245e already in progress: creating tablet
W20260617 07:53:13.179505 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
W20260617 07:53:13.179673 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 36ce60b466f7420992ef194d72b5718d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ce60b466f7420992ef194d72b5718d already in progress: creating tablet
I20260617 07:53:13.179817 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 82d682ae37d74b4b967da0f8e2de6301 (table default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]) successfully deleted
W20260617 07:53:13.180063 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
W20260617 07:53:13.180254 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66140c5d364f453a8089f143cc96ede8 already in progress: creating tablet
I20260617 07:53:13.180469 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0c21efcad98348ebabcee4821dc4682e (table default.Table_754536afb14d459c82f275ef52707a7f [id=878537b828364bd29c9b6c93591acea6]) successfully deleted
W20260617 07:53:13.180660 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet cc84665c7849469aa27e6505dbed1516 because the tablet was not found. No further retry: Not found: Tablet not found: cc84665c7849469aa27e6505dbed1516
I20260617 07:53:13.182705 1171 tablet_bootstrap.cc:492] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:13.183136 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8087e83aff447a8884c16e5473ac750 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.184412 1171 tablet_bootstrap.cc:654] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.180761 2011 raft_consensus.cc:515] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.187943 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c70f5c41e04ad0b913c15aa315353f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.189425 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b83fda0ce74779b4cca2ffd2a9b903" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.190723 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0e12aa4c60457182201a94caecda45" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.191751 764 raft_consensus.cc:3060] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.193241 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 82cf9c672f3b4567b63e878a6ab11334 (table default.Table_109a002e502a44d99c0e775b394e5c38 [id=6f5f5cfa42c54ca3964df6f9e25f18ae]) successfully deleted
W20260617 07:53:13.194085 713 leader_election.cc:343] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 69996eb4ab6e40f9b2d97e00d766822a
I20260617 07:53:13.194223 713 leader_election.cc:304] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.195709 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b7746239c54ab6828299968d18628d" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.196242 2013 raft_consensus.cc:2749] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.196849 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb95639e16ed423fbe60b15a1bcdf5a6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.199817 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.199708 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.200237 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.200703 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 706373f1f5d44edf81ed04183a8bdf89 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:13.156061 1172 tablet_bootstrap.cc:492] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:13.204299 770 raft_consensus.cc:3060] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.205119 1178 tablet_bootstrap.cc:654] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:13.208381 988 leader_election.cc:343] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.210072 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_120df0ba6ac044f5b3528f6016062dab" } new_table_name: "default.Table_92a996a9fa604b7ca46cf37cc9688973" modify_external_catalogs: true
W20260617 07:53:13.210124 713 leader_election.cc:343] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 5a547dabaeb742ba941690f4895955bd
I20260617 07:53:13.213104 2023 raft_consensus.cc:515] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.217633 988 leader_election.cc:304] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.218078 1998 raft_consensus.cc:2749] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.219861 2023 leader_election.cc:290] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.220033 826 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:13.220896 1998 raft_consensus.cc:493] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.221042 1998 raft_consensus.cc:515] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.221930 1998 leader_election.cc:290] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.223779 713 leader_election.cc:304] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.225631 1846 ts_tablet_manager.cc:1929] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:13.225826 1846 log.cc:1199] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/7582d201bc5843949d4be08ee7586f9d
I20260617 07:53:13.227105 1846 ts_tablet_manager.cc:1950] T 7582d201bc5843949d4be08ee7586f9d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:13.227568 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 48) took 1565 ms. Trace:
W20260617 07:53:13.229642 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7934f5fa0287427cb45fe568f0de8758 consensus state has no leader
I20260617 07:53:13.232620 2023 raft_consensus.cc:2749] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:13.232815 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5cf044f7f8984fdc9c0ea0f028992063" } modify_external_catalogs: true
I20260617 07:53:13.232990 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5cf044f7f8984fdc9c0ea0f028992063" } modify_external_catalogs: true
I20260617 07:53:13.233593 741 tablet_service.cc:1511] Processing CreateTablet for tablet 37b36c91191445478055b78830be9450 (DEFAULT_TABLE table=default.Table_21f38a23f6964cf1acdf47d110725c9a [id=e4997acdbb904f3abc0044fd11805379]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:13.234366 988 leader_election.cc:343] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.234607 988 leader_election.cc:304] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:13.235133 988 leader_election.cc:343] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.235313 988 leader_election.cc:304] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.235584 1751 raft_consensus.cc:2749] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.235648 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37b36c91191445478055b78830be9450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.235747 1751 raft_consensus.cc:2749] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:13.236476 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 75846.9us
I20260617 07:53:13.236785 1780 consensus_queue.cc:1048] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:13.237278 1780 consensus_queue.cc:1048] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:13.238332 1856 fs_manager.cc:714] Time spent opening directory manager: real 0.147s user 0.035s sys 0.043s
I20260617 07:53:13.241937 755 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9656e092de4f6e9858d387428fed39 (DEFAULT_TABLE table=default.Table_dc82c567bed447868fae8b372c777c13 [id=9407e61b12e845c884427dedab2065d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.242514 1846 rpcz_store.cc:276] 0617 07:53:11.661864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.661903 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:12.897956 (+1236053us) ts_tablet_manager.cc:1151] Deleting tablet 7582d201bc5843949d4be08ee7586f9d
0617 07:53:12.897970 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:12.945543 (+ 47573us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.223667 (+278124us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.227529 (+ 3862us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1233000}
I20260617 07:53:13.242884 988 leader_election.cc:304] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:13.243185 1751 raft_consensus.cc:2804] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.243326 1751 raft_consensus.cc:697] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:13.243599 1751 consensus_queue.cc:237] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:13.246637 852 leader_election.cc:343] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.246809 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 59) took 1621 ms. Trace:
I20260617 07:53:13.246908 1862 rpcz_store.cc:276] 0617 07:53:11.625043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.625080 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:13.104143 (+1479063us) ts_tablet_manager.cc:1151] Deleting tablet 301bd4d6faec429ba71ce354c23d0f75
0617 07:53:13.104150 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.116678 (+ 12528us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.121522 (+ 4844us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.246745 (+125223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63885,"tablet-delete.queue_time_us":1478856}
I20260617 07:53:13.247376 1862 tablet_replica.cc:333] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.247637 1862 raft_consensus.cc:2243] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.247851 1862 raft_consensus.cc:2272] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.248512 1862 ts_tablet_manager.cc:1916] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.257007 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9656e092de4f6e9858d387428fed39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.262953 1172 tablet_bootstrap.cc:654] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.264082 1846 tablet_replica.cc:333] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:13.268380 2011 leader_election.cc:290] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.268517 760 tablet_service.cc:1511] Processing CreateTablet for tablet c6cbfa2a77d848fa924d633727e88618 (DEFAULT_TABLE table=default.Table_cff9a95917094a97b6cbcaf1fdabdc2a [id=bb5bdf2a707c4003af418f0264a08fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.270619 1862 ts_tablet_manager.cc:1929] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:13.270773 1862 log.cc:1199] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/89783bab2e584fe9a8eda963f78bf3ec
I20260617 07:53:13.271159 1862 ts_tablet_manager.cc:1950] T 89783bab2e584fe9a8eda963f78bf3ec P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.271576 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 61) took 1645 ms. Trace:
I20260617 07:53:13.271715 1862 rpcz_store.cc:276] 0617 07:53:11.626042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.626082 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:13.247257 (+1621175us) ts_tablet_manager.cc:1151] Deleting tablet 89783bab2e584fe9a8eda963f78bf3ec
0617 07:53:13.247271 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.253280 (+ 6009us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.270505 (+ 17225us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.271531 (+ 1026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768,"tablet-delete.queue_time_us":1621012}
I20260617 07:53:13.272269 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 62) took 1645 ms. Trace:
I20260617 07:53:13.272413 1862 rpcz_store.cc:276] 0617 07:53:11.626379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.626419 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:13.272095 (+1645676us) ts_tablet_manager.cc:1151] Deleting tablet be14a95f458d440e86133ef65c484571
0617 07:53:13.272104 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.272218 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1645434}
I20260617 07:53:13.273118 1862 tablet_replica.cc:333] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.273367 1862 raft_consensus.cc:2243] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.273582 1862 raft_consensus.cc:2272] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.274260 754 tablet_service.cc:1511] Processing CreateTablet for tablet 283c08c31718433e83f0cedd799215fe (DEFAULT_TABLE table=default.Table_86c3fe6446874d28b25252b953f8c730 [id=96f65e2c26d247c4acb7fba6a1002cef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.274646 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6cbfa2a77d848fa924d633727e88618. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:13.246990 852 leader_election.cc:343] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.276230 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 92554.2us
I20260617 07:53:13.281164 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.281213 756 tablet_service.cc:1511] Processing CreateTablet for tablet eafcf54494f244f1b978b4b5e39d93bd (DEFAULT_TABLE table=default.Table_10dfdc64b49347fcaf5a117f196588ec [id=6e839c75e501491d91eb715fb91c2359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.281586 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.281963 895 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.283648 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 283c08c31718433e83f0cedd799215fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.284727 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:13.284972 1998 raft_consensus.cc:493] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.285012 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:13.285223 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_0c3bb1ff748948298d93736f1a8583e4 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 1 got 0
I20260617 07:53:13.285447 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:13.285552 1998 raft_consensus.cc:515] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.285828 895 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.286389 1998 leader_election.cc:290] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.286672 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafcf54494f244f1b978b4b5e39d93bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.286801 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.286978 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.287274 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.287760 883 tablet_service.cc:1511] Processing CreateTablet for tablet c6cbfa2a77d848fa924d633727e88618 (DEFAULT_TABLE table=default.Table_cff9a95917094a97b6cbcaf1fdabdc2a [id=bb5bdf2a707c4003af418f0264a08fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.288792 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 7582d201bc5843949d4be08ee7586f9d (table default.Table_540131f07d9249ec80a4db3900a4ed2d [id=f0d64527dd96463a94407118831d2de2]) successfully deleted
I20260617 07:53:13.288867 1987 raft_consensus.cc:493] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.288988 1987 raft_consensus.cc:515] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.289566 1987 leader_election.cc:290] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.290206 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.291258 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c5ff28367b42d3a3922d2b789bc7ec" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.292479 1846 raft_consensus.cc:2243] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.293154 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6cbfa2a77d848fa924d633727e88618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.293411 1170 ts_tablet_manager.cc:1929] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:13.294251 744 tablet_service.cc:1511] Processing CreateTablet for tablet b62ae096bfd347029ef8d7f0462dd111 (DEFAULT_TABLE table=default.Table_899f77e8e1154e7fb9f0983ba586ce47 [id=4336b6e42a2b4c2d86fc98c56990bc8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.294509 746 tablet_service.cc:1511] Processing CreateTablet for tablet d5f158254bd34f1dbc5c9e3e92baa360 (DEFAULT_TABLE table=default.Table_4d518b1a10fb4d86ada299b76be8b2b1 [id=9672b84d3bb54a5ea6b80e625369c412]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:13.294713 713 leader_election.cc:343] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: df705c2300064db680bec1fefab08d2f
I20260617 07:53:13.295459 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f158254bd34f1dbc5c9e3e92baa360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.295401 713 leader_election.cc:304] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.292295 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245cff69d83b43e98b1c72b8d3011347" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.298341 1846 raft_consensus.cc:2272] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.302222 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82e4d6c09bb4414ad7f3b760f7ae681" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.303309 1171 tablet_bootstrap.cc:492] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.303624 1171 ts_tablet_manager.cc:1403] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.121s user 0.020s sys 0.007s
I20260617 07:53:13.308671 895 tablet_service.cc:1511] Processing CreateTablet for tablet eafcf54494f244f1b978b4b5e39d93bd (DEFAULT_TABLE table=default.Table_10dfdc64b49347fcaf5a117f196588ec [id=6e839c75e501491d91eb715fb91c2359]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.309791 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebafc920ed34216be5fb115f9bc6f7f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.310957 885 tablet_service.cc:1511] Processing CreateTablet for tablet b62ae096bfd347029ef8d7f0462dd111 (DEFAULT_TABLE table=default.Table_899f77e8e1154e7fb9f0983ba586ce47 [id=4336b6e42a2b4c2d86fc98c56990bc8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.311502 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf519b83c445798bddda3120b542ce" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.311571 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ba8963530d49a89fe4eb626225377d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.312400 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62ae096bfd347029ef8d7f0462dd111. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:13.313537 713 leader_election.cc:343] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: c7e43e1a3df54efe992a86dd0bd0c149
I20260617 07:53:13.314453 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebafc920ed34216be5fb115f9bc6f7f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:13.314692 918 raft_consensus.cc:3060] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.314980 1846 ts_tablet_manager.cc:1916] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.318198 713 leader_election.cc:304] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.319121 918 raft_consensus.cc:2468] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:13.321106 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c5ff28367b42d3a3922d2b789bc7ec" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.322422 1171 raft_consensus.cc:359] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.322674 1171 raft_consensus.cc:385] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.322757 1171 raft_consensus.cc:740] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.323033 1171 consensus_queue.cc:260] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.323472 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:13.325655 1171 ts_tablet_manager.cc:1434] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260617 07:53:13.326042 1171 tablet_bootstrap.cc:492] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.330778 2049 tablet.cc:1724] T 62b7746239c54ab6828299968d18628d P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:13.332580 1862 ts_tablet_manager.cc:1916] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.333689 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82e4d6c09bb4414ad7f3b760f7ae681" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.297786 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.334199 914 raft_consensus.cc:2468] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:13.298158 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.299477 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.300007 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.300143 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.308436 1172 tablet_bootstrap.cc:492] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:13.310949 1030 tablet_service.cc:1511] Processing CreateTablet for tablet d5f158254bd34f1dbc5c9e3e92baa360 (DEFAULT_TABLE table=default.Table_4d518b1a10fb4d86ada299b76be8b2b1 [id=9672b84d3bb54a5ea6b80e625369c412]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.334520 1170 log.cc:1199] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/2684f3200e604bb6bf37a2f97a193eff
I20260617 07:53:13.334909 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62ae096bfd347029ef8d7f0462dd111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.334918 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f158254bd34f1dbc5c9e3e92baa360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.336930 1171 tablet_bootstrap.cc:654] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.338445 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafcf54494f244f1b978b4b5e39d93bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:13.316813 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 73877.2us
W20260617 07:53:13.342473 988 leader_election.cc:343] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.342692 988 leader_election.cc:304] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.342985 1751 raft_consensus.cc:2749] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:13.343467 988 leader_election.cc:343] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.343645 988 leader_election.cc:304] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.343928 1751 raft_consensus.cc:2749] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.344353 988 leader_election.cc:304] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:13.344621 1751 raft_consensus.cc:2804] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.344715 1751 raft_consensus.cc:493] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.344784 1751 raft_consensus.cc:3060] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.347195 1751 raft_consensus.cc:515] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.347729 1751 leader_election.cc:290] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:13.348210 988 leader_election.cc:343] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.348372 988 leader_election.cc:304] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.348619 1751 raft_consensus.cc:2749] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:13.324361 986 leader_election.cc:343] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.348836 1171 tablet_bootstrap.cc:492] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:13.348942 986 leader_election.cc:343] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.349124 986 leader_election.cc:343] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.349275 986 leader_election.cc:343] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.349431 986 leader_election.cc:343] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.349584 986 leader_election.cc:343] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.350042 1170 ts_tablet_manager.cc:1950] T 2684f3200e604bb6bf37a2f97a193eff P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:13.331449 1998 raft_consensus.cc:493] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.350224 1171 ts_tablet_manager.cc:1403] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.004s
I20260617 07:53:13.332798 1032 tablet_service.cc:1511] Processing CreateTablet for tablet b62ae096bfd347029ef8d7f0462dd111 (DEFAULT_TABLE table=default.Table_899f77e8e1154e7fb9f0983ba586ce47 [id=4336b6e42a2b4c2d86fc98c56990bc8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.350363 1998 raft_consensus.cc:515] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.350911 1998 leader_election.cc:290] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.351178 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62ae096bfd347029ef8d7f0462dd111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.351123 1171 raft_consensus.cc:359] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.352080 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.352348 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.352566 1172 ts_tablet_manager.cc:1403] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.197s user 0.004s sys 0.000s
I20260617 07:53:13.353436 1172 raft_consensus.cc:359] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.353658 1171 raft_consensus.cc:385] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.353807 1172 raft_consensus.cc:385] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.353921 1172 raft_consensus.cc:740] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.354218 1171 raft_consensus.cc:740] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.354353 1172 consensus_queue.cc:260] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.354856 1171 consensus_queue.cc:260] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.354997 1172 ts_tablet_manager.cc:1434] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:13.355432 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 77) took 1747 ms. Trace:
I20260617 07:53:13.355767 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.356011 1171 ts_tablet_manager.cc:1434] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260617 07:53:13.356133 988 leader_election.cc:343] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.356302 988 leader_election.cc:304] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.356571 1998 raft_consensus.cc:2749] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.356662 1171 tablet_bootstrap.cc:492] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.356838 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.356904 2091 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 07:53:13.357287 1172 tablet_bootstrap.cc:492] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:13.358489 1171 tablet_bootstrap.cc:654] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.355937 1170 rpcz_store.cc:276] 0617 07:53:11.608117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.608476 (+ 359us) service_pool.cc:224] Handling call
0617 07:53:13.084660 (+1476184us) ts_tablet_manager.cc:1151] Deleting tablet 2684f3200e604bb6bf37a2f97a193eff
0617 07:53:13.085550 (+ 890us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.290182 (+204632us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.293353 (+ 3171us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.355382 (+ 62029us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1476033}
W20260617 07:53:13.361280 456 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_50c9e41224614d21a12eac5dea96559c [id=121feb8666fe4cb5b796fecf0bf1f8b0], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 121339ab4842432e9fb7bc357750f8ad consensus state has no leader
I20260617 07:53:13.363440 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:13.363668 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:13.364497 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:13.364665 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:13.364903 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:13.365316 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]). Expected version 3 got 0
I20260617 07:53:13.372126 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcfb101cf51487692ef9a6a17f40804" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.373755 2011 consensus_queue.cc:1048] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
W20260617 07:53:13.378073 456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:57237 (request call id 190) took 1734 ms (client timeout 1000 ms). Trace:
I20260617 07:53:13.373651 716 leader_election.cc:304] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.378937 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 80) took 1746 ms. Trace:
I20260617 07:53:13.380448 1998 raft_consensus.cc:493] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:13.380985 713 consensus_peers.cc:597] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d80c2ffcf1b84df0bc6a468ea0929e80. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:13.381800 988 leader_election.cc:343] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.382936 883 tablet_service.cc:1511] Processing CreateTablet for tablet 283c08c31718433e83f0cedd799215fe (DEFAULT_TABLE table=default.Table_86c3fe6446874d28b25252b953f8c730 [id=96f65e2c26d247c4acb7fba6a1002cef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.383420 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 283c08c31718433e83f0cedd799215fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.386188 1856 fs_manager.cc:730] Time spent opening block manager: real 0.146s user 0.002s sys 0.032s
W20260617 07:53:13.391923 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 55476.7us
I20260617 07:53:13.392216 716 leader_election.cc:304] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.394945 2086 raft_consensus.cc:493] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.395073 2086 raft_consensus.cc:515] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.395605 2086 leader_election.cc:290] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:13.396319 852 leader_election.cc:343] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.396422 852 leader_election.cc:304] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.396617 2088 raft_consensus.cc:2749] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:13.398237 713 consensus_peers.cc:597] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d21f61a35ca544568bcfca1a6230deca. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:13.386495 1856 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data,/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
uuid: "29a94ff9f875443ab6aeac00922cda0d"
format_stamp: "Formatted at 2026-06-17 07:52:57 on dist-test-slave-v0n2"
I20260617 07:53:13.398669 1856 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 07:53:13.403657 1751 raft_consensus.cc:493] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.380833 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 2684f3200e604bb6bf37a2f97a193eff (table default.Table_9439306243c4451db8d00e183b7dbeda [id=3d4b592286ce4a06bcc5f3477fdbf25f]) successfully deleted
I20260617 07:53:13.407435 1998 raft_consensus.cc:515] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.408166 1998 leader_election.cc:290] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.408373 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.393455 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:13.394165 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 301bd4d6faec429ba71ce354c23d0f75 (table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012]) successfully deleted
I20260617 07:53:13.409528 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 89783bab2e584fe9a8eda963f78bf3ec (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]) successfully deleted
I20260617 07:53:13.409785 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 2 got 0
I20260617 07:53:13.409751 1170 rpcz_store.cc:276] 0617 07:53:11.612351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.612397 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:13.358809 (+1746412us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:13.358821 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.358918 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1746234}
W20260617 07:53:13.409808 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet be14a95f458d440e86133ef65c484571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be14a95f458d440e86133ef65c484571 already in progress: creating tablet
I20260617 07:53:13.410025 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_022308372ad4427797e380190f5323b8 [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 4 got 0
I20260617 07:53:13.410092 1170 tablet_replica.cc:333] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:13.410203 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_8eb9043c09274769aecb39dee134ba7e [id=9726df7d693441359861876ae1179b4d]). Expected version 3 got 0
I20260617 07:53:13.409639 988 leader_election.cc:304] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.410548 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:13.410787 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d]). Expected version 2 got 0
I20260617 07:53:13.411136 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:13.411790 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:13.412072 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]). Expected version 1 got 0
I20260617 07:53:13.412106 2085 raft_consensus.cc:493] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.412179 1170 raft_consensus.cc:2243] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.412228 2085 raft_consensus.cc:515] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.412374 1170 raft_consensus.cc:2272] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.412832 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]). Expected version 2 got 0
I20260617 07:53:13.412868 2085 leader_election.cc:290] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.412921 1170 ts_tablet_manager.cc:1916] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.413074 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
I20260617 07:53:13.413586 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
W20260617 07:53:13.413775 456 rpcz_store.cc:269] 0617 07:53:11.643494 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.671635 (+ 28141us) service_pool.cc:224] Handling call
0617 07:53:11.694650 (+ 23015us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:12.176601 (+481951us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:12.176613 (+ 12us) write_op.cc:454] Released schema lock
0617 07:53:13.378026 (+1201413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:12.137569 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:12.137767 (+ 198us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:12.137777 (+ 10us) write_op.cc:435] Acquired schema lock
0617 07:53:12.137781 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:12.137912 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:12.137930 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:12.137937 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:12.138021 (+ 84us) tablet.cc:701] Row locks acquired
0617 07:53:12.138025 (+ 4us) write_op.cc:260] PREPARE: finished
0617 07:53:12.138069 (+ 44us) write_op.cc:270] Start()
0617 07:53:12.138132 (+ 63us) write_op.cc:276] Timestamp: P: 1781682792138002 usec, L: 0
0617 07:53:12.138138 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:12.138361 (+ 223us) log.cc:844] Serialized 533 byte log entry
0617 07:53:12.157455 (+ 19094us) op_driver.cc:464] REPLICATION: finished
0617 07:53:12.157592 (+ 137us) write_op.cc:301] APPLY: starting
0617 07:53:12.157611 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:12.157656 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:12.157691 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:12.157801 (+ 110us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:12.157837 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:12.157844 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:12.157928 (+ 84us) log.cc:844] Serialized 23 byte log entry
0617 07:53:12.157993 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:12.158016 (+ 23us) write_op.cc:454] Released schema lock
0617 07:53:12.158023 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":171,"spinlock_wait_cycles":37822720,"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":458,"apply.run_wall_time_us":484,"num_ops":1,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":924,"prepare.run_wall_time_us":931,"raft.queue_time_us":1350,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":247,"replication_time_us":19283}]]}
W20260617 07:53:13.415398 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 52291.9us
I20260617 07:53:13.415772 988 leader_election.cc:304] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
W20260617 07:53:13.416150 988 leader_election.cc:343] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.416246 988 leader_election.cc:304] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.416476 1997 raft_consensus.cc:2749] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.416421 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_85c6acc2e0744783bfa3d2f6f6162552" } new_table_name: "default.Table_a044383079644cf5bbb32311ac6520ec" modify_external_catalogs: true
I20260617 07:53:13.416568 988 leader_election.cc:304] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:13.416690 1997 raft_consensus.cc:2804] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.416810 1997 raft_consensus.cc:493] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.416895 1997 raft_consensus.cc:3060] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.417057 1994 raft_consensus.cc:2749] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.417227 1994 raft_consensus.cc:2804] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.417332 1994 raft_consensus.cc:697] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:13.417583 1994 consensus_queue.cc:237] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.419499 1997 raft_consensus.cc:515] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.420030 1997 leader_election.cc:290] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.421393 988 leader_election.cc:304] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:13.421648 2105 raft_consensus.cc:2804] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.422879 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ba8963530d49a89fe4eb626225377d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.423020 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f32eb8ec894e029a428bbd62caa0f5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.423195 2049 tablet.cc:1724] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:13.423310 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcfb101cf51487692ef9a6a17f40804" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.423422 1751 raft_consensus.cc:515] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.423615 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ae1e189a64da6bad10156b401ec46" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:13.423756 915 raft_consensus.cc:3060] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.423981 1751 leader_election.cc:290] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.425952 895 tablet_service.cc:1511] Processing CreateTablet for tablet d5f158254bd34f1dbc5c9e3e92baa360 (DEFAULT_TABLE table=default.Table_4d518b1a10fb4d86ada299b76be8b2b1 [id=9672b84d3bb54a5ea6b80e625369c412]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.426348 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f158254bd34f1dbc5c9e3e92baa360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.429277 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:13.429530 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:13.422879 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bee4c9cd9f2415ca54b8e85dbd326a7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.423274 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245cff69d83b43e98b1c72b8d3011347" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:13.429922 912 raft_consensus.cc:3060] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.429947 459 catalog_manager.cc:5696] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:13.431633 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.432550 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 2 got 0
I20260617 07:53:13.432580 912 raft_consensus.cc:2468] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:13.432765 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.432906 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:13.433244 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:13.433393 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 2 got 0
I20260617 07:53:13.433665 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:13.433871 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:13.433962 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.434109 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:13.434162 1862 ts_tablet_manager.cc:1929] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:13.434252 1862 log.cc:1199] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/28e1fd7f91f94221884be2166f0cc793
I20260617 07:53:13.434571 1862 ts_tablet_manager.cc:1950] T 28e1fd7f91f94221884be2166f0cc793 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.434624 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.435176 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.435243 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 63) took 1808 ms. Trace:
I20260617 07:53:13.435324 1862 rpcz_store.cc:276] 0617 07:53:11.626836 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.626887 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:13.273048 (+1646161us) ts_tablet_manager.cc:1151] Deleting tablet 28e1fd7f91f94221884be2166f0cc793
0617 07:53:13.273057 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.372930 (+ 99873us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.434095 (+ 61165us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.435226 (+ 1131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1646001}
I20260617 07:53:13.435606 1862 tablet_replica.cc:333] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.435706 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.435771 1862 raft_consensus.cc:2243] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:13.436055 1862 raft_consensus.cc:2272] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.436753 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.436949 1862 ts_tablet_manager.cc:1916] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.438508 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.438732 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 28e1fd7f91f94221884be2166f0cc793 (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]) successfully deleted
I20260617 07:53:13.439128 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.439458 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:13.426362 915 raft_consensus.cc:2468] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:13.439993 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:13.440055 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.440497 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:13.440716 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:13.441028 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]). Expected version 1 got 0
I20260617 07:53:13.441423 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.442579 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a547dabaeb742ba941690f4895955bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.443209 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.443857 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.444509 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.446111 2013 raft_consensus.cc:2749] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.447696 2013 raft_consensus.cc:3060] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.447873 1972 raft_consensus.cc:493] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.448001 1972 raft_consensus.cc:515] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.448673 1972 leader_election.cc:290] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.458709 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.459362 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.460381 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:13.461573 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 95865af94c04410386d23cb369180611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95865af94c04410386d23cb369180611 already in progress: creating tablet
I20260617 07:53:13.461887 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 706373f1f5d44edf81ed04183a8bdf89
I20260617 07:53:13.462517 452 catalog_manager.cc:6784] ReplaceTablet: tablet 706373f1f5d44edf81ed04183a8bdf89 deleted and replaced by tablet e5544753b3144c1989f2ed99bffc2246
I20260617 07:53:13.462865 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 7934f5fa0287427cb45fe568f0de8758 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:13.465485 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 706373f1f5d44edf81ed04183a8bdf89 with delete_type TABLET_DATA_DELETED (replaced by tablet e5544753b3144c1989f2ed99bffc2246) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.465975 1972 raft_consensus.cc:493] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.466137 1972 raft_consensus.cc:515] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.466778 1972 leader_election.cc:290] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.468037 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 706373f1f5d44edf81ed04183a8bdf89 with delete_type TABLET_DATA_DELETED (replaced by tablet e5544753b3144c1989f2ed99bffc2246) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.469478 2023 raft_consensus.cc:2749] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.471295 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ab8e93e3fe475ba9c7b5fce390a8ab" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.473078 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.473282 1050 raft_consensus.cc:2468] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:13.474233 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 7934f5fa0287427cb45fe568f0de8758
I20260617 07:53:13.475307 452 catalog_manager.cc:6784] ReplaceTablet: tablet 7934f5fa0287427cb45fe568f0de8758 deleted and replaced by tablet a4a35e3b7bb74667aa498c58a856cacc
I20260617 07:53:13.475653 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1f40cdfe73f54202b6223af377958372" } modify_external_catalogs: true
I20260617 07:53:13.475855 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1f40cdfe73f54202b6223af377958372" } modify_external_catalogs: true
I20260617 07:53:13.476573 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 7934f5fa0287427cb45fe568f0de8758 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a35e3b7bb74667aa498c58a856cacc) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.476804 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfb98aecc4546c88371436fcfbf8e86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.477025 1048 raft_consensus.cc:2468] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:13.478385 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3275c99834f404f84b96fcc7944cd00" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.478570 1046 raft_consensus.cc:2468] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:13.479485 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e55be5f28740fba65c1199a571d97a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.479677 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de030009192748118b388eec555d90da" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.479869 1046 raft_consensus.cc:2468] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:13.479893 2076 tablet.cc:1724] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260617 07:53:13.480490 851 leader_election.cc:343] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: Tablet not RUNNING: STOPPED
W20260617 07:53:13.480772 988 leader_election.cc:343] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.480885 988 leader_election.cc:304] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.480916 851 leader_election.cc:304] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.481225 851 leader_election.cc:304] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.481251 1994 raft_consensus.cc:2749] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.481472 851 leader_election.cc:304] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:13.481598 988 leader_election.cc:343] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.481765 988 leader_election.cc:343] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.481853 2085 raft_consensus.cc:2804] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.481920 2085 raft_consensus.cc:493] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.481976 2085 raft_consensus.cc:3060] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:13.482255 988 leader_election.cc:343] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.482519 988 leader_election.cc:304] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.482720 1994 raft_consensus.cc:2804] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.482842 1994 raft_consensus.cc:697] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:13.483074 1994 consensus_queue.cc:237] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.484522 2085 raft_consensus.cc:515] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.485064 2085 leader_election.cc:290] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.485194 2085 raft_consensus.cc:2804] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.485252 2085 raft_consensus.cc:493] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.485342 2085 raft_consensus.cc:3060] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.485894 1780 raft_consensus.cc:2804] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.485960 1780 raft_consensus.cc:493] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.486016 1780 raft_consensus.cc:3060] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.486187 1170 ts_tablet_manager.cc:1929] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:13.486346 1170 log.cc:1199] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/74ab8e93e3fe475ba9c7b5fce390a8ab
I20260617 07:53:13.486718 1170 ts_tablet_manager.cc:1950] T 74ab8e93e3fe475ba9c7b5fce390a8ab P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:13.487636 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 81) took 1874 ms. Trace:
I20260617 07:53:13.487746 1170 rpcz_store.cc:276] 0617 07:53:11.612845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.612946 (+ 101us) service_pool.cc:224] Handling call
0617 07:53:13.410027 (+1797081us) ts_tablet_manager.cc:1151] Deleting tablet 74ab8e93e3fe475ba9c7b5fce390a8ab
0617 07:53:13.410038 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.420256 (+ 10218us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.486110 (+ 65854us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.487571 (+ 1461us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1796940}
I20260617 07:53:13.488299 1780 raft_consensus.cc:515] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.488416 1170 tablet_replica.cc:333] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:13.488622 1170 raft_consensus.cc:2243] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:13.488811 1170 pending_rounds.cc:70] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:13.488804 1780 leader_election.cc:290] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.488854 1170 pending_rounds.cc:77] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772721844875264 op_type: NO_OP noop_request { }
I20260617 07:53:13.488947 1170 raft_consensus.cc:2889] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:13.489028 1170 raft_consensus.cc:2272] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.489279 988 leader_election.cc:304] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.489500 1994 raft_consensus.cc:2804] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.489629 1994 raft_consensus.cc:697] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:13.489920 1994 consensus_queue.cc:237] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:13.491057 988 leader_election.cc:343] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.491446 1972 consensus_queue.cc:1048] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:13.492413 851 leader_election.cc:304] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.492792 1972 raft_consensus.cc:2804] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.492854 1972 raft_consensus.cc:493] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.492902 1972 raft_consensus.cc:3060] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.493299 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.493434 1046 raft_consensus.cc:3060] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.495921 1972 raft_consensus.cc:515] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.496610 1972 leader_election.cc:290] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.496726 1046 raft_consensus.cc:2468] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.497380 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3275c99834f404f84b96fcc7944cd00" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.492889 2085 raft_consensus.cc:515] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.497700 1046 raft_consensus.cc:3060] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.498391 2085 leader_election.cc:290] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.500527 1046 raft_consensus.cc:2468] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.501821 1172 tablet_bootstrap.cc:654] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.510983 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:13.511260 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet adbbe7eb5181431290f57ed9128181a3 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]). Expected version 1 got 0
I20260617 07:53:13.511649 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]). Expected version 1 got 0
I20260617 07:53:13.511898 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_8eb9043c09274769aecb39dee134ba7e [id=9726df7d693441359861876ae1179b4d]). Expected version 3 got 0
I20260617 07:53:13.512104 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_022308372ad4427797e380190f5323b8 [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 4 got 0
I20260617 07:53:13.513278 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:13.513474 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:13.513656 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:13.513759 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfb98aecc4546c88371436fcfbf8e86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.513996 1050 raft_consensus.cc:3060] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.513984 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]). Expected version 3 got 0
I20260617 07:53:13.514206 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:13.514861 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]). Expected version 1 got 0
I20260617 07:53:13.515540 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:13.515722 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
I20260617 07:53:13.509680 1862 ts_tablet_manager.cc:1929] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.516841 1862 log.cc:1199] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/b01721f68e3c41f4a2ffaf05bb180761
I20260617 07:53:13.517354 1862 ts_tablet_manager.cc:1950] T b01721f68e3c41f4a2ffaf05bb180761 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.517355 1050 raft_consensus.cc:2468] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.518026 851 leader_election.cc:304] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.518268 2085 raft_consensus.cc:2804] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.518383 2085 raft_consensus.cc:697] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.518654 851 leader_election.cc:304] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.518700 2085 consensus_queue.cc:237] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.518364 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 45) took 1915 ms. Trace:
I20260617 07:53:13.518999 1862 rpcz_store.cc:276] 0617 07:53:11.611649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.633027 (+ 21378us) service_pool.cc:224] Handling call
0617 07:53:13.435563 (+1802536us) ts_tablet_manager.cc:1151] Deleting tablet b01721f68e3c41f4a2ffaf05bb180761
0617 07:53:13.435572 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.506253 (+ 70681us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.509622 (+ 3369us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.518349 (+ 8727us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1802321}
I20260617 07:53:13.519435 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet b01721f68e3c41f4a2ffaf05bb180761 (table default.Table_222b195724fd4c0a86c636969ca9d0f0 [id=544e7bcc34ae49688f95e64400ce17f1]) successfully deleted
I20260617 07:53:13.519497 1972 raft_consensus.cc:2804] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.519547 851 leader_election.cc:304] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.519599 1972 raft_consensus.cc:697] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.519877 1972 consensus_queue.cc:237] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.520076 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 51) took 1905 ms. Trace:
I20260617 07:53:13.520133 1862 rpcz_store.cc:276] 0617 07:53:11.614171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.633428 (+ 19257us) service_pool.cc:224] Handling call
0617 07:53:13.519259 (+1885831us) ts_tablet_manager.cc:1151] Deleting tablet 84f498f551ff4767bd16628b03f55ae2
0617 07:53:13.519271 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.520064 (+ 793us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1885636}
I20260617 07:53:13.520376 1862 tablet_replica.cc:333] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.520534 1862 raft_consensus.cc:2243] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:13.520756 1862 raft_consensus.cc:2272] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.520941 2088 raft_consensus.cc:2804] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.520958 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de030009192748118b388eec555d90da" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.521059 2088 raft_consensus.cc:697] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.521144 1046 raft_consensus.cc:3060] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.521308 2088 consensus_queue.cc:237] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.522193 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:13.522676 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:13.522927 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_120df0ba6ac044f5b3528f6016062dab [id=75e0087891a14cac9688f76ee43c157d]). Expected version 2 got 0
I20260617 07:53:13.523159 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_0c3bb1ff748948298d93736f1a8583e4 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 1 got 0
I20260617 07:53:13.523348 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:13.524274 1862 ts_tablet_manager.cc:1916] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.526911 1172 tablet_bootstrap.cc:492] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:13.527088 1172 ts_tablet_manager.cc:1403] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.170s user 0.001s sys 0.003s
I20260617 07:53:13.527822 1172 raft_consensus.cc:359] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.528015 1172 raft_consensus.cc:385] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.528141 1172 raft_consensus.cc:740] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:13.523885 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 84f498f551ff4767bd16628b03f55ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84f498f551ff4767bd16628b03f55ae2 already in progress: creating tablet
I20260617 07:53:13.528352 1172 consensus_queue.cc:260] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.529523 1172 ts_tablet_manager.cc:1434] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:13.529902 1172 tablet_bootstrap.cc:492] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:13.529865 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
I20260617 07:53:13.530521 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:13.534921 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:13.536281 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]). Expected version 2 got 0
I20260617 07:53:13.537456 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:13.538398 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 2 got 0
I20260617 07:53:13.539397 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:13.539459 1172 tablet_bootstrap.cc:654] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.540083 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:13.540940 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_27991162221746b7a1f8513217cc15e8 [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 2 got 0
I20260617 07:53:13.541759 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:13.544148 1862 ts_tablet_manager.cc:1929] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.544617 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:13.545787 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:13.546514 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:13.547205 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:13.547895 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:13.548381 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:13.548856 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:13.549887 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:13.549185 1862 log.cc:1199] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/3f51c76d93674a91b5ada7821393020a
I20260617 07:53:13.550570 1862 ts_tablet_manager.cc:1950] T 3f51c76d93674a91b5ada7821393020a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.551222 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:13.552289 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 64) took 1924 ms. Trace:
I20260617 07:53:13.553215 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet df5224716de249e9be9d7239407579a9
I20260617 07:53:13.554117 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_55ac8726e90c485f9bf12cacf476e6e7" } modify_external_catalogs: true
I20260617 07:53:13.554353 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_55ac8726e90c485f9bf12cacf476e6e7" } modify_external_catalogs: true
I20260617 07:53:13.558382 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 9618a5c0c9dd4c368f5763c434f70da5
I20260617 07:53:13.559137 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_66c2a830c5a94c0c9f70f12f18100bd5" } new_table_name: "default.Table_db43d16997784003860b863b8476cc86" modify_external_catalogs: true
W20260617 07:53:13.561690 2106 consensus_queue.cc:1175] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dc3bec007846459a9da0c7b8211e477b" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260617 07:53:13.562638 1170 ts_tablet_manager.cc:1916] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.444526 2105 raft_consensus.cc:493] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.564343 2105 raft_consensus.cc:3060] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.565241 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 74ab8e93e3fe475ba9c7b5fce390a8ab (table default.Table_be503ca177d549f6a02bc394edcc4fe7 [id=de6d213812d4427fa28250763779565e]) successfully deleted
I20260617 07:53:13.566030 2093 tablet.cc:1724] T b7d9354c81df42fb9756045e659be26d P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:13.569398 2105 raft_consensus.cc:515] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.570559 1178 tablet_bootstrap.cc:492] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
W20260617 07:53:13.570919 2092 log.cc:927] Time spent T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: Append to log took a long time: real 0.101s user 0.000s sys 0.000s
I20260617 07:53:13.571491 2094 tablet.cc:1724] T 62b7746239c54ab6828299968d18628d P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:13.572364 460 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 3b3e6c6974314cff835b8f9650b5417b
I20260617 07:53:13.572727 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e0a022b4ea4c4845bfea835c7373a969" } modify_external_catalogs: true
I20260617 07:53:13.572888 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e0a022b4ea4c4845bfea835c7373a969" } modify_external_catalogs: true
W20260617 07:53:13.574097 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3fe290e33b5145b6a2831de3d37599b9 consensus state has no leader
I20260617 07:53:13.574487 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_73fb62164ea041f2a6e1e1c5e877605b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.574815 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ab8e93e3fe475ba9c7b5fce390a8ab" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:13.575116 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73fb62164ea041f2a6e1e1c5e877605b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.588194 452 master_service.cc:960] ReplaceTablet: received request to replace tablet b7c5ff28367b42d3a3922d2b789bc7ec from {username='slave'} at 127.0.0.1:33390
W20260617 07:53:13.592195 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee5ddac997834e97a2d6c9b1855ee4e8 consensus state has no leader
W20260617 07:53:13.592711 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ec425bb523a449d9fe16d3ea3a0d7ae consensus state has no leader
I20260617 07:53:13.593253 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_980a7e52a5604063bedf7b9097cc3e2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:13.594010 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_980a7e52a5604063bedf7b9097cc3e2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.572257 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 7934f5fa0287427cb45fe568f0de8758 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a35e3b7bb74667aa498c58a856cacc) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.573581 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet df5224716de249e9be9d7239407579a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.597262 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_7c0e97b79dd9460c8437fa9bfe0ff607"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.579257 1046 raft_consensus.cc:2468] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.582373 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:13.597786 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c0e97b79dd9460c8437fa9bfe0ff607 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.599188 2105 leader_election.cc:290] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.603116 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_05a7c719161e4611a82fb48194a5fbc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:13.603605 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05a7c719161e4611a82fb48194a5fbc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:13.608253 455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:33527 (request call id 144) took 1811 ms (client timeout 1000 ms). Trace:
W20260617 07:53:13.608424 455 rpcz_store.cc:269] 0617 07:53:11.796995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.833589 (+ 36594us) service_pool.cc:224] Handling call
0617 07:53:11.898673 (+ 65084us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:13.608203 (+1709530us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161766,"reported_tablets":194,"spinlock_wait_cycles":141958912}
I20260617 07:53:13.609615 455 master_service.cc:960] ReplaceTablet: received request to replace tablet ee0e12aa4c60457182201a94caecda45 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:13.610930 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9b8de1903c2e4b32ae11268bcb7d6c49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:13.611411 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b8de1903c2e4b32ae11268bcb7d6c49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.611979 1178 ts_tablet_manager.cc:1403] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.497s user 0.006s sys 0.013s
I20260617 07:53:13.588873 1170 ts_tablet_manager.cc:1929] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.613966 1170 log.cc:1199] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0ebafc920ed34216be5fb115f9bc6f7f
I20260617 07:53:13.614409 1170 ts_tablet_manager.cc:1950] T 0ebafc920ed34216be5fb115f9bc6f7f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:13.614603 2093 tablet.cc:1724] T 763581e2baeb46149bfb38d81301b9c5 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:13.616813 772 raft_consensus.cc:3060] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.618692 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 82) took 2005 ms. Trace:
I20260617 07:53:13.618795 1170 rpcz_store.cc:276] 0617 07:53:11.613302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.613345 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:13.488322 (+1874977us) ts_tablet_manager.cc:1151] Deleting tablet 0ebafc920ed34216be5fb115f9bc6f7f
0617 07:53:13.488334 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.584893 (+ 96559us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.588827 (+ 3934us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.618641 (+ 29814us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1874820}
I20260617 07:53:13.619215 1170 tablet_replica.cc:333] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:13.619459 1170 raft_consensus.cc:2243] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:13.619704 1170 pending_rounds.cc:70] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:13.619771 1170 pending_rounds.cc:77] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772722136719360 op_type: NO_OP noop_request { }
I20260617 07:53:13.619910 1170 raft_consensus.cc:2889] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:13.619910 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 0ebafc920ed34216be5fb115f9bc6f7f (table default.Table_72eda13c56884241ab3153e5cb1a72d1 [id=78af228b204f4bb5a4e5867d1a9f9124]) successfully deleted
I20260617 07:53:13.620026 1170 raft_consensus.cc:2272] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.622479 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de030009192748118b388eec555d90da" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.622992 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.626163 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9b4e5d09d2f2490983e5b3a74b033d65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.626322 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 7934f5fa0287427cb45fe568f0de8758 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a35e3b7bb74667aa498c58a856cacc) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.626636 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.626843 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.627059 759 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:13.627151 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b4e5d09d2f2490983e5b3a74b033d65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.627271 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.627503 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.627746 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.627934 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.628480 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.628672 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de030009192748118b388eec555d90da" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.630084 1170 ts_tablet_manager.cc:1916] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.637589 2013 raft_consensus.cc:2749] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.641084 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_79919723364a4f5982d7c530cbaf7be6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.642017 747 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.638309 1172 tablet_bootstrap.cc:492] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:13.642469 1172 ts_tablet_manager.cc:1403] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.113s user 0.006s sys 0.015s
W20260617 07:53:13.642586 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79919723364a4f5982d7c530cbaf7be6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.643155 1172 raft_consensus.cc:359] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.643304 1172 raft_consensus.cc:385] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.643348 1172 raft_consensus.cc:740] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.643551 1172 consensus_queue.cc:260] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.646054 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2c25119f0d73426f98bbbadf2d86ad6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:13.649590 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c25119f0d73426f98bbbadf2d86ad6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.649858 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfb98aecc4546c88371436fcfbf8e86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.652070 1172 ts_tablet_manager.cc:1434] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260617 07:53:13.655539 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfb98aecc4546c88371436fcfbf8e86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.656261 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ed21cebfa20b4c13af92240c4698a476"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.657536 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3275c99834f404f84b96fcc7944cd00" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.658429 769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:13.659261 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed21cebfa20b4c13af92240c4698a476 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.661046 754 tablet_service.cc:1558] Processing DeleteTablet for tablet df5224716de249e9be9d7239407579a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.661243 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 706373f1f5d44edf81ed04183a8bdf89 with delete_type TABLET_DATA_DELETED (replaced by tablet e5544753b3144c1989f2ed99bffc2246) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.661393 752 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.661877 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3275c99834f404f84b96fcc7944cd00" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.662549 1172 tablet_bootstrap.cc:492] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:13.664750 2105 raft_consensus.cc:493] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.664927 2105 raft_consensus.cc:515] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.666155 2105 leader_election.cc:290] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.668473 1178 raft_consensus.cc:359] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.669528 1172 tablet_bootstrap.cc:654] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.672465 453 master_service.cc:960] ReplaceTablet: received request to replace tablet f15dcc10552d4747bad436538662bb66 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:13.675132 1172 tablet_bootstrap.cc:492] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:13.675271 1172 ts_tablet_manager.cc:1403] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20260617 07:53:13.675904 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.676146 752 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.685293 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_055ace13aa294344aeb50420a4235f3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.686641 1846 ts_tablet_manager.cc:1929] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 07:53:13.687917 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1e064b5bc93442f83aeffa88861d818 consensus state has no leader
W20260617 07:53:13.691143 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_055ace13aa294344aeb50420a4235f3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:13.691496 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4d8542262864a0ab9d763528502bcbb consensus state has no leader
I20260617 07:53:13.692160 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d965aa4e8dc244cdb93dd15cdee9070c
I20260617 07:53:13.695380 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.696161 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:13.696425 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 247709us
I20260617 07:53:13.556820 895 tablet_service.cc:1558] Processing DeleteTablet for tablet df5224716de249e9be9d7239407579a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.563956 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.697088 1862 rpcz_store.cc:276] 0617 07:53:11.627660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.705782 (+ 78122us) service_pool.cc:224] Handling call
0617 07:53:13.520336 (+1814554us) ts_tablet_manager.cc:1151] Deleting tablet 3f51c76d93674a91b5ada7821393020a
0617 07:53:13.520345 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.532705 (+ 12360us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.544073 (+ 11368us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.552266 (+ 8193us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1802629}
I20260617 07:53:13.576085 1987 raft_consensus.cc:493] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.697292 716 leader_election.cc:304] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.697474 1862 tablet_replica.cc:333] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.697387 1987 raft_consensus.cc:515] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.697641 1862 raft_consensus.cc:2243] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.697789 1862 raft_consensus.cc:2272] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.597963 851 leader_election.cc:304] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:13.698100 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 100177us
I20260617 07:53:13.599678 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82e4d6c09bb4414ad7f3b760f7ae681" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:13.698318 1862 ts_tablet_manager.cc:1916] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.698344 915 raft_consensus.cc:3060] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.698442 1657 raft_consensus.cc:2804] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.698539 1657 raft_consensus.cc:697] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.698750 1657 consensus_queue.cc:237] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.609926 1780 raft_consensus.cc:493] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.699630 1780 raft_consensus.cc:515] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.700120 1780 leader_election.cc:290] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.700241 1780 raft_consensus.cc:493] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.700330 1780 raft_consensus.cc:515] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.700760 1780 leader_election.cc:290] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.701155 915 raft_consensus.cc:2468] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:13.613042 1171 tablet_bootstrap.cc:492] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.701577 1171 ts_tablet_manager.cc:1403] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.345s user 0.009s sys 0.024s
I20260617 07:53:13.702369 1171 raft_consensus.cc:359] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.702495 1171 raft_consensus.cc:385] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.702544 1171 raft_consensus.cc:740] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.702693 1171 consensus_queue.cc:260] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.703045 964 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:13.703130 1171 ts_tablet_manager.cc:1434] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260617 07:53:13.629737 1972 raft_consensus.cc:493] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:13.630452 852 leader_election.cc:343] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.675917 2085 raft_consensus.cc:493] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.703404 1972 raft_consensus.cc:515] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.703473 2085 raft_consensus.cc:515] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.703933 1972 leader_election.cc:290] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.704007 2085 leader_election.cc:290] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.703408 852 leader_election.cc:304] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.704330 2087 raft_consensus.cc:2749] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:13.704352 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 73905.5us
W20260617 07:53:13.704682 852 leader_election.cc:343] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.704921 852 leader_election.cc:343] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.706369 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 3f51c76d93674a91b5ada7821393020a (table default.Table_c651ebd3c3eb4bc8a82dea4cf194f571 [id=cdace7368624415da1cd61263240f706]) successfully deleted
I20260617 07:53:13.706707 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59acdc64fe9247d28c4c277161b42f4f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.706899 1048 raft_consensus.cc:2468] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:13.707883 883 tablet_service.cc:1558] Processing DeleteTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.708153 1987 leader_election.cc:290] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.708406 988 leader_election.cc:304] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.708626 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706373f1f5d44edf81ed04183a8bdf89" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.708794 1046 raft_consensus.cc:2468] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:13.708910 851 leader_election.cc:304] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.709087 2105 raft_consensus.cc:2804] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
W20260617 07:53:13.709252 851 leader_election.cc:343] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 2684f3200e604bb6bf37a2f97a193eff
W20260617 07:53:13.709398 851 leader_election.cc:343] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: df705c2300064db680bec1fefab08d2f
I20260617 07:53:13.709440 2105 raft_consensus.cc:697] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:13.709674 2105 consensus_queue.cc:237] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.711858 1898 raft_consensus.cc:2804] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.711931 1898 raft_consensus.cc:493] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.711989 1898 raft_consensus.cc:3060] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.713281 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df37ed81b17d4178adeb6057491b4cc9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.713459 1046 raft_consensus.cc:2468] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:13.714244 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 80f67a6c1dcf4a69842452c371a9c078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:13.714383 986 leader_election.cc:343] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.714481 986 leader_election.cc:304] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.714941 1994 raft_consensus.cc:2749] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.715777 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1
I20260617 07:53:13.716769 1898 raft_consensus.cc:515] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.717545 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.718930 851 leader_election.cc:304] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.719281 851 leader_election.cc:304] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.719548 2087 raft_consensus.cc:2804] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.719627 2087 raft_consensus.cc:493] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.719704 2087 raft_consensus.cc:3060] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.720304 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59acdc64fe9247d28c4c277161b42f4f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.720477 1046 raft_consensus.cc:3060] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.722911 2087 raft_consensus.cc:515] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.723448 1046 raft_consensus.cc:2468] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.723598 2087 leader_election.cc:290] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.723780 2087 raft_consensus.cc:2804] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.723845 2087 raft_consensus.cc:493] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.723917 2087 raft_consensus.cc:3060] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.724043 851 leader_election.cc:304] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.724300 1972 raft_consensus.cc:2804] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.724406 1972 raft_consensus.cc:697] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.724622 1972 consensus_queue.cc:237] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.725905 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706373f1f5d44edf81ed04183a8bdf89" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.726289 1046 raft_consensus.cc:3060] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.709262 1171 tablet_bootstrap.cc:492] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.731307 1171 tablet_bootstrap.cc:654] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.731552 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_32c6bef7b0d546df853fe9d0529d6b03 [id=cf45ee3bb58a4495a2930179a8532b9c] alter complete (version 2)
I20260617 07:53:13.731875 1046 raft_consensus.cc:2468] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.732389 851 leader_election.cc:304] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.732512 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.733101 2085 raft_consensus.cc:2804] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.733237 2085 raft_consensus.cc:697] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.733502 2085 consensus_queue.cc:237] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.734159 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:13.736449 988 leader_election.cc:343] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.740434 2087 raft_consensus.cc:515] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.742344 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet b7c5ff28367b42d3a3922d2b789bc7ec
I20260617 07:53:13.742287 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df37ed81b17d4178adeb6057491b4cc9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.742357 2087 leader_election.cc:290] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.742467 1046 raft_consensus.cc:3060] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.743312 883 tablet_service.cc:1558] Processing DeleteTablet for tablet b7c5ff28367b42d3a3922d2b789bc7ec with delete_type TABLET_DATA_DELETED (replaced by tablet 3bd63a5d7e8342d9b919aa0862f8cfc7) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.743438 452 catalog_manager.cc:6784] ReplaceTablet: tablet b7c5ff28367b42d3a3922d2b789bc7ec deleted and replaced by tablet 3bd63a5d7e8342d9b919aa0862f8cfc7
I20260617 07:53:13.743721 1172 raft_consensus.cc:359] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.743911 1172 raft_consensus.cc:385] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.744402 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet b7c5ff28367b42d3a3922d2b789bc7ec with delete_type TABLET_DATA_DELETED (replaced by tablet 3bd63a5d7e8342d9b919aa0862f8cfc7) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.746270 1172 raft_consensus.cc:740] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.747006 1898 leader_election.cc:290] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.747010 1172 consensus_queue.cc:260] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.752326 1170 ts_tablet_manager.cc:1929] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.756633 1171 tablet_bootstrap.cc:492] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.756844 1171 ts_tablet_manager.cc:1403] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.005s
I20260617 07:53:13.757648 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 7582d201bc5843949d4be08ee7586f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.758255 769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ae1e189a64da6bad10156b401ec46" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.758841 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_eea666288e104386986507e494503cad" } modify_external_catalogs: true
I20260617 07:53:13.759157 745 tablet_service.cc:1558] Processing DeleteTablet for tablet d7309d2b22c849ce980fd263a29ac77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.757754 1171 raft_consensus.cc:359] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.759330 1171 raft_consensus.cc:385] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.759388 1171 raft_consensus.cc:740] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.760274 1171 consensus_queue.cc:260] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.761138 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_eea666288e104386986507e494503cad" } modify_external_catalogs: true
I20260617 07:53:13.762988 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.760493 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 19f8525046964950884b0f9aa515ec81 with delete_type TABLET_DATA_DELETED (replaced by tablet 9cddb9e82c354f26b3abe56ebdefd008) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.760398 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.765128 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_64457de2b58244afa9932a32a979774d" } modify_external_catalogs: true
I20260617 07:53:13.765599 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_64457de2b58244afa9932a32a979774d" } modify_external_catalogs: true
I20260617 07:53:13.765981 1178 raft_consensus.cc:385] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.766096 1178 raft_consensus.cc:740] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.766161 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f32eb8ec894e029a428bbd62caa0f5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.766342 1178 consensus_queue.cc:260] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.766882 1178 ts_tablet_manager.cc:1434] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.155s user 0.002s sys 0.000s
I20260617 07:53:13.767197 1178 tablet_bootstrap.cc:492] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:13.768814 1178 tablet_bootstrap.cc:654] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.774825 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_aed7483cd2e248e2915c153c409f86b6" } modify_external_catalogs: true
I20260617 07:53:13.775038 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_aed7483cd2e248e2915c153c409f86b6" } modify_external_catalogs: true
I20260617 07:53:13.776430 1846 log.cc:1199] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/6ddfb822b5af4bb6b664936c769d9625
I20260617 07:53:13.776486 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.776679 769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bee4c9cd9f2415ca54b8e85dbd326a7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.776957 1846 ts_tablet_manager.cc:1950] T 6ddfb822b5af4bb6b664936c769d9625 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:13.777001 2123 raft_consensus.cc:2749] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260617 07:53:13.777314 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 51) took 2111 ms. Trace:
I20260617 07:53:13.778630 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8eb9043c09274769aecb39dee134ba7e" } new_table_name: "default.Table_920f71d2a7bb466ea8426518f300ac86" modify_external_catalogs: true
I20260617 07:53:13.778797 1862 ts_tablet_manager.cc:1929] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:13.784736 1862 log.cc:1199] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d80c2ffcf1b84df0bc6a468ea0929e80
I20260617 07:53:13.785236 1171 ts_tablet_manager.cc:1434] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260617 07:53:13.785591 1862 ts_tablet_manager.cc:1950] T d80c2ffcf1b84df0bc6a468ea0929e80 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.785918 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 66) took 2079 ms. Trace:
I20260617 07:53:13.786635 1862 rpcz_store.cc:276] 0617 07:53:11.706271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.706402 (+ 131us) service_pool.cc:224] Handling call
0617 07:53:13.697424 (+1991022us) ts_tablet_manager.cc:1151] Deleting tablet d80c2ffcf1b84df0bc6a468ea0929e80
0617 07:53:13.697436 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.771583 (+ 74147us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.778741 (+ 7158us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.785905 (+ 7164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1979599}
I20260617 07:53:13.788805 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_dc65c6594c234b77bfd660f740f07ae8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.777392 1846 rpcz_store.cc:276] 0617 07:53:11.666005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.666058 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:13.242987 (+1576929us) ts_tablet_manager.cc:1151] Deleting tablet 6ddfb822b5af4bb6b664936c769d9625
0617 07:53:13.243171 (+ 184us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.648405 (+405234us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.686537 (+ 38132us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.777267 (+ 90730us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11122,"tablet-delete.queue_time_us":1576660}
I20260617 07:53:13.779155 1898 raft_consensus.cc:493] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.790079 1846 tablet_replica.cc:333] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:13.790071 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 65) took 2083 ms. Trace:
I20260617 07:53:13.790186 1898 raft_consensus.cc:515] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:13.790340 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc65c6594c234b77bfd660f740f07ae8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.790532 1846 raft_consensus.cc:2243] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.790729 1846 raft_consensus.cc:2272] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.791211 1898 leader_election.cc:290] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.791301 1846 ts_tablet_manager.cc:1916] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.792687 1171 tablet_bootstrap.cc:492] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.792719 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d80c2ffcf1b84df0bc6a468ea0929e80 (table default.Table_5b5a4062a59c4b3f811cc1d4441fd030 [id=f40e523aa8e943dbb46cd015d28c4c6b]) successfully deleted
I20260617 07:53:13.793167 1898 raft_consensus.cc:493] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.793320 1898 raft_consensus.cc:515] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.794278 1898 leader_election.cc:290] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:13.795588 851 leader_election.cc:343] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 7e90ad3b80f24bc7aeb2e92ba5c84b63
I20260617 07:53:13.796663 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.797092 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.797204 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_599c014ad57e446a951f4d7cfc3a09b3" } new_table_name: "default.Table_9cc33f29bdc74258b288fd41c7366da4" modify_external_catalogs: true
I20260617 07:53:13.798651 883 tablet_service.cc:1558] Processing DeleteTablet for tablet d7309d2b22c849ce980fd263a29ac77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.799073 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.799491 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 82cf9c672f3b4567b63e878a6ab11334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.799817 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.800130 883 tablet_service.cc:1558] Processing DeleteTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 with delete_type TABLET_DATA_DELETED (replaced by tablet d6ab00c0be9545cc97a0f29d82de4877) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.800446 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 with delete_type TABLET_DATA_DELETED (replaced by tablet 58ba8963530d49a89fe4eb626225377d) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.800664 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a547dabaeb742ba941690f4895955bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.800438 1171 tablet_bootstrap.cc:654] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.804417 2049 tablet.cc:1724] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:13.790146 1862 rpcz_store.cc:276] 0617 07:53:11.706147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.707428 (+ 1281us) service_pool.cc:224] Handling call
0617 07:53:13.789945 (+2082517us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:13.789956 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.790055 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2072064}
I20260617 07:53:13.805332 1862 tablet_replica.cc:333] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.805352 764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245cff69d83b43e98b1c72b8d3011347" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.805567 1862 raft_consensus.cc:2243] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.805797 1862 raft_consensus.cc:2272] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.806808 1862 ts_tablet_manager.cc:1916] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.807802 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 6ddfb822b5af4bb6b664936c769d9625 (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]) successfully deleted
I20260617 07:53:13.814273 752 tablet_service.cc:1558] Processing DeleteTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.814612 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706373f1f5d44edf81ed04183a8bdf89" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:13.814651 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d9e473fd444efa6ab63cc51dbb2bd already in progress: creating tablet
I20260617 07:53:13.815009 769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e55be5f28740fba65c1199a571d97a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.817041 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:13.817364 459 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:46601 (request call id 214) took 1149 ms (client timeout 1000 ms). Trace:
W20260617 07:53:13.817682 459 rpcz_store.cc:269] 0617 07:53:12.668243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.684508 (+ 16265us) service_pool.cc:224] Handling call
0617 07:53:12.705847 (+ 21339us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:13.453911 (+748064us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:13.453921 (+ 10us) write_op.cc:454] Released schema lock
0617 07:53:13.817303 (+363382us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:13.442609 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:13.442717 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:13.442723 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:13.442726 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:13.442841 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:13.442855 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:13.442860 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:13.442926 (+ 66us) tablet.cc:701] Row locks acquired
0617 07:53:13.442928 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:13.442960 (+ 32us) write_op.cc:270] Start()
0617 07:53:13.442993 (+ 33us) write_op.cc:276] Timestamp: P: 1781682793442922 usec, L: 0
0617 07:53:13.442996 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:13.443167 (+ 171us) log.cc:844] Serialized 533 byte log entry
0617 07:53:13.447091 (+ 3924us) op_driver.cc:464] REPLICATION: finished
0617 07:53:13.447317 (+ 226us) write_op.cc:301] APPLY: starting
0617 07:53:13.447337 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:13.447393 (+ 56us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:13.447433 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:13.447503 (+ 70us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:13.447548 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:13.447560 (+ 12us) write_op.cc:312] APPLY: finished
0617 07:53:13.447648 (+ 88us) log.cc:844] Serialized 23 byte log entry
0617 07:53:13.447707 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:13.447727 (+ 20us) write_op.cc:454] Released schema lock
0617 07:53:13.447733 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0617 07:53:13.723661 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:13.723800 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:13.723807 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:13.723809 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:13.723919 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:13.723933 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:13.723938 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:13.724000 (+ 62us) tablet.cc:701] Row locks acquired
0617 07:53:13.724002 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:13.724037 (+ 35us) write_op.cc:270] Start()
0617 07:53:13.724070 (+ 33us) write_op.cc:276] Timestamp: P: 1781682793724019 usec, L: 0
0617 07:53:13.724074 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:13.724235 (+ 161us) log.cc:844] Serialized 356 byte log entry
0617 07:53:13.727873 (+ 3638us) op_driver.cc:464] REPLICATION: finished
0617 07:53:13.728234 (+ 361us) write_op.cc:301] APPLY: starting
0617 07:53:13.728249 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:13.728290 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:13.728322 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:13.728370 (+ 48us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:13.728401 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:13.728408 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:13.728490 (+ 82us) log.cc:844] Serialized 23 byte log entry
0617 07:53:13.728802 (+ 312us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:13.728891 (+ 89us) write_op.cc:454] Released schema lock
0617 07:53:13.728902 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:13.729005 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:13.729012 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":240769,"reported_tablets":193,"spinlock_wait_cycles":33298688,"child_traces":[["op",{"apply.queue_time_us":164,"apply.run_cpu_time_us":472,"apply.run_wall_time_us":472,"num_ops":1,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":664,"prepare.run_wall_time_us":664,"raft.queue_time_us":402,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":229,"replication_time_us":4063}],["op",{"apply.queue_time_us":309,"apply.run_cpu_time_us":462,"apply.run_wall_time_us":743,"num_ops":1,"prepare.queue_time_us":171,"prepare.run_cpu_time_us":700,"prepare.run_wall_time_us":1466,"raft.queue_time_us":63,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":216,"replication_time_us":3772}]]}
I20260617 07:53:13.819271 764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82e4d6c09bb4414ad7f3b760f7ae681" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.821995 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e85510ab21154a9d9c9461d1a0491a56" } new_table_name: "default.Table_1a37fbbe9740440a8c245559a94b7f5f" modify_external_catalogs: true
I20260617 07:53:13.822280 747 tablet_service.cc:1558] Processing DeleteTablet for tablet b7c5ff28367b42d3a3922d2b789bc7ec with delete_type TABLET_DATA_DELETED (replaced by tablet 3bd63a5d7e8342d9b919aa0862f8cfc7) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.823666 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.823884 2122 tablet.cc:1724] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:13.824419 769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.824749 775 raft_consensus.cc:1240] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Rejecting Update request from peer dc3bec007846459a9da0c7b8211e477b for earlier term 1. Current term is 2. Ops: []
I20260617 07:53:13.825152 764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59acdc64fe9247d28c4c277161b42f4f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.825394 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.829599 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ee0e12aa4c60457182201a94caecda45
I20260617 07:53:13.830191 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2684f3200e604bb6bf37a2f97a193eff" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.830621 455 catalog_manager.cc:6784] ReplaceTablet: tablet ee0e12aa4c60457182201a94caecda45 deleted and replaced by tablet 7b6f85399f924f619dd09465bb74f689
I20260617 07:53:13.830945 764 raft_consensus.cc:3060] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.832113 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4d58dd10a2254fc383ba0cbde79c772b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.832402 769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df705c2300064db680bec1fefab08d2f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:13.832664 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d58dd10a2254fc383ba0cbde79c772b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.833091 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706373f1f5d44edf81ed04183a8bdf89" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.838711 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet f15dcc10552d4747bad436538662bb66
I20260617 07:53:13.839301 453 catalog_manager.cc:6784] ReplaceTablet: tablet f15dcc10552d4747bad436538662bb66 deleted and replaced by tablet 262732996d6d47749830529ac025f42f
I20260617 07:53:13.839393 1170 log.cc:1199] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/570ae1e189a64da6bad10156b401ec46
I20260617 07:53:13.839802 1170 ts_tablet_manager.cc:1950] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:13.840272 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 83) took 2226 ms. Trace:
I20260617 07:53:13.840348 1170 rpcz_store.cc:276] 0617 07:53:11.613671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.613732 (+ 61us) service_pool.cc:224] Handling call
0617 07:53:13.619117 (+2005385us) ts_tablet_manager.cc:1151] Deleting tablet 570ae1e189a64da6bad10156b401ec46
0617 07:53:13.619127 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.668599 (+ 49472us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.752255 (+ 83656us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.840252 (+ 87997us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2005245}
I20260617 07:53:13.840726 1170 tablet_replica.cc:333] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:13.840900 1170 raft_consensus.cc:2243] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:13.841101 1170 pending_rounds.cc:70] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:13.841140 1170 pending_rounds.cc:77] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772722108784640 op_type: NO_OP noop_request { }
I20260617 07:53:13.841221 1170 raft_consensus.cc:2889] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:13.841289 1170 raft_consensus.cc:2272] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.745203 1046 raft_consensus.cc:2468] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.776288 1098 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:13.791476 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f5b567da0e4baab53c00c55923e920" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:13.817545 852 consensus_peers.cc:597] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:13.844918 1045 raft_consensus.cc:2468] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:13.845162 852 leader_election.cc:343] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.810750 2076 tablet.cc:1724] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:13.845388 851 leader_election.cc:304] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:13.845512 852 leader_election.cc:343] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.845795 852 leader_election.cc:343] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.845957 2085 raft_consensus.cc:2804] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.846028 2085 raft_consensus.cc:493] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260617 07:53:13.846053 852 leader_election.cc:343] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.846086 2085 raft_consensus.cc:3060] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:13.846257 852 leader_election.cc:343] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.846446 852 leader_election.cc:343] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.846903 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.846979 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.847241 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.847489 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.847745 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.847987 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.848218 883 tablet_service.cc:1558] Processing DeleteTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.848526 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.849184 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.849440 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.849686 883 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.849951 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.850551 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.850804 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.851413 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.851765 883 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.852010 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.852285 883 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0e12aa4c60457182201a94caecda45 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b6f85399f924f619dd09465bb74f689) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.852559 883 tablet_service.cc:1558] Processing DeleteTablet for tablet f15dcc10552d4747bad436538662bb66 with delete_type TABLET_DATA_DELETED (replaced by tablet 262732996d6d47749830529ac025f42f) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:13.812004 2105 raft_consensus.cc:493] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:13.819394 986 leader_election.cc:343] T 570ae1e189a64da6bad10156b401ec46 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.854061 986 leader_election.cc:343] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.854158 986 leader_election.cc:304] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:13.854465 986 leader_election.cc:343] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.854538 986 leader_election.cc:304] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:13.854797 986 leader_election.cc:343] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.855010 986 leader_election.cc:343] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.855088 986 leader_election.cc:304] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.855454 1997 raft_consensus.cc:2749] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.855543 1751 raft_consensus.cc:2749] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.855611 1997 raft_consensus.cc:2749] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.851289 2085 raft_consensus.cc:515] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.857142 1898 raft_consensus.cc:493] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.857247 1898 raft_consensus.cc:515] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.857602 2105 raft_consensus.cc:515] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.858601 2105 leader_election.cc:290] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.858950 2049 tablet.cc:1724] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 07:53:13.836288 1994 raft_consensus.cc:493] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.859584 1994 raft_consensus.cc:515] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.860064 1994 leader_election.cc:290] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:13.859328 2076 tablet.cc:1724] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 07:53:13.861353 1862 ts_tablet_manager.cc:1929] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:13.861450 1862 log.cc:1199] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d21f61a35ca544568bcfca1a6230deca
I20260617 07:53:13.864979 1898 leader_election.cc:290] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.865027 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2af44d9ab34e4bbea24d6c7d95748b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.865172 1045 raft_consensus.cc:2468] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:13.865545 851 leader_election.cc:304] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.865849 1898 raft_consensus.cc:2804] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.865942 1898 raft_consensus.cc:493] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.866062 1898 raft_consensus.cc:3060] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.869052 1898 raft_consensus.cc:515] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.873481 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f5b567da0e4baab53c00c55923e920" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.873639 1045 raft_consensus.cc:3060] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.870988 1862 ts_tablet_manager.cc:1950] T d21f61a35ca544568bcfca1a6230deca P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:13.876889 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 67) took 2170 ms. Trace:
I20260617 07:53:13.876938 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2af44d9ab34e4bbea24d6c7d95748b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.877099 1052 raft_consensus.cc:3060] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.876981 1862 rpcz_store.cc:276] 0617 07:53:11.706364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.772181 (+ 65817us) service_pool.cc:224] Handling call
0617 07:53:13.805285 (+2033104us) ts_tablet_manager.cc:1151] Deleting tablet d21f61a35ca544568bcfca1a6230deca
0617 07:53:13.805294 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.858579 (+ 53285us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.861313 (+ 2734us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.876869 (+ 15556us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2030849}
I20260617 07:53:13.877358 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 69) took 2103 ms. Trace:
I20260617 07:53:13.877446 1862 rpcz_store.cc:276] 0617 07:53:11.773657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.773854 (+ 197us) service_pool.cc:224] Handling call
0617 07:53:13.877240 (+2103386us) ts_tablet_manager.cc:1151] Deleting tablet 5dcfb101cf51487692ef9a6a17f40804
0617 07:53:13.877249 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.877343 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2102746}
I20260617 07:53:13.877733 1862 tablet_replica.cc:333] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:13.877705 1045 raft_consensus.cc:2468] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.877919 1862 raft_consensus.cc:2243] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:13.878149 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03d6dc473fc4be1a436fd71a06f403e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.874506 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a632b42300d64471b516008ebca3312f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:13.878212 1862 raft_consensus.cc:2272] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.873557 2085 leader_election.cc:290] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.879179 1862 ts_tablet_manager.cc:1916] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.879694 1052 raft_consensus.cc:2468] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.879958 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 570ae1e189a64da6bad10156b401ec46 (table default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]) successfully deleted
I20260617 07:53:13.880110 851 leader_election.cc:304] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.880373 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0e12aa4c60457182201a94caecda45 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b6f85399f924f619dd09465bb74f689) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.880378 851 leader_election.cc:304] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.880538 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet f15dcc10552d4747bad436538662bb66 with delete_type TABLET_DATA_DELETED (replaced by tablet 262732996d6d47749830529ac025f42f) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:13.880611 2087 raft_consensus.cc:2804] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.880738 2087 raft_consensus.cc:697] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.881053 2087 consensus_queue.cc:237] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.881453 2085 raft_consensus.cc:2804] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.881510 851 leader_election.cc:304] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.881583 2085 raft_consensus.cc:697] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.881752 2086 raft_consensus.cc:2804] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.881891 2086 raft_consensus.cc:697] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.881829 2085 consensus_queue.cc:237] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.833850 1172 ts_tablet_manager.cc:1434] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.159s user 0.001s sys 0.001s
I20260617 07:53:13.882128 2086 consensus_queue.cc:237] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.882913 1172 tablet_bootstrap.cc:492] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:13.884817 1172 tablet_bootstrap.cc:654] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:13.886550 716 consensus_peers.cc:597] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:13.887974 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e90ad3b80f24bc7aeb2e92ba5c84b63" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.888329 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59acdc64fe9247d28c4c277161b42f4f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.889145 769 raft_consensus.cc:2468] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:13.889605 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 67545.5us
I20260617 07:53:13.892145 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df37ed81b17d4178adeb6057491b4cc9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.892527 1657 consensus_queue.cc:1048] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:13.893597 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df37ed81b17d4178adeb6057491b4cc9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.898599 2125 consensus_queue.cc:1048] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260617 07:53:13.898762 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b2428f7dfbdf40a1998af9f8b4a4ce68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.899235 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f5b567da0e4baab53c00c55923e920" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:13.899401 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2428f7dfbdf40a1998af9f8b4a4ce68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:13.900612 986 leader_election.cc:343] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.900743 988 leader_election.cc:343] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.900969 986 leader_election.cc:343] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.901060 986 leader_election.cc:304] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.901145 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d21f61a35ca544568bcfca1a6230deca (table default.Table_97c26e097b994c36a82d2b9c95b8be1d [id=d270e804a9a84991bcf8bef8fd5c3fe3]) successfully deleted
W20260617 07:53:13.901221 988 leader_election.cc:343] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.901289 1751 raft_consensus.cc:2749] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:13.901430 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5dcfb101cf51487692ef9a6a17f40804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dcfb101cf51487692ef9a6a17f40804 already in progress: creating tablet
I20260617 07:53:13.901769 1898 leader_election.cc:290] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.901862 769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2af44d9ab34e4bbea24d6c7d95748b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.901872 1751 consensus_queue.cc:1059] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260617 07:53:13.902145 1751 raft_consensus.cc:3055] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Stepping down as leader of term 1
I20260617 07:53:13.902187 758 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0e12aa4c60457182201a94caecda45 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b6f85399f924f619dd09465bb74f689) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.902215 1751 raft_consensus.cc:740] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:13.902331 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f5b567da0e4baab53c00c55923e920" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.902480 1751 consensus_queue.cc:260] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:13.902676 852 leader_election.cc:343] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.902777 1751 raft_consensus.cc:3060] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Advancing to term 2
W20260617 07:53:13.903048 852 leader_election.cc:343] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.903288 852 leader_election.cc:343] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.904760 852 leader_election.cc:304] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:13.905128 852 leader_election.cc:343] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.905386 852 consensus_peers.cc:597] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:13.905519 852 consensus_peers.cc:597] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:13.905731 852 leader_election.cc:343] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.905761 1657 raft_consensus.cc:2749] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.905817 852 leader_election.cc:304] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:13.907343 852 leader_election.cc:343] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.907599 852 leader_election.cc:304] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:13.908077 1170 ts_tablet_manager.cc:1916] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.908480 2087 raft_consensus.cc:2749] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.908656 2087 raft_consensus.cc:2804] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 07:53:13.908733 2087 raft_consensus.cc:493] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.908800 2087 raft_consensus.cc:3060] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:13.909018 1987 raft_consensus.cc:493] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:13.909106 1987 raft_consensus.cc:515] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.909601 1987 leader_election.cc:290] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.910192 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4a3aea221f46d3a7265bd757616bfe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.910382 1046 raft_consensus.cc:2468] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:13.911401 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f15dcc10552d4747bad436538662bb66 with delete_type TABLET_DATA_DELETED (replaced by tablet 262732996d6d47749830529ac025f42f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:13.911847 851 leader_election.cc:304] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.912181 2086 raft_consensus.cc:2804] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:13.912249 2086 raft_consensus.cc:493] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:13.912305 2086 raft_consensus.cc:3060] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.912861 769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2af44d9ab34e4bbea24d6c7d95748b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.913687 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03d6dc473fc4be1a436fd71a06f403e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.914359 769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a632b42300d64471b516008ebca3312f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.915084 2086 raft_consensus.cc:515] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.915916 1172 tablet_bootstrap.cc:492] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:13.916046 1172 ts_tablet_manager.cc:1403] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260617 07:53:13.915931 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4a3aea221f46d3a7265bd757616bfe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:13.916244 1052 raft_consensus.cc:3060] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:13.916983 1172 raft_consensus.cc:359] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.917116 1172 raft_consensus.cc:385] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.917157 1172 raft_consensus.cc:740] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.917344 1172 consensus_queue.cc:260] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.917955 1172 ts_tablet_manager.cc:1434] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:13.918203 1172 tablet_bootstrap.cc:492] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:13.918665 1846 ts_tablet_manager.cc:1929] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.918661 1052 raft_consensus.cc:2468] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:13.918781 1846 log.cc:1199] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/ab8388648475499db50cc16a7c36775a
I20260617 07:53:13.919129 851 leader_election.cc:304] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:13.919248 1846 ts_tablet_manager.cc:1950] T ab8388648475499db50cc16a7c36775a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:13.919386 1987 raft_consensus.cc:2804] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:13.919495 1987 raft_consensus.cc:697] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:13.919544 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 52) took 2253 ms. Trace:
I20260617 07:53:13.919699 1987 consensus_queue.cc:237] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.919728 1846 rpcz_store.cc:276] 0617 07:53:11.666133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.666362 (+ 229us) service_pool.cc:224] Handling call
0617 07:53:13.789989 (+2123627us) ts_tablet_manager.cc:1151] Deleting tablet ab8388648475499db50cc16a7c36775a
0617 07:53:13.789999 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.830344 (+ 40345us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.917646 (+ 87302us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.919512 (+ 1866us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2123316}
I20260617 07:53:13.920068 1846 tablet_replica.cc:333] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:13.926384 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet ab8388648475499db50cc16a7c36775a (table default.Table_49b1276fd8f846b19cac293aa9f64723 [id=cd79fc14ef8c46309788c945c6267661]) successfully deleted
I20260617 07:53:13.927630 1846 raft_consensus.cc:2243] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.927856 1846 raft_consensus.cc:2272] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.928592 1846 ts_tablet_manager.cc:1916] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:13.929776 716 consensus_peers.cc:597] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d21f61a35ca544568bcfca1a6230deca. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:13.935077 2086 leader_election.cc:290] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.936298 2087 raft_consensus.cc:515] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:13.938566 851 leader_election.cc:343] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: df705c2300064db680bec1fefab08d2f
I20260617 07:53:13.941154 2087 leader_election.cc:290] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:13.942742 986 leader_election.cc:343] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.942869 986 leader_election.cc:304] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.943080 2143 raft_consensus.cc:2749] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:13.943240 986 leader_election.cc:343] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.943384 986 leader_election.cc:304] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:13.943614 2143 raft_consensus.cc:2749] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:13.947841 1172 tablet_bootstrap.cc:654] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.954620 1171 tablet_bootstrap.cc:492] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:13.954780 1171 ts_tablet_manager.cc:1403] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.162s user 0.008s sys 0.002s
I20260617 07:53:13.954939 2010 raft_consensus.cc:493] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:13.955124 2010 raft_consensus.cc:515] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.956007 2010 leader_election.cc:290] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:13.957449 2023 raft_consensus.cc:2749] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:13.957279 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ce51c155c04897a4cf8f7b4ac9a5c6" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:13.958424 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 50832.9us
I20260617 07:53:13.958868 1170 ts_tablet_manager.cc:1929] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:13.959064 1170 log.cc:1199] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/245cff69d83b43e98b1c72b8d3011347
I20260617 07:53:13.959491 1170 ts_tablet_manager.cc:1950] T 245cff69d83b43e98b1c72b8d3011347 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:13.959609 1178 tablet_bootstrap.cc:492] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:13.959772 1178 ts_tablet_manager.cc:1403] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.193s user 0.011s sys 0.006s
I20260617 07:53:13.960470 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 84) took 2346 ms. Trace:
I20260617 07:53:13.960496 1178 raft_consensus.cc:359] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.960747 1178 raft_consensus.cc:385] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.960845 1178 raft_consensus.cc:740] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.960964 1170 rpcz_store.cc:276] 0617 07:53:11.614153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.614195 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:13.840678 (+2226483us) ts_tablet_manager.cc:1151] Deleting tablet 245cff69d83b43e98b1c72b8d3011347
0617 07:53:13.840688 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.911216 (+ 70528us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.958797 (+ 47581us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.960447 (+ 1650us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2226347}
I20260617 07:53:13.961099 1178 consensus_queue.cc:260] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.961437 1170 tablet_replica.cc:333] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:13.961678 1170 raft_consensus.cc:2243] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:13.963713 2122 tablet.cc:1724] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 07:53:13.965469 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df705c2300064db680bec1fefab08d2f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.965682 770 raft_consensus.cc:3060] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:13.965469 764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4a3aea221f46d3a7265bd757616bfe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:13.970257 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 245cff69d83b43e98b1c72b8d3011347 (table default.Table_1735b3a964d948ea9c83c11e8adf8c68 [id=7a799def323b4e8d958c34f9ace044a2]) successfully deleted
I20260617 07:53:13.964178 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4a3aea221f46d3a7265bd757616bfe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:13.955765 1171 raft_consensus.cc:359] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.971380 1171 raft_consensus.cc:385] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.971473 1171 raft_consensus.cc:740] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.971722 1171 consensus_queue.cc:260] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:13.970806 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ce51c155c04897a4cf8f7b4ac9a5c6" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:13.970896 1172 tablet_bootstrap.cc:492] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:13.972277 1171 ts_tablet_manager.cc:1434] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260617 07:53:13.972319 1172 ts_tablet_manager.cc:1403] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.000s
I20260617 07:53:13.972595 1171 tablet_bootstrap.cc:492] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:13.972970 455 master_service.cc:960] ReplaceTablet: received request to replace tablet ce7cb453c7b647f298a6ebe20fd0e45b from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:13.973178 1172 raft_consensus.cc:359] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.973342 1172 raft_consensus.cc:385] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:13.973398 1172 raft_consensus.cc:740] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:13.973582 1172 consensus_queue.cc:260] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:13.974334 1172 ts_tablet_manager.cc:1434] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:13.974505 1170 raft_consensus.cc:2272] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:13.974639 1171 tablet_bootstrap.cc:654] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.975420 1170 ts_tablet_manager.cc:1916] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:13.974892 1172 tablet_bootstrap.cc:492] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:13.982216 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 (DEFAULT_TABLE table=default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb [id=964a0b6e388a4823bb124eef82b57431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.982645 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.983441 1172 tablet_bootstrap.cc:654] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:13.982216 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f34a2ee6fa82482db979ab25bc284f8e (DEFAULT_TABLE table=default.Table_c8087e83aff447a8884c16e5473ac750 [id=7fc04a52842c4a0fbdd047b650bf03a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.986240 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34a2ee6fa82482db979ab25bc284f8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:13.989202 852 leader_election.cc:343] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.989566 852 leader_election.cc:343] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.989852 852 leader_election.cc:343] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.990146 852 leader_election.cc:343] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.990397 852 leader_election.cc:343] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.990661 852 leader_election.cc:343] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:13.990973 852 consensus_peers.cc:597] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:13.992723 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_89bce7ee0b534345bafee7f0af6358e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:13.992935 1170 ts_tablet_manager.cc:1929] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:13.993033 1170 log.cc:1199] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0cfb98aecc4546c88371436fcfbf8e86
W20260617 07:53:13.993253 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89bce7ee0b534345bafee7f0af6358e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:13.993305 1170 ts_tablet_manager.cc:1950] T 0cfb98aecc4546c88371436fcfbf8e86 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:13.994014 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 85) took 2379 ms. Trace:
I20260617 07:53:13.994750 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 38168b7946eb487f91cc7dc47eedfcd8 (DEFAULT_TABLE table=default.Table_94e77b59e906420289e6014bb64dd340 [id=a6b2ab8f6b3748e1892d08ccaf18b7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.995128 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38168b7946eb487f91cc7dc47eedfcd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:13.999257 1172 tablet_bootstrap.cc:492] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
W20260617 07:53:13.999275 852 leader_election.cc:343] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:13.999389 1172 ts_tablet_manager.cc:1403] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.001s
I20260617 07:53:14.000164 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 0b479c2984934852a864699b66416538 (DEFAULT_TABLE table=default.Table_6b3ef645c2e84944a54aafdcf255ab13 [id=70f2a5c5967d472e81b5c4575f6ac7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:13.994109 1170 rpcz_store.cc:276] 0617 07:53:11.614600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.614644 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:13.961390 (+2346746us) ts_tablet_manager.cc:1151] Deleting tablet 0cfb98aecc4546c88371436fcfbf8e86
0617 07:53:13.961400 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.986195 (+ 24795us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.992895 (+ 6700us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:13.993996 (+ 1101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2346593}
I20260617 07:53:14.000612 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b479c2984934852a864699b66416538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.001744 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ce7cb453c7b647f298a6ebe20fd0e45b
I20260617 07:53:14.002231 455 catalog_manager.cc:6784] ReplaceTablet: tablet ce7cb453c7b647f298a6ebe20fd0e45b deleted and replaced by tablet 0b85d49f255940eeaf343bfcf71e00e9
I20260617 07:53:14.002590 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1936829f95a944e1894b1d3e4021a5e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.003104 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1936829f95a944e1894b1d3e4021a5e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.000139 1172 raft_consensus.cc:359] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.001125 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 5fb489c72a7a4e3590b81c768eeb5c43 (DEFAULT_TABLE table=default.Table_e39af9602cd746f3995e8ccb1f0a95d4 [id=201fadfa5df64f77a364abf704c809ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.001125 1030 tablet_service.cc:1511] Processing CreateTablet for tablet fe42e90971464554b1a029b401568938 (DEFAULT_TABLE table=default.Table_6059c873bed34cf5aad6dc245f4bb700 [id=ff169992bdbf4f10ae9d6de79eddeb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.001600 1027 tablet_service.cc:1511] Processing CreateTablet for tablet bbbea6fe52f04f298eeecdc119bebb65 (DEFAULT_TABLE table=default.Table_2ef5d5b6d55d4cd0adc070cfdf8209a7 [id=c36b5242d93a41dda283989b3204f558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.003783 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbbea6fe52f04f298eeecdc119bebb65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.004464 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 0cfb98aecc4546c88371436fcfbf8e86 (table default.Table_49b1276fd8f846b19cac293aa9f64723 [id=cd79fc14ef8c46309788c945c6267661]) successfully deleted
I20260617 07:53:14.001801 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 43106674307b4610abea9a68590aecef (DEFAULT_TABLE table=default.Table_e33a84b1d8554d62aebbf2f6ffb338d9 [id=7e73469c3f9e4fc8bb92608b72c30cbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.001858 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (DEFAULT_TABLE table=default.Table_a109162a61eb408c80979471592ad6b2 [id=494c90461b61486ab6dad26bbd3acab5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.004848 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c2bae0d7dfe4512b1674796e5dacf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.006639 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 77c3bf1860c34ee3821bf273234cb0a4 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:14.008435 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43106674307b4610abea9a68590aecef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:13.999678 852 leader_election.cc:343] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.010545 1172 raft_consensus.cc:385] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.010624 1172 raft_consensus.cc:740] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.010854 1172 consensus_queue.cc:260] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.011881 883 tablet_service.cc:1511] Processing CreateTablet for tablet f34a2ee6fa82482db979ab25bc284f8e (DEFAULT_TABLE table=default.Table_c8087e83aff447a8884c16e5473ac750 [id=7fc04a52842c4a0fbdd047b650bf03a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.011961 1172 ts_tablet_manager.cc:1434] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260617 07:53:14.011953 895 tablet_service.cc:1511] Processing CreateTablet for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 (DEFAULT_TABLE table=default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb [id=964a0b6e388a4823bb124eef82b57431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.012287 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34a2ee6fa82482db979ab25bc284f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.012516 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.015633 1170 tablet_replica.cc:333] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:14.016227 1170 raft_consensus.cc:2243] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.016357 1170 raft_consensus.cc:2272] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.016613 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e698b8d28fd24f26a1a627bc6409bd57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:14.016813 1170 ts_tablet_manager.cc:1916] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:14.017176 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e698b8d28fd24f26a1a627bc6409bd57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.017369 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb489c72a7a4e3590b81c768eeb5c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.017927 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 77c3bf1860c34ee3821bf273234cb0a4
I20260617 07:53:14.018973 458 catalog_manager.cc:6784] ReplaceTablet: tablet 77c3bf1860c34ee3821bf273234cb0a4 deleted and replaced by tablet f395f963a5a5400a966a8d4cc62aadf1
I20260617 07:53:14.019718 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_acd61f61eb644016aee97330152bf01e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.020709 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acd61f61eb644016aee97330152bf01e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.023958 895 tablet_service.cc:1511] Processing CreateTablet for tablet 38168b7946eb487f91cc7dc47eedfcd8 (DEFAULT_TABLE table=default.Table_94e77b59e906420289e6014bb64dd340 [id=a6b2ab8f6b3748e1892d08ccaf18b7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.024396 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38168b7946eb487f91cc7dc47eedfcd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.026536 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_442fbaeb953440b2a628c4c888990c9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.027182 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_442fbaeb953440b2a628c4c888990c9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.031040 1172 tablet_bootstrap.cc:492] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:14.032140 885 tablet_service.cc:1511] Processing CreateTablet for tablet 0b479c2984934852a864699b66416538 (DEFAULT_TABLE table=default.Table_6b3ef645c2e84944a54aafdcf255ab13 [id=70f2a5c5967d472e81b5c4575f6ac7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.032469 1172 tablet_bootstrap.cc:654] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.032513 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b479c2984934852a864699b66416538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.033061 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2e6883490743451e895cee827dd61401"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.033545 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e6883490743451e895cee827dd61401 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.036233 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe42e90971464554b1a029b401568938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.039693 885 tablet_service.cc:1511] Processing CreateTablet for tablet fe42e90971464554b1a029b401568938 (DEFAULT_TABLE table=default.Table_6059c873bed34cf5aad6dc245f4bb700 [id=ff169992bdbf4f10ae9d6de79eddeb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.040174 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe42e90971464554b1a029b401568938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.042178 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b with delete_type TABLET_DATA_DELETED (replaced by tablet 0b85d49f255940eeaf343bfcf71e00e9) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.042276 1170 ts_tablet_manager.cc:1929] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.042646 1170 log.cc:1199] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/df4f9101deaa4e6ebddacbce14f32810
I20260617 07:53:14.042765 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 446114516f164dc0a956f2ccbf2e7c35 (DEFAULT_TABLE table=default.Table_2da085a4502d4943857234839bbbf9d9 [id=8f6c6244ed2c445e8a4d7ec26ca31ef2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.043121 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446114516f164dc0a956f2ccbf2e7c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.043465 1170 ts_tablet_manager.cc:1950] T df4f9101deaa4e6ebddacbce14f32810 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:14.044480 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 86) took 2429 ms. Trace:
I20260617 07:53:14.046170 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 with delete_type TABLET_DATA_DELETED (replaced by tablet f395f963a5a5400a966a8d4cc62aadf1) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.046801 1170 rpcz_store.cc:276] 0617 07:53:11.614961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.615004 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:14.000748 (+2385744us) ts_tablet_manager.cc:1151] Deleting tablet df4f9101deaa4e6ebddacbce14f32810
0617 07:53:14.000756 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.024276 (+ 23520us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.042229 (+ 17953us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.044463 (+ 2234us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2385607}
I20260617 07:53:14.047447 1170 tablet_replica.cc:333] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:14.048568 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_29925f966d344ba89f83ad512a5bf335" } new_table_name: "default.Table_a18dfbacf2d34929b9fd021add13fd7e" modify_external_catalogs: true
I20260617 07:53:14.049479 713 leader_election.cc:304] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:14.049649 1170 raft_consensus.cc:2243] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.049815 1170 raft_consensus.cc:2272] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:14.049861 713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 74239.8us
I20260617 07:53:14.050320 1170 ts_tablet_manager.cc:1916] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.050511 758 tablet_service.cc:1511] Processing CreateTablet for tablet f34a2ee6fa82482db979ab25bc284f8e (DEFAULT_TABLE table=default.Table_c8087e83aff447a8884c16e5473ac750 [id=7fc04a52842c4a0fbdd047b650bf03a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.050966 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34a2ee6fa82482db979ab25bc284f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.055821 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ec3b5256518241a1a661b1e8c1841123" } new_table_name: "default.Table_2a9cd90a401b43569e0065aca5940892" modify_external_catalogs: true
I20260617 07:53:14.058286 884 tablet_service.cc:1511] Processing CreateTablet for tablet bbbea6fe52f04f298eeecdc119bebb65 (DEFAULT_TABLE table=default.Table_2ef5d5b6d55d4cd0adc070cfdf8209a7 [id=c36b5242d93a41dda283989b3204f558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.058732 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbbea6fe52f04f298eeecdc119bebb65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.064649 1170 ts_tablet_manager.cc:1929] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.066166 883 tablet_service.cc:1511] Processing CreateTablet for tablet 5fb489c72a7a4e3590b81c768eeb5c43 (DEFAULT_TABLE table=default.Table_e39af9602cd746f3995e8ccb1f0a95d4 [id=201fadfa5df64f77a364abf704c809ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.066646 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb489c72a7a4e3590b81c768eeb5c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.068468 1170 log.cc:1199] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/57e05a97a4ab4ed7bff523d1fb1c59ae
I20260617 07:53:14.070755 1170 ts_tablet_manager.cc:1950] T 57e05a97a4ab4ed7bff523d1fb1c59ae P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:14.071990 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 87) took 2456 ms. Trace:
I20260617 07:53:14.072557 884 tablet_service.cc:1511] Processing CreateTablet for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (DEFAULT_TABLE table=default.Table_a109162a61eb408c80979471592ad6b2 [id=494c90461b61486ab6dad26bbd3acab5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.073968 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet df4f9101deaa4e6ebddacbce14f32810 (table default.Table_996d5685c9904502b299700425b29a1d [id=534b1a750b5a4b5db2ae4aaa7b47f379]) successfully deleted
I20260617 07:53:14.074478 1171 tablet_bootstrap.cc:492] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:14.074640 1171 ts_tablet_manager.cc:1403] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.102s user 0.001s sys 0.001s
I20260617 07:53:14.073839 1170 rpcz_store.cc:276] 0617 07:53:11.615308 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.615346 (+ 38us) service_pool.cc:224] Handling call
0617 07:53:14.047402 (+2432056us) ts_tablet_manager.cc:1151] Deleting tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
0617 07:53:14.047411 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.053128 (+ 5717us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.064584 (+ 11456us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.071969 (+ 7385us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2431922}
I20260617 07:53:14.075102 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 57e05a97a4ab4ed7bff523d1fb1c59ae (table default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6]) successfully deleted
I20260617 07:53:14.075515 1171 raft_consensus.cc:359] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.075718 1171 raft_consensus.cc:385] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.075806 1171 raft_consensus.cc:740] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.077348 1862 ts_tablet_manager.cc:1929] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.077644 1171 consensus_queue.cc:260] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.080210 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c2bae0d7dfe4512b1674796e5dacf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.075713 1170 tablet_replica.cc:333] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:14.080632 1170 raft_consensus.cc:2243] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.081058 1170 raft_consensus.cc:2272] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.081820 1170 ts_tablet_manager.cc:1916] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.083509 1171 ts_tablet_manager.cc:1434] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260617 07:53:14.083740 2143 raft_consensus.cc:493] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.083884 2143 raft_consensus.cc:515] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.084609 2143 leader_election.cc:290] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:14.085180 1171 tablet_bootstrap.cc:492] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:14.086134 1862 log.cc:1199] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/c7e43e1a3df54efe992a86dd0bd0c149
I20260617 07:53:14.086637 1862 ts_tablet_manager.cc:1950] T c7e43e1a3df54efe992a86dd0bd0c149 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.087011 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 68) took 2313 ms. Trace:
I20260617 07:53:14.089006 1862 rpcz_store.cc:276] 0617 07:53:11.773529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.774182 (+ 653us) service_pool.cc:224] Handling call
0617 07:53:13.877676 (+2103494us) ts_tablet_manager.cc:1151] Deleting tablet c7e43e1a3df54efe992a86dd0bd0c149
0617 07:53:13.877685 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.980268 (+102583us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.077266 (+ 96998us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.086968 (+ 9702us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2103151}
I20260617 07:53:14.089413 1862 tablet_replica.cc:333] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:14.089684 1862 raft_consensus.cc:2243] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:14.088011 1171 tablet_bootstrap.cc:654] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.095610 1856 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 07:53:14.096278 1862 pending_rounds.cc:70] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:14.096432 1862 pending_rounds.cc:77] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772707904192512 op_type: NO_OP noop_request { }
I20260617 07:53:14.096648 1862 raft_consensus.cc:2889] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:14.096817 1862 raft_consensus.cc:2272] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.096849 1856 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 07:53:14.097157 1856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 07:53:14.097530 1862 ts_tablet_manager.cc:1916] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.100909 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef (DEFAULT_TABLE table=default.Table_44474dc1c911457d832d458ce32ec14c [id=53e1523dfa4e4cceb0addb9b9a7efa30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.101003 1170 ts_tablet_manager.cc:1929] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.101087 1170 log.cc:1199] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a2f21861cb6f481eae968edc733e6e6f
I20260617 07:53:14.101305 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.101400 1170 ts_tablet_manager.cc:1950] T a2f21861cb6f481eae968edc733e6e6f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:14.102128 1019 tablet_service.cc:1511] Processing CreateTablet for tablet a7c7083dff434fddbad7f2dcf2a6b6e6 (DEFAULT_TABLE table=default.Table_9937bd83b783442697ef53db3d660fb4 [id=23be61f7550c4f97bfa3c271e2372721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.102397 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c7083dff434fddbad7f2dcf2a6b6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.106168 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 500c2e83277b404b937eddf6c89534b9 (DEFAULT_TABLE table=default.Table_c784578a63aa4fdba651212f46ce5bd1 [id=344252dfce80441cb9012a91c793659e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.106521 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500c2e83277b404b937eddf6c89534b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.107597 880 tablet_service.cc:1511] Processing CreateTablet for tablet 43106674307b4610abea9a68590aecef (DEFAULT_TABLE table=default.Table_e33a84b1d8554d62aebbf2f6ffb338d9 [id=7e73469c3f9e4fc8bb92608b72c30cbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.107968 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43106674307b4610abea9a68590aecef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.110167 1020 tablet_service.cc:1511] Processing CreateTablet for tablet b15ce9f172974ef39f4dad71324550d8 (DEFAULT_TABLE table=default.Table_9e7b6c33248348bdba38f8555f67a3d2 [id=5921a77d11be4638819c30644e1a8aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.110478 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15ce9f172974ef39f4dad71324550d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.111068 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:14.111353 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:14.111611 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_0c3bb1ff748948298d93736f1a8583e4 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 1 got 0
I20260617 07:53:14.111791 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:14.111904 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:14.112433 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:14.112598 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:14.112841 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet adbbe7eb5181431290f57ed9128181a3 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]). Expected version 1 got 0
I20260617 07:53:14.113039 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]). Expected version 1 got 0
I20260617 07:53:14.113232 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:14.117341 897 tablet_service.cc:1511] Processing CreateTablet for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef (DEFAULT_TABLE table=default.Table_44474dc1c911457d832d458ce32ec14c [id=53e1523dfa4e4cceb0addb9b9a7efa30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.118126 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.113699 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:14.120904 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:14.121117 1171 tablet_bootstrap.cc:492] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:14.121258 1171 ts_tablet_manager.cc:1403] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260617 07:53:14.121430 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 88) took 2505 ms. Trace:
I20260617 07:53:14.121511 1170 rpcz_store.cc:276] 0617 07:53:11.615615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.615651 (+ 36us) service_pool.cc:224] Handling call
0617 07:53:14.075381 (+2459730us) ts_tablet_manager.cc:1151] Deleting tablet a2f21861cb6f481eae968edc733e6e6f
0617 07:53:14.075391 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.087147 (+ 11756us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.100936 (+ 13789us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.121410 (+ 20474us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2459600}
I20260617 07:53:14.121116 453 catalog_manager.cc:5696] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:14.122411 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:14.122321 1171 raft_consensus.cc:359] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.122526 1171 raft_consensus.cc:385] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.122645 1171 raft_consensus.cc:740] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.122761 1170 tablet_replica.cc:333] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:14.122622 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a2f21861cb6f481eae968edc733e6e6f (table default.Table_35ca50ee926746e499128390bf83c078 [id=12d27e43b2da42f7b55dbf5c9f4b103f]) successfully deleted
I20260617 07:53:14.122942 1171 consensus_queue.cc:260] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.123167 1170 raft_consensus.cc:2243] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:14.123632 1170 pending_rounds.cc:70] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:14.123689 1171 ts_tablet_manager.cc:1434] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:14.124010 1171 tablet_bootstrap.cc:492] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:14.124102 1170 pending_rounds.cc:77] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772723037413376 op_type: NO_OP noop_request { }
I20260617 07:53:14.124320 1170 raft_consensus.cc:2889] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:14.124432 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
I20260617 07:53:14.124523 1170 raft_consensus.cc:2272] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.125164 880 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b with delete_type TABLET_DATA_DELETED (replaced by tablet 0b85d49f255940eeaf343bfcf71e00e9) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.125689 1170 ts_tablet_manager.cc:1916] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.125950 1171 tablet_bootstrap.cc:654] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.128230 897 tablet_service.cc:1511] Processing CreateTablet for tablet 500c2e83277b404b937eddf6c89534b9 (DEFAULT_TABLE table=default.Table_c784578a63aa4fdba651212f46ce5bd1 [id=344252dfce80441cb9012a91c793659e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.128865 887 tablet_service.cc:1511] Processing CreateTablet for tablet b15ce9f172974ef39f4dad71324550d8 (DEFAULT_TABLE table=default.Table_9e7b6c33248348bdba38f8555f67a3d2 [id=5921a77d11be4638819c30644e1a8aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.128016 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
I20260617 07:53:14.129588 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
I20260617 07:53:14.129864 880 tablet_service.cc:1511] Processing CreateTablet for tablet a7c7083dff434fddbad7f2dcf2a6b6e6 (DEFAULT_TABLE table=default.Table_9937bd83b783442697ef53db3d660fb4 [id=23be61f7550c4f97bfa3c271e2372721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.132759 1862 ts_tablet_manager.cc:1929] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.133584 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15dcc10552d4747bad436538662bb66" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:14.133845 1862 log.cc:1199] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/7392ca4ba6a140e19c57e962a26162af
I20260617 07:53:14.134004 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:14.134258 1862 ts_tablet_manager.cc:1950] T 7392ca4ba6a140e19c57e962a26162af P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.134521 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:14.135074 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:14.135183 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet c7e43e1a3df54efe992a86dd0bd0c149 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
I20260617 07:53:14.136445 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_920f71d2a7bb466ea8426518f300ac86 [id=9726df7d693441359861876ae1179b4d]). Expected version 4 got 3
I20260617 07:53:14.137495 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:14.138540 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:14.139819 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
W20260617 07:53:14.140539 988 leader_election.cc:343] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.141228 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 8c76bfcbd22e4bfb97346a1b56f68dab (table default.Table_3b87923865964ae78caae0e8d9231e27 [id=ed9c0eecb73c4c529138cdb71267fba1]). Expected version 1 got 0
I20260617 07:53:14.141853 453 catalog_manager.cc:5696] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:14.142354 1170 ts_tablet_manager.cc:1929] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.142501 2086 consensus_queue.cc:1048] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:14.145869 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]). Expected version 3 got 0
I20260617 07:53:14.146816 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:14.147249 453 catalog_manager.cc:5696] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:14.147693 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:14.148061 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_16fbac0e677342729f3fe3f6555cde4b [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 2 got 0
I20260617 07:53:14.148294 453 catalog_manager.cc:5696] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:14.148684 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:14.149223 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:14.149408 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:14.149627 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:14.154906 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 70) took 2381 ms. Trace:
I20260617 07:53:14.155036 1862 rpcz_store.cc:276] 0617 07:53:11.773808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.796769 (+ 22961us) service_pool.cc:224] Handling call
0617 07:53:14.089357 (+2292588us) ts_tablet_manager.cc:1151] Deleting tablet 7392ca4ba6a140e19c57e962a26162af
0617 07:53:14.089366 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.115345 (+ 25979us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.132675 (+ 17330us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.154864 (+ 22189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2292365}
I20260617 07:53:14.155381 1862 tablet_replica.cc:333] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:14.155601 1862 raft_consensus.cc:2243] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.155766 1862 pending_rounds.cc:70] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:14.155843 1862 pending_rounds.cc:77] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772712973697024 op_type: NO_OP noop_request { }
I20260617 07:53:14.155968 1862 raft_consensus.cc:2889] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:14.156111 1862 raft_consensus.cc:2272] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.156751 1862 ts_tablet_manager.cc:1916] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.157174 885 tablet_service.cc:1511] Processing CreateTablet for tablet 446114516f164dc0a956f2ccbf2e7c35 (DEFAULT_TABLE table=default.Table_2da085a4502d4943857234839bbbf9d9 [id=8f6c6244ed2c445e8a4d7ec26ca31ef2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.158566 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 7392ca4ba6a140e19c57e962a26162af (table default.Table_7e5bc7ff50154b6ea71d9df096938e22 [id=7b8289fa3bd0446d8c61e654188ef0a1]) successfully deleted
I20260617 07:53:14.159689 1170 log.cc:1199] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a82e4d6c09bb4414ad7f3b760f7ae681
I20260617 07:53:14.160128 1170 ts_tablet_manager.cc:1950] T a82e4d6c09bb4414ad7f3b760f7ae681 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:14.160156 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 with delete_type TABLET_DATA_DELETED (replaced by tablet f395f963a5a5400a966a8d4cc62aadf1) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.160342 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:14.160585 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:14.161612 895 tablet_service.cc:1511] Processing CreateTablet for tablet 146d1b46891a416aafe55aa740e1569e (DEFAULT_TABLE table=default.Table_94f094992132448fa01aa6eebc25e2f6 [id=d1ed9874e5294dee9bb6f8fa5d58f602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.162344 1171 tablet_bootstrap.cc:492] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:14.161947 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:14.162523 1171 ts_tablet_manager.cc:1403] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20260617 07:53:14.162674 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:14.163442 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:14.161525 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 146d1b46891a416aafe55aa740e1569e (DEFAULT_TABLE table=default.Table_94f094992132448fa01aa6eebc25e2f6 [id=d1ed9874e5294dee9bb6f8fa5d58f602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.164037 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146d1b46891a416aafe55aa740e1569e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.164682 1172 tablet_bootstrap.cc:492] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:14.164829 1172 ts_tablet_manager.cc:1403] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.134s user 0.020s sys 0.012s
I20260617 07:53:14.166095 1172 raft_consensus.cc:359] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.166260 1172 raft_consensus.cc:385] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.166322 1172 raft_consensus.cc:740] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.166594 1172 consensus_queue.cc:260] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.167166 1172 ts_tablet_manager.cc:1434] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:14.167419 1172 tablet_bootstrap.cc:492] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:14.169059 1172 tablet_bootstrap.cc:654] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.171607 884 tablet_service.cc:1511] Processing CreateTablet for tablet 13f5cf580e0541b487c799163b1bdd5e (DEFAULT_TABLE table=default.Table_1669fc1629774d918c478aa955e8df7e [id=980a69fb11c94250bd0b0ec591ce68b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.173060 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 13f5cf580e0541b487c799163b1bdd5e (DEFAULT_TABLE table=default.Table_1669fc1629774d918c478aa955e8df7e [id=980a69fb11c94250bd0b0ec591ce68b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.173450 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f5cf580e0541b487c799163b1bdd5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.174510 1171 raft_consensus.cc:359] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.174715 1171 raft_consensus.cc:385] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.174793 1171 raft_consensus.cc:740] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.175050 1171 consensus_queue.cc:260] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.161000 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 89) took 2545 ms. Trace:
I20260617 07:53:14.177380 1170 rpcz_store.cc:276] 0617 07:53:11.616056 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.616116 (+ 60us) service_pool.cc:224] Handling call
0617 07:53:14.122715 (+2506599us) ts_tablet_manager.cc:1151] Deleting tablet a82e4d6c09bb4414ad7f3b760f7ae681
0617 07:53:14.122724 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.138399 (+ 15675us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.142304 (+ 3905us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.160976 (+ 18672us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2506455}
I20260617 07:53:14.177876 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a82e4d6c09bb4414ad7f3b760f7ae681 (table default.Table_b8c2cdf0232f43a2abece8a769ac6cb3 [id=ec77f754c1974d4bbf057719b39c0059]) successfully deleted
I20260617 07:53:14.177986 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 90) took 2561 ms. Trace:
I20260617 07:53:14.178051 1170 rpcz_store.cc:276] 0617 07:53:11.616514 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.616559 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:14.177881 (+2561322us) ts_tablet_manager.cc:1151] Deleting tablet 5203534569bd4da18bc06751f094735f
0617 07:53:14.177889 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.177971 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2561194}
W20260617 07:53:14.179466 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5203534569bd4da18bc06751f094735f because the tablet was not found. No further retry: Not found: Tablet not found: 5203534569bd4da18bc06751f094735f
I20260617 07:53:14.182117 1862 ts_tablet_manager.cc:1929] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.182412 1170 tablet_replica.cc:333] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:14.187595 1170 raft_consensus.cc:2243] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.187824 1170 raft_consensus.cc:2272] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.188405 1170 ts_tablet_manager.cc:1916] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.197165 2143 raft_consensus.cc:493] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.197294 2143 raft_consensus.cc:515] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.197530 770 raft_consensus.cc:2468] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 2.
I20260617 07:53:14.197942 2143 leader_election.cc:290] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:14.200157 1862 log.cc:1199] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:14.201123 1862 ts_tablet_manager.cc:1950] T 9cddb9e82c354f26b3abe56ebdefd008 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.202431 1178 ts_tablet_manager.cc:1434] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.220s user 0.001s sys 0.001s
I20260617 07:53:14.202822 1178 tablet_bootstrap.cc:492] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:14.203388 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 71) took 2406 ms. Trace:
I20260617 07:53:14.206005 744 tablet_service.cc:1511] Processing CreateTablet for tablet 38168b7946eb487f91cc7dc47eedfcd8 (DEFAULT_TABLE table=default.Table_94e77b59e906420289e6014bb64dd340 [id=a6b2ab8f6b3748e1892d08ccaf18b7d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.206648 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15dcc10552d4747bad436538662bb66" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:14.207037 759 tablet_service.cc:1511] Processing CreateTablet for tablet fe42e90971464554b1a029b401568938 (DEFAULT_TABLE table=default.Table_6059c873bed34cf5aad6dc245f4bb700 [id=ff169992bdbf4f10ae9d6de79eddeb38]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:14.207597 986 leader_election.cc:343] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.207715 986 leader_election.cc:304] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:14.207831 1862 rpcz_store.cc:276] 0617 07:53:11.797171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.800365 (+ 3194us) service_pool.cc:224] Handling call
0617 07:53:14.155297 (+2354932us) ts_tablet_manager.cc:1151] Deleting tablet 9cddb9e82c354f26b3abe56ebdefd008
0617 07:53:14.155306 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.178987 (+ 23681us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.182012 (+ 3025us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.203329 (+ 21317us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2354692}
I20260617 07:53:14.208243 1862 tablet_replica.cc:333] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:14.209012 2011 raft_consensus.cc:2749] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:14.209239 753 tablet_service.cc:1511] Processing CreateTablet for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 (DEFAULT_TABLE table=default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb [id=964a0b6e388a4823bb124eef82b57431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.209589 747 tablet_service.cc:1511] Processing CreateTablet for tablet 0b479c2984934852a864699b66416538 (DEFAULT_TABLE table=default.Table_6b3ef645c2e84944a54aafdcf255ab13 [id=70f2a5c5967d472e81b5c4575f6ac7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.210276 2143 raft_consensus.cc:2749] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:14.213927 1862 raft_consensus.cc:2243] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.214113 1862 raft_consensus.cc:2272] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.214679 1862 ts_tablet_manager.cc:1916] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.218152 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38168b7946eb487f91cc7dc47eedfcd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.218218 1170 ts_tablet_manager.cc:1929] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.218315 1170 log.cc:1199] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/59acdc64fe9247d28c4c277161b42f4f
I20260617 07:53:14.218600 1170 ts_tablet_manager.cc:1950] T 59acdc64fe9247d28c4c277161b42f4f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:14.225005 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:14.225090 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 52af94bd46c941b8a27136ca0506e744 (DEFAULT_TABLE table=default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.225474 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52af94bd46c941b8a27136ca0506e744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.225909 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8cedb539748dc917128511325bbcc" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:14.228178 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8cedb539748dc917128511325bbcc" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:14.229727 986 leader_election.cc:343] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.231346 745 tablet_service.cc:1511] Processing CreateTablet for tablet bbbea6fe52f04f298eeecdc119bebb65 (DEFAULT_TABLE table=default.Table_2ef5d5b6d55d4cd0adc070cfdf8209a7 [id=c36b5242d93a41dda283989b3204f558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.231736 752 tablet_service.cc:1511] Processing CreateTablet for tablet 5fb489c72a7a4e3590b81c768eeb5c43 (DEFAULT_TABLE table=default.Table_e39af9602cd746f3995e8ccb1f0a95d4 [id=201fadfa5df64f77a364abf704c809ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.232409 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe42e90971464554b1a029b401568938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.234916 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbbea6fe52f04f298eeecdc119bebb65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.227330 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 9cddb9e82c354f26b3abe56ebdefd008 (table default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]) successfully deleted
I20260617 07:53:14.236863 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:14.237092 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet adbbe7eb5181431290f57ed9128181a3 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]). Expected version 1 got 0
I20260617 07:53:14.237458 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]). Expected version 1 got 0
I20260617 07:53:14.238260 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:14.238312 1171 ts_tablet_manager.cc:1434] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.076s user 0.002s sys 0.000s
I20260617 07:53:14.238487 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:14.238642 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:14.239234 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_0c3bb1ff748948298d93736f1a8583e4 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 1 got 0
I20260617 07:53:14.239432 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:14.239675 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
I20260617 07:53:14.239858 1171 tablet_bootstrap.cc:492] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:14.240125 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:14.240269 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500c2e83277b404b937eddf6c89534b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.240543 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:14.240880 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:14.241035 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_920f71d2a7bb466ea8426518f300ac86 [id=9726df7d693441359861876ae1179b4d]). Expected version 4 got 3
I20260617 07:53:14.241258 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
I20260617 07:53:14.241470 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]). Expected version 1 got 0
I20260617 07:53:14.241595 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:14.241683 751 tablet_service.cc:1511] Processing CreateTablet for tablet 43106674307b4610abea9a68590aecef (DEFAULT_TABLE table=default.Table_e33a84b1d8554d62aebbf2f6ffb338d9 [id=7e73469c3f9e4fc8bb92608b72c30cbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.242380 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb489c72a7a4e3590b81c768eeb5c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.244989 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15ce9f172974ef39f4dad71324550d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.246575 1862 ts_tablet_manager.cc:1929] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.246726 1862 log.cc:1199] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0ebafc920ed34216be5fb115f9bc6f7f
I20260617 07:53:14.247112 1862 ts_tablet_manager.cc:1950] T 0ebafc920ed34216be5fb115f9bc6f7f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.247490 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 72) took 2446 ms. Trace:
I20260617 07:53:14.247611 1862 rpcz_store.cc:276] 0617 07:53:11.800761 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.800809 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:14.208179 (+2407370us) ts_tablet_manager.cc:1151] Deleting tablet 0ebafc920ed34216be5fb115f9bc6f7f
0617 07:53:14.208190 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.243426 (+ 35236us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.246502 (+ 3076us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.247434 (+ 932us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2407174}
I20260617 07:53:14.247758 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:14.247975 1862 tablet_replica.cc:333] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:14.248536 446 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet ee5ddac997834e97a2d6c9b1855ee4e8 consensus state has no leader
I20260617 07:53:14.250258 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:14.250507 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 8c76bfcbd22e4bfb97346a1b56f68dab (table default.Table_3b87923865964ae78caae0e8d9231e27 [id=ed9c0eecb73c4c529138cdb71267fba1]). Expected version 1 got 0
I20260617 07:53:14.250689 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]). Expected version 3 got 0
I20260617 07:53:14.250996 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]). Expected version 1 got 0
I20260617 07:53:14.251191 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:14.251516 758 tablet_service.cc:1511] Processing CreateTablet for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (DEFAULT_TABLE table=default.Table_a109162a61eb408c80979471592ad6b2 [id=494c90461b61486ab6dad26bbd3acab5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.251724 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:14.252115 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_29925f966d344ba89f83ad512a5bf335 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 1 got 0
I20260617 07:53:14.252136 756 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b with delete_type TABLET_DATA_DELETED (replaced by tablet 0b85d49f255940eeaf343bfcf71e00e9) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.252418 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:14.252524 760 tablet_service.cc:1511] Processing CreateTablet for tablet 446114516f164dc0a956f2ccbf2e7c35 (DEFAULT_TABLE table=default.Table_2da085a4502d4943857234839bbbf9d9 [id=8f6c6244ed2c445e8a4d7ec26ca31ef2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.252892 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43106674307b4610abea9a68590aecef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.253156 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c7083dff434fddbad7f2dcf2a6b6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.256446 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:14.256631 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:14.256853 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:14.257102 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:14.257440 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:14.257632 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:14.257781 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_18615792e6cb4a0480280818c51fef6d [id=b20987ff1f1c43098b1408b126b32913]). Expected version 1 got 0
I20260617 07:53:14.257922 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:14.258157 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446114516f164dc0a956f2ccbf2e7c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.258178 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:14.258325 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:14.261140 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146d1b46891a416aafe55aa740e1569e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.261662 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9f97b99a0ab74a3782a8dfa84db280cc" } modify_external_catalogs: true
I20260617 07:53:14.261838 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446114516f164dc0a956f2ccbf2e7c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.261857 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9f97b99a0ab74a3782a8dfa84db280cc" } modify_external_catalogs: true
I20260617 07:53:14.262583 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 with delete_type TABLET_DATA_DELETED (replaced by tablet f395f963a5a5400a966a8d4cc62aadf1) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.262981 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777] alter complete (version 3)
I20260617 07:53:14.248173 1862 raft_consensus.cc:2243] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.265981 1862 raft_consensus.cc:2272] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.267282 1178 tablet_bootstrap.cc:654] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.267369 1862 ts_tablet_manager.cc:1916] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.268500 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f5cf580e0541b487c799163b1bdd5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.269647 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b479c2984934852a864699b66416538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.271596 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d] alter complete (version 1)
I20260617 07:53:14.271641 756 tablet_service.cc:1511] Processing CreateTablet for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef (DEFAULT_TABLE table=default.Table_44474dc1c911457d832d458ce32ec14c [id=53e1523dfa4e4cceb0addb9b9a7efa30]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:14.271970 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca400838f5214d1a8f57e72c5068f0f9 consensus state has no leader
I20260617 07:53:14.272195 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.272367 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e01c4bf739194d638e2a3988702d4cfb" } modify_external_catalogs: true
I20260617 07:53:14.272529 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e01c4bf739194d638e2a3988702d4cfb" } modify_external_catalogs: true
I20260617 07:53:14.273864 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.273955 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9cbd5b289a9346eaad72894e1a5dd1c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.274477 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cbd5b289a9346eaad72894e1a5dd1c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.281291 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_18615792e6cb4a0480280818c51fef6d" } new_table_name: "default.Table_f86c4a5d30d546a890795712293d1a2f" modify_external_catalogs: true
W20260617 07:53:14.290341 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d94915d96694d6f9a86063640e5fe18 consensus state has no leader
I20260617 07:53:14.290758 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_92b0d73b0ca04fd4bfb2980b6975bded"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.291365 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92b0d73b0ca04fd4bfb2980b6975bded in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.292794 741 tablet_service.cc:1511] Processing CreateTablet for tablet 500c2e83277b404b937eddf6c89534b9 (DEFAULT_TABLE table=default.Table_c784578a63aa4fdba651212f46ce5bd1 [id=344252dfce80441cb9012a91c793659e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.293023 754 tablet_service.cc:1511] Processing CreateTablet for tablet a7c7083dff434fddbad7f2dcf2a6b6e6 (DEFAULT_TABLE table=default.Table_9937bd83b783442697ef53db3d660fb4 [id=23be61f7550c4f97bfa3c271e2372721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.293462 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5c409221fa4a069f2427150d4499da (DEFAULT_TABLE table=default.Table_3edd5bcee7e04d8c8974fe2880a5d2d1 [id=4979733a52f54c1496c5b75da292f5bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.293865 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5c409221fa4a069f2427150d4499da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.294479 1987 raft_consensus.cc:493] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.294615 1987 raft_consensus.cc:515] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.295212 1987 leader_election.cc:290] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:14.296604 851 leader_election.cc:343] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 57e05a97a4ab4ed7bff523d1fb1c59ae
I20260617 07:53:14.296813 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet c9657e0dd2a8459cb728bdfe8a68b840
I20260617 07:53:14.297473 1052 raft_consensus.cc:1275] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:14.297569 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9e0d150692fa47c5971861b6614f2b62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.298132 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e0d150692fa47c5971861b6614f2b62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.298270 2086 consensus_queue.cc:1048] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:14.298539 1030 tablet_service.cc:1511] Processing CreateTablet for tablet ee4936517b0e45ce972b0f6e2faa238d (DEFAULT_TABLE table=default.Table_77e3d12071b343569fe1fc74b25e5f18 [id=a5f22aea60b74f7c852c63edc42da862]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.298913 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4936517b0e45ce972b0f6e2faa238d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.298959 1052 raft_consensus.cc:1275] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:14.300642 1987 consensus_queue.cc:1048] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:14.302662 1172 tablet_bootstrap.cc:492] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:14.302852 1172 ts_tablet_manager.cc:1403] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.135s user 0.003s sys 0.000s
W20260617 07:53:14.303077 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c019792d23484fb789378bf377547415 consensus state has no leader
I20260617 07:53:14.303617 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 52af94bd46c941b8a27136ca0506e744
I20260617 07:53:14.303769 1172 raft_consensus.cc:359] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.303933 1172 raft_consensus.cc:385] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.303990 1172 raft_consensus.cc:740] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.304319 1172 consensus_queue.cc:260] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.304360 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_6fcd834879b6472a9345cb6621c95bef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:14.304908 1172 ts_tablet_manager.cc:1434] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260617 07:53:14.304894 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fcd834879b6472a9345cb6621c95bef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.305186 1172 tablet_bootstrap.cc:492] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:14.306555 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.306965 1987 raft_consensus.cc:493] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.307121 1987 raft_consensus.cc:515] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.307502 1172 tablet_bootstrap.cc:654] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.307530 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 52af94bd46c941b8a27136ca0506e744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.307729 1987 leader_election.cc:290] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:14.308398 883 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5c409221fa4a069f2427150d4499da (DEFAULT_TABLE table=default.Table_3edd5bcee7e04d8c8974fe2880a5d2d1 [id=4979733a52f54c1496c5b75da292f5bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.308512 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c2bae0d7dfe4512b1674796e5dacf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.309430 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 52af94bd46c941b8a27136ca0506e744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.309656 746 tablet_service.cc:1511] Processing CreateTablet for tablet b15ce9f172974ef39f4dad71324550d8 (DEFAULT_TABLE table=default.Table_9e7b6c33248348bdba38f8555f67a3d2 [id=5921a77d11be4638819c30644e1a8aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.310209 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0ebafc920ed34216be5fb115f9bc6f7f (table default.Table_72eda13c56884241ab3153e5cb1a72d1 [id=78af228b204f4bb5a4e5867d1a9f9124]) successfully deleted
I20260617 07:53:14.310416 743 tablet_service.cc:1511] Processing CreateTablet for tablet 13f5cf580e0541b487c799163b1bdd5e (DEFAULT_TABLE table=default.Table_1669fc1629774d918c478aa955e8df7e [id=980a69fb11c94250bd0b0ec591ce68b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.312172 897 tablet_service.cc:1558] Processing DeleteTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.312827 887 tablet_service.cc:1511] Processing CreateTablet for tablet ee4936517b0e45ce972b0f6e2faa238d (DEFAULT_TABLE table=default.Table_77e3d12071b343569fe1fc74b25e5f18 [id=a5f22aea60b74f7c852c63edc42da862]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.319662 453 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578] alter complete (version 2)
I20260617 07:53:14.321925 755 tablet_service.cc:1511] Processing CreateTablet for tablet 146d1b46891a416aafe55aa740e1569e (DEFAULT_TABLE table=default.Table_94f094992132448fa01aa6eebc25e2f6 [id=d1ed9874e5294dee9bb6f8fa5d58f602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.322279 757 tablet_service.cc:1511] Processing CreateTablet for tablet 52af94bd46c941b8a27136ca0506e744 (DEFAULT_TABLE table=default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.324059 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3
I20260617 07:53:14.324442 895 tablet_service.cc:1511] Processing CreateTablet for tablet 52af94bd46c941b8a27136ca0506e744 (DEFAULT_TABLE table=default.Table_64457de2b58244afa9932a32a979774d [id=bb603c5d52014c11bcf699ed474ed98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.324915 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8e82234c43f24c1c8a1d9275a00ddad8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.325479 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e82234c43f24c1c8a1d9275a00ddad8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.326501 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500c2e83277b404b937eddf6c89534b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.329226 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:14.329412 988 leader_election.cc:343] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.330024 988 leader_election.cc:304] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:14.330283 2143 raft_consensus.cc:2749] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:14.333806 851 leader_election.cc:343] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: be14a95f458d440e86133ef65c484571
I20260617 07:53:14.338553 2143 raft_consensus.cc:493] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.338721 2143 raft_consensus.cc:515] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.339432 2143 leader_election.cc:290] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:14.344048 880 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.345180 2143 consensus_queue.cc:1048] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:14.350203 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52af94bd46c941b8a27136ca0506e744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.351495 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2d9e473fd444efa6ab63cc51dbb2bd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:14.355202 1172 tablet_bootstrap.cc:492] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:14.356313 1172 ts_tablet_manager.cc:1403] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.051s user 0.006s sys 0.001s
W20260617 07:53:14.357702 988 leader_election.cc:343] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.360126 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 5f8602b87a20455884c16196a901d335
I20260617 07:53:14.360986 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1a5905f1182a42e49a2f920255c65e18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.361610 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a5905f1182a42e49a2f920255c65e18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.365945 750 tablet_service.cc:1558] Processing DeleteTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.366309 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2d9e473fd444efa6ab63cc51dbb2bd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:14.363042 1172 raft_consensus.cc:359] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.366456 1172 raft_consensus.cc:385] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 07:53:14.366876 986 leader_election.cc:343] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.367487 2011 raft_consensus.cc:493] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:14.367534 986 leader_election.cc:304] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:14.367889 2143 raft_consensus.cc:2749] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:14.366844 1172 raft_consensus.cc:740] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.368907 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_94fefeabbc244e55a4ebb57d7e80f0ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.369586 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94fefeabbc244e55a4ebb57d7e80f0ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.369568 1172 consensus_queue.cc:260] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.371649 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c4e47d1c1dd44cd0b8444ac78849276a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.372255 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4e47d1c1dd44cd0b8444ac78849276a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.372318 2011 raft_consensus.cc:515] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.374061 1172 ts_tablet_manager.cc:1434] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.017s user 0.002s sys 0.001s
I20260617 07:53:14.373564 760 tablet_service.cc:1511] Processing CreateTablet for tablet ee4936517b0e45ce972b0f6e2faa238d (DEFAULT_TABLE table=default.Table_77e3d12071b343569fe1fc74b25e5f18 [id=a5f22aea60b74f7c852c63edc42da862]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.376137 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f8602b87a20455884c16196a901d335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.385636 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 3e3d05dcda274f288aebc279aba3e10a from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:14.387264 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 52af94bd46c941b8a27136ca0506e744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.387480 742 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.388135 2011 leader_election.cc:290] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:14.388823 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f8602b87a20455884c16196a901d335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:14.389073 716 leader_election.cc:343] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: c7343400555f447b8a1721ba36d7766d
I20260617 07:53:14.390906 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c7083dff434fddbad7f2dcf2a6b6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.396727 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f8602b87a20455884c16196a901d335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.401841 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15ce9f172974ef39f4dad71324550d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.402561 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f5cf580e0541b487c799163b1bdd5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.398422 852 leader_election.cc:304] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba; no voters: dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:14.404197 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146d1b46891a416aafe55aa740e1569e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.405318 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_360fa4c3327249579a54f68d3a81e327"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.405999 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_360fa4c3327249579a54f68d3a81e327 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.407003 1987 raft_consensus.cc:2804] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 2 FOLLOWER]: Leader election won for term 2
I20260617 07:53:14.407131 1987 raft_consensus.cc:697] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 2 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:14.407356 1987 consensus_queue.cc:237] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.407526 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9fe905fdfa404b8484be742e4c275d96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.408039 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fe905fdfa404b8484be742e4c275d96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:14.418751 986 consensus_peers.cc:597] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:14.421455 2011 raft_consensus.cc:493] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:14.421633 2011 raft_consensus.cc:515] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.425412 2011 leader_election.cc:290] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:14.426396 716 leader_election.cc:343] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 950c1c44020a4586b3197f5f68a38963
I20260617 07:53:14.431169 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 3e3d05dcda274f288aebc279aba3e10a
I20260617 07:53:14.434085 457 catalog_manager.cc:6784] ReplaceTablet: tablet 3e3d05dcda274f288aebc279aba3e10a deleted and replaced by tablet bc57a1e3bc8b434da43f484705476b9b
I20260617 07:53:14.434648 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3d05dcda274f288aebc279aba3e10a with delete_type TABLET_DATA_DELETED (replaced by tablet bc57a1e3bc8b434da43f484705476b9b) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.435191 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3d05dcda274f288aebc279aba3e10a with delete_type TABLET_DATA_DELETED (replaced by tablet bc57a1e3bc8b434da43f484705476b9b) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.445991 1172 tablet_bootstrap.cc:492] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:14.448170 1172 tablet_bootstrap.cc:654] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.449537 2143 raft_consensus.cc:493] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.449699 2143 raft_consensus.cc:515] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.450413 2143 leader_election.cc:290] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:14.453933 2184 tablet.cc:1724] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:14.457127 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 79) took 2844 ms. Trace:
I20260617 07:53:14.457374 1170 rpcz_store.cc:276] 0617 07:53:11.612244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.616889 (+ 4645us) service_pool.cc:224] Handling call
0617 07:53:14.182355 (+2565466us) ts_tablet_manager.cc:1151] Deleting tablet 59acdc64fe9247d28c4c277161b42f4f
0617 07:53:14.182367 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.201570 (+ 19203us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.218160 (+ 16590us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.457098 (+238938us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1702,"tablet-delete.queue_time_us":2565336}
I20260617 07:53:14.458247 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 59acdc64fe9247d28c4c277161b42f4f (table default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]) successfully deleted
I20260617 07:53:14.458931 1170 tablet_replica.cc:333] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:14.463461 1987 raft_consensus.cc:493] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.463652 1987 raft_consensus.cc:515] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.463871 1170 raft_consensus.cc:2243] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.464077 1170 raft_consensus.cc:2272] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.464004 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ddca8eb1aba6417a8cb8a723dd38551b" } new_table_name: "default.Table_43f3f6d0ce9c485d90bac2d86ec29f39" modify_external_catalogs: true
I20260617 07:53:14.464648 1170 ts_tablet_manager.cc:1916] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.464813 1987 leader_election.cc:290] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:14.464780 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53108a2d6c8b4398a568c14df8e0a23e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:14.464951 1047 raft_consensus.cc:2468] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:14.465472 851 leader_election.cc:304] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:14.465912 1987 raft_consensus.cc:2804] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:14.466513 1987 raft_consensus.cc:493] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:14.466723 1987 raft_consensus.cc:3060] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:14.469050 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66140c5d364f453a8089f143cc96ede8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:14.469633 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4936517b0e45ce972b0f6e2faa238d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:14.470625 988 leader_election.cc:343] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:14.470927 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 488cc3a082b14dee8f70153e6f2925a4 consensus state has no leader
I20260617 07:53:14.471738 1987 raft_consensus.cc:515] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.474433 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6fcd834879b6472a9345cb6621c95bef" } new_table_name: "default.Table_254698a40b82484f8ed8c47e68fb0b68" modify_external_catalogs: true
I20260617 07:53:14.475502 1846 ts_tablet_manager.cc:1929] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.475687 1846 log.cc:1199] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/b01721f68e3c41f4a2ffaf05bb180761
I20260617 07:53:14.476125 1846 ts_tablet_manager.cc:1950] T b01721f68e3c41f4a2ffaf05bb180761 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:14.478260 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_16fbac0e677342729f3fe3f6555cde4b" } new_table_name: "default.Table_8dd1d9e74c1245e1afe42a16f20e57f6" modify_external_catalogs: true
I20260617 07:53:14.478425 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53108a2d6c8b4398a568c14df8e0a23e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:14.478597 1052 raft_consensus.cc:3060] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:14.478499 1987 leader_election.cc:290] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:14.480655 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 8db4fdde370e4d30bbf14285923644a1
I20260617 07:53:14.481141 1052 raft_consensus.cc:2468] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:14.481601 851 leader_election.cc:304] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:14.481984 1987 raft_consensus.cc:2804] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:14.482178 1987 raft_consensus.cc:697] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:14.482414 1987 consensus_queue.cc:237] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.488044 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db4fdde370e4d30bbf14285923644a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.489074 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db4fdde370e4d30bbf14285923644a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.489504 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_35df243dcbf147028c18e6e47085e771"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.490211 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35df243dcbf147028c18e6e47085e771 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.489694 2184 tablet.cc:1724] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:14.490885 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e05a97a4ab4ed7bff523d1fb1c59ae" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:14.494328 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a109162a61eb408c80979471592ad6b2" } new_table_name: "default.Table_78c4ad680e8849b18da7d278b7ecaf51" modify_external_catalogs: true
I20260617 07:53:14.489368 751 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5c409221fa4a069f2427150d4499da (DEFAULT_TABLE table=default.Table_3edd5bcee7e04d8c8974fe2880a5d2d1 [id=4979733a52f54c1496c5b75da292f5bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.496258 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66140c5d364f453a8089f143cc96ede8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:14.496757 986 leader_election.cc:343] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.496878 986 leader_election.cc:304] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:14.497133 2143 raft_consensus.cc:2749] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:14.500994 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d175a3c6daf849a68772a50df0940f7e" } modify_external_catalogs: true
I20260617 07:53:14.501219 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d175a3c6daf849a68772a50df0940f7e" } modify_external_catalogs: true
W20260617 07:53:14.505147 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdb1b67f4cb7463b98a63ec75d38890f has no consensus state
I20260617 07:53:14.510221 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a419ba4ac7ca4fb583f6da5781f87dba" } modify_external_catalogs: true
I20260617 07:53:14.510422 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a419ba4ac7ca4fb583f6da5781f87dba" } modify_external_catalogs: true
W20260617 07:53:14.518884 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c2bae0d7dfe4512b1674796e5dacf27 consensus state has no leader
I20260617 07:53:14.519415 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet adbbe7eb5181431290f57ed9128181a3
I20260617 07:53:14.520617 880 tablet_service.cc:1558] Processing DeleteTablet for tablet adbbe7eb5181431290f57ed9128181a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.521313 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet adbbe7eb5181431290f57ed9128181a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.526422 2184 tablet.cc:1724] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:14.527344 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_f4b27f0c168e4788986ff63a8dbca936" } modify_external_catalogs: true
I20260617 07:53:14.528172 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_f4b27f0c168e4788986ff63a8dbca936" } modify_external_catalogs: true
I20260617 07:53:14.534222 2187 tablet.cc:1724] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:14.535816 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet c58bbdbf59c7426c8adbbbe3f0aafaed
I20260617 07:53:14.536623 880 tablet_service.cc:1558] Processing DeleteTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.536825 2178 tablet.cc:1724] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:14.537268 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.544068 2087 consensus_queue.cc:1048] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:14.547161 453 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet adbbe7eb5181431290f57ed9128181a3 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet adbbe7eb5181431290f57ed9128181a3 consensus state has no leader
I20260617 07:53:14.548295 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.549899 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.550251 880 tablet_service.cc:1558] Processing DeleteTablet for tablet d21f61a35ca544568bcfca1a6230deca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.550598 880 tablet_service.cc:1558] Processing DeleteTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 with delete_type TABLET_DATA_DELETED (replaced by tablet 36ce60b466f7420992ef194d72b5718d) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.551082 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 7392ca4ba6a140e19c57e962a26162af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.554224 2143 raft_consensus.cc:493] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.554375 2143 raft_consensus.cc:515] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.556581 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ec78c123d448329b8442a0de0140d3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:14.557098 988 leader_election.cc:343] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.557389 2143 leader_election.cc:290] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:14.562785 1172 tablet_bootstrap.cc:492] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:14.563462 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_43f3f6d0ce9c485d90bac2d86ec29f39" } modify_external_catalogs: true
I20260617 07:53:14.563673 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_43f3f6d0ce9c485d90bac2d86ec29f39" } modify_external_catalogs: true
I20260617 07:53:14.564637 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5c409221fa4a069f2427150d4499da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.570739 1172 ts_tablet_manager.cc:1403] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.125s user 0.010s sys 0.002s
I20260617 07:53:14.564221 2188 tablet.cc:1724] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:14.572654 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e3c486f7fa954fc68ec3f00121664da5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.573267 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3c486f7fa954fc68ec3f00121664da5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.574985 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d96805f03e8f47b58040c4896878c01e" } new_table_name: "default.Table_aab2b789b2dc48719838e0704687a406" modify_external_catalogs: true
I20260617 07:53:14.569140 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ec78c123d448329b8442a0de0140d3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:14.579057 986 leader_election.cc:343] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.579192 986 leader_election.cc:304] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:14.579499 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be14a95f458d440e86133ef65c484571" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:14.582314 2143 raft_consensus.cc:2749] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:14.591878 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_513f8c4d25114eb89041a6f10d07af8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.592684 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_513f8c4d25114eb89041a6f10d07af8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.594519 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53108a2d6c8b4398a568c14df8e0a23e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:14.594617 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3dc653e501984d0b9ab8f960d94fb7a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.595211 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dc653e501984d0b9ab8f960d94fb7a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:14.597235 446 consensus_peers.cc:597] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f -> Peer 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505): Couldn't send request to peer 29a94ff9f875443ab6aeac00922cda0d. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260617 07:53:14.601825 764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53108a2d6c8b4398a568c14df8e0a23e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:14.603407 1172 raft_consensus.cc:359] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.603730 1172 raft_consensus.cc:385] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.603844 1172 raft_consensus.cc:740] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.604157 1172 consensus_queue.cc:260] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.604979 1172 ts_tablet_manager.cc:1434] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260617 07:53:14.605096 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_dc7b3a260be0403aa988a9e09d73be9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:14.605381 1172 tablet_bootstrap.cc:492] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:14.605661 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc7b3a260be0403aa988a9e09d73be9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.607736 2191 tablet.cc:1724] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:14.608446 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_611568f3c8e3430381233e6f3ee4ac1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.609036 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_611568f3c8e3430381233e6f3ee4ac1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.618986 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_16971ccf055b46f0b31b36cc72ae619c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.619565 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16971ccf055b46f0b31b36cc72ae619c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.620811 1862 ts_tablet_manager.cc:1929] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.620999 1862 log.cc:1199] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/245cff69d83b43e98b1c72b8d3011347
I20260617 07:53:14.621471 1862 ts_tablet_manager.cc:1950] T 245cff69d83b43e98b1c72b8d3011347 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.621824 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8f6fcc4db43e45beb5146c43fcb3d19d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:14.622462 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f6fcc4db43e45beb5146c43fcb3d19d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.622903 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4936517b0e45ce972b0f6e2faa238d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.629869 1171 tablet_bootstrap.cc:654] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.631731 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52af94bd46c941b8a27136ca0506e744. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:14.633642 713 leader_election.cc:343] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: c7343400555f447b8a1721ba36d7766d
I20260617 07:53:14.633812 713 leader_election.cc:304] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:14.634115 2125 raft_consensus.cc:2749] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:14.634259 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 73) took 2831 ms. Trace:
I20260617 07:53:14.634330 1862 rpcz_store.cc:276] 0617 07:53:11.802516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.802565 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:14.247884 (+2445319us) ts_tablet_manager.cc:1151] Deleting tablet 245cff69d83b43e98b1c72b8d3011347
0617 07:53:14.247893 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.270694 (+ 22801us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.620757 (+350063us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.634242 (+ 13485us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2445111}
I20260617 07:53:14.634675 1862 tablet_replica.cc:333] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:14.634845 1862 raft_consensus.cc:2243] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:14.635311 1862 raft_consensus.cc:2272] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.637394 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5c409221fa4a069f2427150d4499da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.639714 1862 ts_tablet_manager.cc:1916] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:14.639868 713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 48812.2us
W20260617 07:53:14.640285 713 leader_election.cc:343] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 950c1c44020a4586b3197f5f68a38963
I20260617 07:53:14.641769 713 leader_election.cc:304] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:14.642482 2125 raft_consensus.cc:2749] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:14.644553 756 tablet_service.cc:1558] Processing DeleteTablet for tablet adbbe7eb5181431290f57ed9128181a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.645159 1862 ts_tablet_manager.cc:1929] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.645272 1862 log.cc:1199] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0f9db8a986b344548e435b77edc14cb6
I20260617 07:53:14.647212 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db4fdde370e4d30bbf14285923644a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.648100 1172 tablet_bootstrap.cc:654] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.649842 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3d05dcda274f288aebc279aba3e10a with delete_type TABLET_DATA_DELETED (replaced by tablet bc57a1e3bc8b434da43f484705476b9b) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.653889 751 tablet_service.cc:1558] Processing DeleteTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.663816 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 50) took 2897 ms. Trace:
I20260617 07:53:14.664052 1846 rpcz_store.cc:276] 0617 07:53:11.665650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.665695 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:13.920003 (+2254308us) ts_tablet_manager.cc:1151] Deleting tablet b01721f68e3c41f4a2ffaf05bb180761
0617 07:53:13.920014 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:13.939734 (+ 19720us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.176305 (+236571us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.562590 (+386285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28194,"tablet-delete.queue_time_us":2227786}
I20260617 07:53:14.664719 1846 tablet_replica.cc:333] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:14.664680 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet b01721f68e3c41f4a2ffaf05bb180761 (table default.Table_222b195724fd4c0a86c636969ca9d0f0 [id=544e7bcc34ae49688f95e64400ce17f1]) successfully deleted
I20260617 07:53:14.665053 1846 raft_consensus.cc:2243] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.665330 1846 raft_consensus.cc:2272] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:14.669067 453 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2a61124fa6f846a6be1a208f2eaa7c20 consensus state has no leader
I20260617 07:53:14.670756 1170 ts_tablet_manager.cc:1929] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.670888 1170 log.cc:1199] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d03d6dc473fc4be1a436fd71a06f403e
I20260617 07:53:14.671523 1170 ts_tablet_manager.cc:1950] T d03d6dc473fc4be1a436fd71a06f403e P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:14.651465 851 consensus_peers.cc:597] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0cfb98aecc4546c88371436fcfbf8e86. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:14.675726 2125 raft_consensus.cc:493] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.675894 2125 raft_consensus.cc:515] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.676535 2125 leader_election.cc:290] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:14.677402 716 leader_election.cc:343] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 28e1fd7f91f94221884be2166f0cc793
I20260617 07:53:14.667194 1171 tablet_bootstrap.cc:492] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:14.653049 2178 tablet.cc:1724] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:14.678583 1171 ts_tablet_manager.cc:1403] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.440s user 0.010s sys 0.016s
W20260617 07:53:14.679306 713 leader_election.cc:343] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 28e1fd7f91f94221884be2166f0cc793
I20260617 07:53:14.679514 713 leader_election.cc:304] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:14.679476 1171 raft_consensus.cc:359] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.679643 1171 raft_consensus.cc:385] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.679780 1171 raft_consensus.cc:740] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.679863 2125 raft_consensus.cc:2749] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:14.680212 1171 consensus_queue.cc:260] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:14.671370 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 86566us
I20260617 07:53:14.645696 1862 ts_tablet_manager.cc:1950] T 0f9db8a986b344548e435b77edc14cb6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.683866 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 74) took 2874 ms. Trace:
I20260617 07:53:14.684777 1862 rpcz_store.cc:276] 0617 07:53:11.809446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.809502 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:14.634633 (+2825131us) ts_tablet_manager.cc:1151] Deleting tablet 0f9db8a986b344548e435b77edc14cb6
0617 07:53:14.634641 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.642512 (+ 7871us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.645114 (+ 2602us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.683848 (+ 38734us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2824843}
I20260617 07:53:14.685178 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_d018eef700b3482a83212d8b4a10041e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:14.685779 1862 tablet_replica.cc:333] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:14.685842 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d018eef700b3482a83212d8b4a10041e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.687306 1178 tablet_bootstrap.cc:492] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:14.687489 1178 ts_tablet_manager.cc:1403] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.485s user 0.003s sys 0.019s
I20260617 07:53:14.688903 1178 raft_consensus.cc:359] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.689167 1178 raft_consensus.cc:385] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.689244 1178 raft_consensus.cc:740] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.689157 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_d8060f340cdb46ecb14589d645903439"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:14.689553 1178 consensus_queue.cc:260] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:14.689674 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8060f340cdb46ecb14589d645903439 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:14.698427 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b12221b517d346f3adec5874b70f1eb6" } new_table_name: "default.Table_2cd3859046ff474fa0cd1bdc9145099c" modify_external_catalogs: true
I20260617 07:53:14.701179 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d863711c4bc44037a3f8927442a50d68" } modify_external_catalogs: true
I20260617 07:53:14.701372 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d863711c4bc44037a3f8927442a50d68" } modify_external_catalogs: true
I20260617 07:53:14.701756 1846 ts_tablet_manager.cc:1916] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.710150 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 245cff69d83b43e98b1c72b8d3011347 (table default.Table_1735b3a964d948ea9c83c11e8adf8c68 [id=7a799def323b4e8d958c34f9ace044a2]) successfully deleted
W20260617 07:53:14.711205 852 leader_election.cc:343] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.711338 852 leader_election.cc:304] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:14.712522 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.712553 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 5942eea42c7541349ad7b6560e6777c8 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:14.713610 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:14.716658 453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:46601 (request call id 215) took 879 ms (client timeout 1000 ms). Trace:
I20260617 07:53:14.719794 1172 tablet_bootstrap.cc:492] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:14.720024 1172 ts_tablet_manager.cc:1403] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.115s user 0.005s sys 0.014s
I20260617 07:53:14.723747 1178 ts_tablet_manager.cc:1434] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260617 07:53:14.725133 1172 raft_consensus.cc:359] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.725371 1172 raft_consensus.cc:385] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.725485 1172 raft_consensus.cc:740] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.725805 1172 consensus_queue.cc:260] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.726289 1178 tablet_bootstrap.cc:492] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:14.726336 1172 ts_tablet_manager.cc:1434] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260617 07:53:14.727721 1172 tablet_bootstrap.cc:492] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:14.716818 453 rpcz_store.cc:269] 0617 07:53:13.837097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.839459 (+ 2362us) service_pool.cc:224] Handling call
0617 07:53:13.901970 (+ 62511us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:14.187760 (+285790us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.187768 (+ 8us) write_op.cc:454] Released schema lock
0617 07:53:14.233506 (+ 45738us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.233511 (+ 5us) write_op.cc:454] Released schema lock
0617 07:53:14.716613 (+483102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:14.166637 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:14.166732 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:14.166739 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:14.166741 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:14.166912 (+ 171us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:14.166927 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:14.166932 (+ 5us) tablet.cc:685] Acquiring locks for 4 operations
0617 07:53:14.167038 (+ 106us) tablet.cc:701] Row locks acquired
0617 07:53:14.167041 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:14.167079 (+ 38us) write_op.cc:270] Start()
0617 07:53:14.167113 (+ 34us) write_op.cc:276] Timestamp: P: 1781682794167016 usec, L: 0
0617 07:53:14.167117 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:14.167305 (+ 188us) log.cc:844] Serialized 1674 byte log entry
0617 07:53:14.176512 (+ 9207us) op_driver.cc:464] REPLICATION: finished
0617 07:53:14.176627 (+ 115us) write_op.cc:301] APPLY: starting
0617 07:53:14.176643 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:14.176714 (+ 71us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:14.176737 (+ 23us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:14.176828 (+ 91us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:14.176866 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0617 07:53:14.176873 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:14.176998 (+ 125us) log.cc:844] Serialized 41 byte log entry
0617 07:53:14.177067 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.177094 (+ 27us) write_op.cc:454] Released schema lock
0617 07:53:14.177101 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0617 07:53:14.226260 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:14.226406 (+ 146us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:14.226413 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:14.226415 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:14.226522 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:14.226539 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:14.226547 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:14.226614 (+ 67us) tablet.cc:701] Row locks acquired
0617 07:53:14.226617 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:14.226656 (+ 39us) write_op.cc:270] Start()
0617 07:53:14.226690 (+ 34us) write_op.cc:276] Timestamp: P: 1781682794226586 usec, L: 0
0617 07:53:14.226694 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:14.226868 (+ 174us) log.cc:844] Serialized 356 byte log entry
0617 07:53:14.230978 (+ 4110us) op_driver.cc:464] REPLICATION: finished
0617 07:53:14.231107 (+ 129us) write_op.cc:301] APPLY: starting
0617 07:53:14.231124 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:14.231166 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:14.231200 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:14.231254 (+ 54us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:14.231287 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:14.231294 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:14.231364 (+ 70us) log.cc:844] Serialized 23 byte log entry
0617 07:53:14.231441 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.231461 (+ 20us) write_op.cc:454] Released schema lock
0617 07:53:14.231468 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0617 07:53:14.265418 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:14.265539 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:14.265546 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:14.265548 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:14.265654 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:14.265671 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:14.265676 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:14.265768 (+ 92us) tablet.cc:701] Row locks acquired
0617 07:53:14.265770 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:14.265805 (+ 35us) write_op.cc:270] Start()
0617 07:53:14.265840 (+ 35us) write_op.cc:276] Timestamp: P: 1781682794265784 usec, L: 0
0617 07:53:14.265844 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:14.266023 (+ 179us) log.cc:844] Serialized 356 byte log entry
0617 07:53:14.269164 (+ 3141us) op_driver.cc:464] REPLICATION: finished
0617 07:53:14.269284 (+ 120us) write_op.cc:301] APPLY: starting
0617 07:53:14.269299 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:14.269339 (+ 40us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:14.269382 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:14.269432 (+ 50us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:14.269464 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:14.269470 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:14.269536 (+ 66us) log.cc:844] Serialized 23 byte log entry
0617 07:53:14.269593 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.269611 (+ 18us) write_op.cc:454] Released schema lock
0617 07:53:14.269617 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:14.269676 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.269679 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 07:53:14.309067 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:14.309184 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:14.309191 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:14.309193 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:14.309299 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:14.309314 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:14.309318 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:14.309398 (+ 80us) tablet.cc:701] Row locks acquired
0617 07:53:14.309401 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:14.309438 (+ 37us) write_op.cc:270] Start()
0617 07:53:14.309470 (+ 32us) write_op.cc:276] Timestamp: P: 1781682794309412 usec, L: 0
0617 07:53:14.309473 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:14.309648 (+ 175us) log.cc:844] Serialized 356 byte log entry
0617 07:53:14.316404 (+ 6756us) op_driver.cc:464] REPLICATION: finished
0617 07:53:14.316602 (+ 198us) write_op.cc:301] APPLY: starting
0617 07:53:14.316624 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:14.316679 (+ 55us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:14.316715 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:14.316805 (+ 90us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:14.316852 (+ 47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:14.316863 (+ 11us) write_op.cc:312] APPLY: finished
0617 07:53:14.316956 (+ 93us) log.cc:844] Serialized 23 byte log entry
0617 07:53:14.317038 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.317062 (+ 24us) write_op.cc:454] Released schema lock
0617 07:53:14.317071 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:14.317155 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.317161 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2389,"reported_tablets":202,"spinlock_wait_cycles":115741440,"child_traces":[["op",{"apply.queue_time_us":64,"apply.run_cpu_time_us":530,"apply.run_wall_time_us":529,"num_ops":4,"prepare.queue_time_us":94,"prepare.run_cpu_time_us":792,"prepare.run_wall_time_us":793,"raft.queue_time_us":502,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":235,"replication_time_us":9364}],["op",{"apply.queue_time_us":82,"apply.run_cpu_time_us":411,"apply.run_wall_time_us":410,"num_ops":1,"prepare.queue_time_us":312,"prepare.run_cpu_time_us":730,"prepare.run_wall_time_us":731,"raft.queue_time_us":1519,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":261,"replication_time_us":4255}],["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":385,"apply.run_wall_time_us":384,"num_ops":1,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":725,"prepare.run_wall_time_us":725,"raft.queue_time_us":418,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":242,"replication_time_us":3292}],["op",{"apply.queue_time_us":136,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":539,"num_ops":1,"prepare.queue_time_us":477,"prepare.run_cpu_time_us":719,"prepare.run_wall_time_us":719,"raft.queue_time_us":416,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":229,"replication_time_us":6870}]]}
I20260617 07:53:14.733183 453 master_service.cc:960] ReplaceTablet: received request to replace tablet eb75a965740344c2bd0b68a8dda28be5 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:14.735283 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b8214873449f45f6be18047115a40c52" } new_table_name: "default.Table_c6fedca194ec4749b5cf314ab4952408" modify_external_catalogs: true
I20260617 07:53:14.735981 1171 ts_tablet_manager.cc:1434] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.057s user 0.001s sys 0.001s
I20260617 07:53:14.736836 1171 tablet_bootstrap.cc:492] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:14.738056 1178 tablet_bootstrap.cc:654] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.738147 1862 raft_consensus.cc:2243] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.738240 1171 tablet_bootstrap.cc:654] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.741482 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 91) took 3124 ms. Trace:
I20260617 07:53:14.741629 1170 rpcz_store.cc:276] 0617 07:53:11.616846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.617089 (+ 243us) service_pool.cc:224] Handling call
0617 07:53:14.458862 (+2841773us) ts_tablet_manager.cc:1151] Deleting tablet d03d6dc473fc4be1a436fd71a06f403e
0617 07:53:14.458878 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.581574 (+122696us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.670696 (+ 89122us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.741461 (+ 70765us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2841658}
I20260617 07:53:14.742105 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 92) took 3124 ms. Trace:
I20260617 07:53:14.742215 1170 rpcz_store.cc:276] 0617 07:53:11.617339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.617390 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:14.741982 (+3124592us) ts_tablet_manager.cc:1151] Deleting tablet df705c2300064db680bec1fefab08d2f
0617 07:53:14.741992 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.742090 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3124475}
I20260617 07:53:14.742326 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d03d6dc473fc4be1a436fd71a06f403e (table default.Table_ffd2c46b97334436a592c497f3a8fa2a [id=af6a6625d89c41feac726918675fcbf5]) successfully deleted
I20260617 07:53:14.742596 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 93) took 3124 ms. Trace:
I20260617 07:53:14.742671 1170 rpcz_store.cc:276] 0617 07:53:11.617690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.617754 (+ 64us) service_pool.cc:224] Handling call
0617 07:53:14.742489 (+3124735us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:14.742498 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.742581 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3124609}
W20260617 07:53:14.742911 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet df705c2300064db680bec1fefab08d2f because the tablet was not found. No further retry: Not found: Tablet not found: df705c2300064db680bec1fefab08d2f
I20260617 07:53:14.742945 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 94) took 3124 ms. Trace:
I20260617 07:53:14.743013 1170 rpcz_store.cc:276] 0617 07:53:11.618030 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.618067 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:14.742863 (+3124796us) ts_tablet_manager.cc:1151] Deleting tablet 3fcf87953dc14bf190ac74101547e52f
0617 07:53:14.742870 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.742933 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3124684}
I20260617 07:53:14.743256 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 95) took 3124 ms. Trace:
I20260617 07:53:14.743314 1170 rpcz_store.cc:276] 0617 07:53:11.618314 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.618349 (+ 35us) service_pool.cc:224] Handling call
0617 07:53:14.743181 (+3124832us) ts_tablet_manager.cc:1151] Deleting tablet 98f7c3f6260c4db690de1a5081bb2493
0617 07:53:14.743187 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.743245 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3124708}
I20260617 07:53:14.743530 1170 tablet_replica.cc:333] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:14.743528 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a02dbb70eec84932917ef282fdae0bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a02dbb70eec84932917ef282fdae0bd7 already in progress: creating tablet
I20260617 07:53:14.743690 1170 raft_consensus.cc:2243] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:14.743749 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3fcf87953dc14bf190ac74101547e52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcf87953dc14bf190ac74101547e52f already in progress: creating tablet
I20260617 07:53:14.743813 1170 raft_consensus.cc:2272] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:14.744201 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
I20260617 07:53:14.744282 1170 ts_tablet_manager.cc:1916] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.744519 2193 raft_consensus.cc:493] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.744681 2193 raft_consensus.cc:515] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.745622 2193 leader_election.cc:290] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:14.746539 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa1c1fdede041d28570b85e63c401b7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:14.747093 986 leader_election.cc:343] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.747473 2202 raft_consensus.cc:2749] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:14.748765 1862 raft_consensus.cc:2272] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:14.749445 852 consensus_peers.cc:597] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:14.749663 852 consensus_peers.cc:597] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:14.749845 1862 ts_tablet_manager.cc:1916] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:14.750211 852 leader_election.cc:343] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.750306 852 leader_election.cc:304] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:14.750489 2086 raft_consensus.cc:2749] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:14.751171 852 consensus_peers.cc:597] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:14.751314 852 consensus_peers.cc:597] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:14.751421 852 leader_election.cc:343] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:14.751657 852 leader_election.cc:343] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:14.758291 852 consensus_peers.cc:597] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:14.759841 1846 ts_tablet_manager.cc:1929] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.760007 1846 log.cc:1199] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/5a547dabaeb742ba941690f4895955bd
I20260617 07:53:14.760588 1846 ts_tablet_manager.cc:1950] T 5a547dabaeb742ba941690f4895955bd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:14.761624 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0f9db8a986b344548e435b77edc14cb6 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]) successfully deleted
I20260617 07:53:14.763161 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa1c1fdede041d28570b85e63c401b7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:14.764448 1171 tablet_bootstrap.cc:492] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:14.764585 1171 ts_tablet_manager.cc:1403] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.000s
I20260617 07:53:14.765448 1171 raft_consensus.cc:359] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.766044 1171 raft_consensus.cc:385] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.766175 1171 raft_consensus.cc:740] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.766434 1171 consensus_queue.cc:260] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:14.767457 988 leader_election.cc:343] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.767582 988 leader_election.cc:304] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:14.767119 851 consensus_peers.cc:597] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:14.769934 1171 ts_tablet_manager.cc:1434] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:14.770289 1171 tablet_bootstrap.cc:492] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:14.771888 1171 tablet_bootstrap.cc:654] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.772504 1862 ts_tablet_manager.cc:1929] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.773200 2193 raft_consensus.cc:2749] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:14.769963 852 consensus_peers.cc:597] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:14.782527 1862 log.cc:1199] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/2684f3200e604bb6bf37a2f97a193eff
I20260617 07:53:14.783133 1862 ts_tablet_manager.cc:1950] T 2684f3200e604bb6bf37a2f97a193eff P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.783603 2194 tablet.cc:1724] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:14.783969 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 75) took 2974 ms. Trace:
I20260617 07:53:14.784580 1862 rpcz_store.cc:276] 0617 07:53:11.809936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.809977 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:14.685701 (+2875724us) ts_tablet_manager.cc:1151] Deleting tablet 2684f3200e604bb6bf37a2f97a193eff
0617 07:53:14.685731 (+ 30us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.752710 (+ 66979us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.772446 (+ 19736us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.783954 (+ 11508us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63104,"tablet-delete.queue_time_us":2875527}
I20260617 07:53:14.786230 1862 tablet_replica.cc:333] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:14.786653 1862 raft_consensus.cc:2243] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.787093 1862 raft_consensus.cc:2272] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.787748 1862 ts_tablet_manager.cc:1916] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.803611 2188 tablet.cc:1724] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:14.808962 2222 tablet.cc:1724] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:14.812758 1862 ts_tablet_manager.cc:1929] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.815932 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 2684f3200e604bb6bf37a2f97a193eff (table default.Table_9439306243c4451db8d00e183b7dbeda [id=3d4b592286ce4a06bcc5f3477fdbf25f]) successfully deleted
I20260617 07:53:14.817530 1862 log.cc:1199] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/570ae1e189a64da6bad10156b401ec46
I20260617 07:53:14.818019 1862 ts_tablet_manager.cc:1950] T 570ae1e189a64da6bad10156b401ec46 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.819065 1170 ts_tablet_manager.cc:1929] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.819206 1170 log.cc:1199] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/df37ed81b17d4178adeb6057491b4cc9
I20260617 07:53:14.819540 1170 ts_tablet_manager.cc:1950] T df37ed81b17d4178adeb6057491b4cc9 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:14.820497 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 78) took 3208 ms. Trace:
I20260617 07:53:14.820614 1170 rpcz_store.cc:276] 0617 07:53:11.612141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.618563 (+ 6422us) service_pool.cc:224] Handling call
0617 07:53:14.743493 (+3124930us) ts_tablet_manager.cc:1151] Deleting tablet df37ed81b17d4178adeb6057491b4cc9
0617 07:53:14.743500 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.771717 (+ 28217us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.818982 (+ 47265us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.820472 (+ 1490us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3124784}
I20260617 07:53:14.820737 2229 tablet.cc:1724] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:14.821141 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 97) took 3164 ms. Trace:
I20260617 07:53:14.821184 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet df37ed81b17d4178adeb6057491b4cc9 (table default.Table_57d8a7f4af774adeb25c6a592b0c0800 [id=b1b850d52163487fa43a3699bf969f8b]) successfully deleted
I20260617 07:53:14.821247 1170 rpcz_store.cc:276] 0617 07:53:11.656308 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.656649 (+ 341us) service_pool.cc:224] Handling call
0617 07:53:14.820975 (+3164326us) ts_tablet_manager.cc:1151] Deleting tablet 6d8f144d04af4ea18f99aee3b82f4a28
0617 07:53:14.820988 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.821121 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3164098}
I20260617 07:53:14.821489 1170 tablet_replica.cc:333] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:14.821667 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
I20260617 07:53:14.822252 1178 tablet_bootstrap.cc:492] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:14.822393 1178 ts_tablet_manager.cc:1403] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.002s
I20260617 07:53:14.823127 1178 raft_consensus.cc:359] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.823312 1178 raft_consensus.cc:385] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.823405 1178 raft_consensus.cc:740] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.823689 1178 consensus_queue.cc:260] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.824930 1178 ts_tablet_manager.cc:1434] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:14.825129 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 76) took 3014 ms. Trace:
I20260617 07:53:14.825255 1862 rpcz_store.cc:276] 0617 07:53:11.813332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.813380 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:14.786185 (+2972805us) ts_tablet_manager.cc:1151] Deleting tablet 570ae1e189a64da6bad10156b401ec46
0617 07:53:14.786194 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.797050 (+ 10856us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.812707 (+ 15657us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.825104 (+ 12397us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6032,"tablet-delete.queue_time_us":2972606}
I20260617 07:53:14.825630 1862 tablet_replica.cc:333] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:14.825871 1862 raft_consensus.cc:2243] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.825148 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 53) took 3158 ms. Trace:
I20260617 07:53:14.826231 1862 raft_consensus.cc:2272] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.826372 1846 rpcz_store.cc:276] 0617 07:53:11.666273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.666404 (+ 131us) service_pool.cc:224] Handling call
0617 07:53:14.664622 (+2998218us) ts_tablet_manager.cc:1151] Deleting tablet 5a547dabaeb742ba941690f4895955bd
0617 07:53:14.664634 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.705417 (+ 40783us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.759751 (+ 54334us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.825116 (+ 65365us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2972089}
I20260617 07:53:14.826756 1862 ts_tablet_manager.cc:1916] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.826933 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 5a547dabaeb742ba941690f4895955bd (table default.Table_e63db29973b24c64be400ecb2982e867 [id=361b241d29f5458b9bfec6e97c3f37dc]) successfully deleted
I20260617 07:53:14.827088 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 54) took 3160 ms. Trace:
I20260617 07:53:14.827258 1846 rpcz_store.cc:276] 0617 07:53:11.666363 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.666426 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:14.826973 (+3160547us) ts_tablet_manager.cc:1151] Deleting tablet d9968c8179c14d1b9bc9a2c2779fb86e
0617 07:53:14.826981 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.827060 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3134241}
I20260617 07:53:14.827729 1846 tablet_replica.cc:333] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:14.827708 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d9968c8179c14d1b9bc9a2c2779fb86e because the tablet was not found. No further retry: Not found: Tablet not found: d9968c8179c14d1b9bc9a2c2779fb86e
I20260617 07:53:14.827983 1846 raft_consensus.cc:2243] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.828214 1846 raft_consensus.cc:2272] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.828754 1846 ts_tablet_manager.cc:1916] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.830811 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 570ae1e189a64da6bad10156b401ec46 (table default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]) successfully deleted
I20260617 07:53:14.832508 1862 ts_tablet_manager.cc:1929] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.836421 1178 tablet_bootstrap.cc:492] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:14.821658 1170 raft_consensus.cc:2243] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.843228 1170 raft_consensus.cc:2272] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.844010 1170 ts_tablet_manager.cc:1916] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.834316 1172 tablet_bootstrap.cc:654] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:14.833911 852 consensus_peers.cc:597] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:14.834545 1171 tablet_bootstrap.cc:492] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:14.848958 1862 log.cc:1199] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/74ab8e93e3fe475ba9c7b5fce390a8ab
I20260617 07:53:14.849090 1171 ts_tablet_manager.cc:1403] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.079s user 0.032s sys 0.016s
I20260617 07:53:14.849280 1862 ts_tablet_manager.cc:1950] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.839766 2086 raft_consensus.cc:493] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.849704 1178 tablet_bootstrap.cc:654] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.849810 2086 raft_consensus.cc:515] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.850471 2086 leader_election.cc:290] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:14.840348 2202 raft_consensus.cc:493] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.850628 2202 raft_consensus.cc:515] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.851171 2202 leader_election.cc:290] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:14.851406 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 77) took 3037 ms. Trace:
I20260617 07:53:14.851529 1862 rpcz_store.cc:276] 0617 07:53:11.813806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.813847 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:14.825585 (+3011738us) ts_tablet_manager.cc:1151] Deleting tablet 74ab8e93e3fe475ba9c7b5fce390a8ab
0617 07:53:14.825595 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.829821 (+ 4226us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.832469 (+ 2648us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.851388 (+ 18919us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3011525}
I20260617 07:53:14.851974 1862 tablet_replica.cc:333] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:14.852303 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f32eb8ec894e029a428bbd62caa0f5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:14.852469 1050 raft_consensus.cc:2468] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:14.852645 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5ddac997834e97a2d6c9b1855ee4e8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:14.852763 1046 raft_consensus.cc:2468] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:14.853207 1862 raft_consensus.cc:2243] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:14.853624 1862 pending_rounds.cc:70] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:14.853878 1862 pending_rounds.cc:77] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772723098357760 op_type: NO_OP noop_request { }
I20260617 07:53:14.854137 1862 raft_consensus.cc:2889] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:14.854351 1862 raft_consensus.cc:2272] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.854795 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 74ab8e93e3fe475ba9c7b5fce390a8ab (table default.Table_be503ca177d549f6a02bc394edcc4fe7 [id=de6d213812d4427fa28250763779565e]) successfully deleted
I20260617 07:53:14.855122 851 leader_election.cc:304] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:14.855403 851 leader_election.cc:304] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:14.855649 1862 ts_tablet_manager.cc:1916] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.855664 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f32eb8ec894e029a428bbd62caa0f5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:14.855756 2201 raft_consensus.cc:2804] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:14.855929 2201 raft_consensus.cc:493] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:14.855980 2202 raft_consensus.cc:2804] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:14.856029 2201 raft_consensus.cc:3060] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:14.856070 2202 raft_consensus.cc:493] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:14.856140 2202 raft_consensus.cc:3060] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:14.856475 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5ddac997834e97a2d6c9b1855ee4e8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:14.858691 2201 raft_consensus.cc:515] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.858805 2202 raft_consensus.cc:515] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:14.859248 2201 leader_election.cc:290] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:14.859318 2202 leader_election.cc:290] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:14.859668 852 leader_election.cc:343] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:14.859925 852 leader_election.cc:343] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.860134 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5ddac997834e97a2d6c9b1855ee4e8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:14.860327 1171 raft_consensus.cc:359] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.860462 1171 raft_consensus.cc:385] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.860502 1171 raft_consensus.cc:740] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.860684 1171 consensus_queue.cc:260] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.860723 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f32eb8ec894e029a428bbd62caa0f5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:14.861161 1171 ts_tablet_manager.cc:1434] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260617 07:53:14.861459 1171 tablet_bootstrap.cc:492] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:14.862807 1171 tablet_bootstrap.cc:654] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.863257 2125 raft_consensus.cc:493] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.863482 2125 raft_consensus.cc:515] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.864507 2125 leader_election.cc:290] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:14.865020 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cb2c879e6451886c55907678792de" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:14.866423 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cb2c879e6451886c55907678792de" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:14.867678 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5ddac997834e97a2d6c9b1855ee4e8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:14.867764 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f32eb8ec894e029a428bbd62caa0f5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:14.867818 1050 raft_consensus.cc:3060] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:14.867908 1046 raft_consensus.cc:3060] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:14.868074 713 leader_election.cc:304] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:14.868536 2125 raft_consensus.cc:2749] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:14.870378 1050 raft_consensus.cc:2468] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:14.870522 1046 raft_consensus.cc:2468] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:14.871031 851 leader_election.cc:304] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:14.871328 851 leader_election.cc:304] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:14.871533 2201 raft_consensus.cc:2804] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:14.871676 2201 raft_consensus.cc:697] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:14.871910 2201 consensus_queue.cc:237] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:14.871985 852 leader_election.cc:343] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:14.872285 852 leader_election.cc:343] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.871544 2086 raft_consensus.cc:2804] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:14.872897 2086 raft_consensus.cc:697] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:14.873117 2086 consensus_queue.cc:237] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:14.875448 852 consensus_peers.cc:597] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:14.876996 851 consensus_peers.cc:597] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:14.878872 1172 tablet_bootstrap.cc:492] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:14.879097 1172 ts_tablet_manager.cc:1403] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.151s user 0.023s sys 0.003s
I20260617 07:53:14.880036 1172 raft_consensus.cc:359] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.880321 1172 raft_consensus.cc:385] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.880426 1172 raft_consensus.cc:740] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.880734 1172 consensus_queue.cc:260] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.881201 1862 ts_tablet_manager.cc:1929] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.881352 1862 log.cc:1199] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/59acdc64fe9247d28c4c277161b42f4f
I20260617 07:53:14.881765 1862 ts_tablet_manager.cc:1950] T 59acdc64fe9247d28c4c277161b42f4f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.882542 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 78) took 3068 ms. Trace:
I20260617 07:53:14.882671 1862 rpcz_store.cc:276] 0617 07:53:11.814213 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.814250 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:14.851920 (+3037670us) ts_tablet_manager.cc:1151] Deleting tablet 59acdc64fe9247d28c4c277161b42f4f
0617 07:53:14.851929 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.862527 (+ 10598us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.865693 (+ 3166us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.882523 (+ 16830us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3037507}
I20260617 07:53:14.885011 2201 consensus_queue.cc:1048] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:14.887315 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 59acdc64fe9247d28c4c277161b42f4f (table default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]) successfully deleted
I20260617 07:53:14.887596 1178 tablet_bootstrap.cc:492] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:14.887821 1178 ts_tablet_manager.cc:1403] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.001s
I20260617 07:53:14.888819 1178 raft_consensus.cc:359] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.889060 1178 raft_consensus.cc:385] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.889140 1178 raft_consensus.cc:740] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.890434 1171 tablet_bootstrap.cc:492] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:14.890592 1171 ts_tablet_manager.cc:1403] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.000s
I20260617 07:53:14.891367 1171 raft_consensus.cc:359] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.891556 1171 raft_consensus.cc:385] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:14.891624 1171 raft_consensus.cc:740] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:14.891736 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 79) took 3077 ms. Trace:
I20260617 07:53:14.891862 1171 consensus_queue.cc:260] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.891939 1862 rpcz_store.cc:276] 0617 07:53:11.814668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.814715 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:14.883030 (+3068315us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:14.883041 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.883138 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3068108}
I20260617 07:53:14.892525 1862 tablet_replica.cc:333] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:14.892835 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 95865af94c04410386d23cb369180611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95865af94c04410386d23cb369180611 already in progress: creating tablet
I20260617 07:53:14.892956 1862 raft_consensus.cc:2243] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:14.892930 1178 consensus_queue.cc:260] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.893195 1862 pending_rounds.cc:70] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:14.893249 1862 pending_rounds.cc:77] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772723743420416 op_type: NO_OP noop_request { }
I20260617 07:53:14.893322 1862 raft_consensus.cc:2889] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:14.893388 1862 raft_consensus.cc:2272] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.892678 1171 ts_tablet_manager.cc:1434] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:14.894061 1171 tablet_bootstrap.cc:492] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:14.897079 1171 tablet_bootstrap.cc:654] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.897514 2201 consensus_queue.cc:1048] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:14.898134 1862 ts_tablet_manager.cc:1916] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.910310 1178 ts_tablet_manager.cc:1434] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260617 07:53:14.918849 1862 ts_tablet_manager.cc:1929] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.919016 1862 log.cc:1199] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/df37ed81b17d4178adeb6057491b4cc9
I20260617 07:53:14.919399 1862 ts_tablet_manager.cc:1950] T df37ed81b17d4178adeb6057491b4cc9 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.920153 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 80) took 3105 ms. Trace:
I20260617 07:53:14.920297 1862 rpcz_store.cc:276] 0617 07:53:11.815070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.815110 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:14.892482 (+3077372us) ts_tablet_manager.cc:1151] Deleting tablet df37ed81b17d4178adeb6057491b4cc9
0617 07:53:14.892491 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.909083 (+ 16592us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.918784 (+ 9701us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.920133 (+ 1349us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3077193}
I20260617 07:53:14.920747 1862 tablet_replica.cc:333] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:14.921025 1862 raft_consensus.cc:2243] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.921216 1862 raft_consensus.cc:2272] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.921764 1862 ts_tablet_manager.cc:1916] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.923741 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet df37ed81b17d4178adeb6057491b4cc9 (table default.Table_57d8a7f4af774adeb25c6a592b0c0800 [id=b1b850d52163487fa43a3699bf969f8b]) successfully deleted
I20260617 07:53:14.926982 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 5942eea42c7541349ad7b6560e6777c8
I20260617 07:53:14.927356 1862 ts_tablet_manager.cc:1929] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:14.927441 1862 log.cc:1199] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a82e4d6c09bb4414ad7f3b760f7ae681
I20260617 07:53:14.927481 460 catalog_manager.cc:6784] ReplaceTablet: tablet 5942eea42c7541349ad7b6560e6777c8 deleted and replaced by tablet 2ffa87a4304b43a89be0faa3c5ce0b2c
I20260617 07:53:14.927691 1862 ts_tablet_manager.cc:1950] T a82e4d6c09bb4414ad7f3b760f7ae681 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:14.884163 1172 ts_tablet_manager.cc:1434] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:14.892511 1098 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:14.928455 1172 tablet_bootstrap.cc:492] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:14.929874 1172 tablet_bootstrap.cc:654] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.930689 1178 tablet_bootstrap.cc:492] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:14.930740 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet eb75a965740344c2bd0b68a8dda28be5
I20260617 07:53:14.930956 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 5942eea42c7541349ad7b6560e6777c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffa87a4304b43a89be0faa3c5ce0b2c) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.931186 453 catalog_manager.cc:6784] ReplaceTablet: tablet eb75a965740344c2bd0b68a8dda28be5 deleted and replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01
I20260617 07:53:14.931527 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4b11386c9de448719673afea74a4e6a0" } new_table_name: "default.Table_871f52a414934a248bcacbe3399ccee8" modify_external_catalogs: true
I20260617 07:53:14.932374 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 5942eea42c7541349ad7b6560e6777c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffa87a4304b43a89be0faa3c5ce0b2c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.932623 743 tablet_service.cc:1558] Processing DeleteTablet for tablet eb75a965740344c2bd0b68a8dda28be5 with delete_type TABLET_DATA_DELETED (replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:14.932821 1178 tablet_bootstrap.cc:654] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:14.933027 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet eb75a965740344c2bd0b68a8dda28be5 with delete_type TABLET_DATA_DELETED (replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:14.933096 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 5942eea42c7541349ad7b6560e6777c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffa87a4304b43a89be0faa3c5ce0b2c) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.933424 884 tablet_service.cc:1558] Processing DeleteTablet for tablet eb75a965740344c2bd0b68a8dda28be5 with delete_type TABLET_DATA_DELETED (replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:14.934934 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 81) took 3119 ms. Trace:
I20260617 07:53:14.935034 1862 rpcz_store.cc:276] 0617 07:53:11.815385 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.815426 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:14.920704 (+3105278us) ts_tablet_manager.cc:1151] Deleting tablet a82e4d6c09bb4414ad7f3b760f7ae681
0617 07:53:14.920714 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.924592 (+ 3878us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.927300 (+ 2708us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.934916 (+ 7616us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6480,"tablet-delete.queue_time_us":3105102}
I20260617 07:53:14.935321 1862 tablet_replica.cc:333] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:14.935479 1862 raft_consensus.cc:2243] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:14.935715 1862 pending_rounds.cc:70] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:14.936086 780 raft_consensus.cc:3060] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:14.936614 1846 ts_tablet_manager.cc:1929] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.936748 1846 log.cc:1199] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/950c1c44020a4586b3197f5f68a38963
I20260617 07:53:14.937232 1846 ts_tablet_manager.cc:1950] T 950c1c44020a4586b3197f5f68a38963 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:14.937218 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a82e4d6c09bb4414ad7f3b760f7ae681 (table default.Table_b8c2cdf0232f43a2abece8a769ac6cb3 [id=ec77f754c1974d4bbf057719b39c0059]) successfully deleted
I20260617 07:53:14.938228 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 55) took 3243 ms. Trace:
I20260617 07:53:14.938341 1846 rpcz_store.cc:276] 0617 07:53:11.694308 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.694362 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:14.827673 (+3133311us) ts_tablet_manager.cc:1151] Deleting tablet 950c1c44020a4586b3197f5f68a38963
0617 07:53:14.827681 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.847753 (+ 20072us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.936521 (+ 88768us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.938169 (+ 1648us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3133106}
I20260617 07:53:14.938712 1846 tablet_replica.cc:333] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:14.938892 1846 raft_consensus.cc:2243] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.939065 1846 raft_consensus.cc:2272] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.939613 1846 ts_tablet_manager.cc:1916] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.935760 1862 pending_rounds.cc:77] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772722266132480 op_type: NO_OP noop_request { }
I20260617 07:53:14.940889 1862 raft_consensus.cc:2889] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:14.941314 1862 raft_consensus.cc:2272] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.941365 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 950c1c44020a4586b3197f5f68a38963 (table default.Table_45c63267e23f435fbd339cff71a43d48 [id=025ad5e64ed3429b8844117f5ddec194]) successfully deleted
I20260617 07:53:14.941965 1862 ts_tablet_manager.cc:1916] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.949220 1862 ts_tablet_manager.cc:1929] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.950161 1019 tablet_service.cc:1511] Processing CreateTablet for tablet f249a9d29de54c959dbae1751501daee (DEFAULT_TABLE table=default.Table_9cbd5b289a9346eaad72894e1a5dd1c8 [id=7c99c55dfd9449a19c1b86c5522103f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.950577 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f249a9d29de54c959dbae1751501daee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.952183 743 tablet_service.cc:1511] Processing CreateTablet for tablet f249a9d29de54c959dbae1751501daee (DEFAULT_TABLE table=default.Table_9cbd5b289a9346eaad72894e1a5dd1c8 [id=7c99c55dfd9449a19c1b86c5522103f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.952567 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f249a9d29de54c959dbae1751501daee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.959266 755 tablet_service.cc:1511] Processing CreateTablet for tablet dac3dc9d7da447cb8fdca84fdac0dc39 (DEFAULT_TABLE table=default.Table_2e6883490743451e895cee827dd61401 [id=5578ba3c17c74435a13cb7b4a65c371c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.959695 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac3dc9d7da447cb8fdca84fdac0dc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.969884 2193 raft_consensus.cc:493] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:14.970036 2193 raft_consensus.cc:515] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:14.970613 2193 leader_election.cc:290] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:14.971797 1019 tablet_service.cc:1511] Processing CreateTablet for tablet dac3dc9d7da447cb8fdca84fdac0dc39 (DEFAULT_TABLE table=default.Table_2e6883490743451e895cee827dd61401 [id=5578ba3c17c74435a13cb7b4a65c371c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.972270 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac3dc9d7da447cb8fdca84fdac0dc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.978494 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f498f551ff4767bd16628b03f55ae2" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:14.979494 986 leader_election.cc:343] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:14.983791 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:14.984229 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:14.984411 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]). Expected version 1 got 0
I20260617 07:53:14.984751 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:14.984954 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:14.985159 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_f86c4a5d30d546a890795712293d1a2f [id=b20987ff1f1c43098b1408b126b32913]). Expected version 2 got 0
I20260617 07:53:14.985446 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:14.985653 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:14.985998 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:14.986001 1170 ts_tablet_manager.cc:1929] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:14.986163 746 tablet_service.cc:1511] Processing CreateTablet for tablet 37406deefeeb4b9ea8ecb8656cf98832 (DEFAULT_TABLE table=default.Table_4d58dd10a2254fc383ba0cbde79c772b [id=ff5f41470c674efba709a427e8e67986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.986299 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:14.986606 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37406deefeeb4b9ea8ecb8656cf98832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.987139 1170 log.cc:1199] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/f2ce51c155c04897a4cf8f7b4ac9a5c6
I20260617 07:53:14.987320 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 37406deefeeb4b9ea8ecb8656cf98832 (DEFAULT_TABLE table=default.Table_4d58dd10a2254fc383ba0cbde79c772b [id=ff5f41470c674efba709a427e8e67986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.987521 1170 ts_tablet_manager.cc:1950] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:14.987661 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37406deefeeb4b9ea8ecb8656cf98832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.987799 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 98) took 3330 ms. Trace:
I20260617 07:53:14.989472 1862 log.cc:1199] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0cfb98aecc4546c88371436fcfbf8e86
I20260617 07:53:14.990121 1171 tablet_bootstrap.cc:492] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:14.949752 884 tablet_service.cc:1511] Processing CreateTablet for tablet f249a9d29de54c959dbae1751501daee (DEFAULT_TABLE table=default.Table_9cbd5b289a9346eaad72894e1a5dd1c8 [id=7c99c55dfd9449a19c1b86c5522103f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.990733 1171 ts_tablet_manager.cc:1403] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.097s user 0.011s sys 0.003s
I20260617 07:53:14.991006 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f249a9d29de54c959dbae1751501daee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.992322 751 tablet_service.cc:1511] Processing CreateTablet for tablet 81457401d47448e385735f910f8b632a (DEFAULT_TABLE table=default.Table_dc65c6594c234b77bfd660f740f07ae8 [id=f01879ac55694935a9498de6534ed044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.987861 1170 rpcz_store.cc:276] 0617 07:53:11.657734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.657795 (+ 61us) service_pool.cc:224] Handling call
0617 07:53:14.821452 (+3163657us) ts_tablet_manager.cc:1151] Deleting tablet f2ce51c155c04897a4cf8f7b4ac9a5c6
0617 07:53:14.821459 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.878452 (+ 56993us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.985947 (+107495us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.987785 (+ 1838us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3163474}
I20260617 07:53:14.992887 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 (table default.Table_bbc95ce139d8435387c7952fa8812d3b [id=7a019b84bca74a3cbd26a8fe985488ff]) successfully deleted
I20260617 07:53:14.992933 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81457401d47448e385735f910f8b632a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.992976 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 81457401d47448e385735f910f8b632a (DEFAULT_TABLE table=default.Table_dc65c6594c234b77bfd660f740f07ae8 [id=f01879ac55694935a9498de6534ed044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.993522 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 99) took 3335 ms. Trace:
I20260617 07:53:14.993573 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81457401d47448e385735f910f8b632a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.993599 1170 rpcz_store.cc:276] 0617 07:53:11.658518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.658569 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:14.993407 (+3334838us) ts_tablet_manager.cc:1151] Deleting tablet 18f9bace06e34602acc7fcd7501b3671
0617 07:53:14.993416 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.993506 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3334673}
I20260617 07:53:14.954964 2202 consensus_queue.cc:1048] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:14.994040 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 18f9bace06e34602acc7fcd7501b3671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18f9bace06e34602acc7fcd7501b3671 already in progress: creating tablet
I20260617 07:53:14.971065 883 tablet_service.cc:1511] Processing CreateTablet for tablet dac3dc9d7da447cb8fdca84fdac0dc39 (DEFAULT_TABLE table=default.Table_2e6883490743451e895cee827dd61401 [id=5578ba3c17c74435a13cb7b4a65c371c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.994483 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac3dc9d7da447cb8fdca84fdac0dc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.996948 1170 tablet_replica.cc:333] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:14.997148 1170 raft_consensus.cc:2243] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:14.997280 1170 raft_consensus.cc:2272] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:14.997781 1170 ts_tablet_manager.cc:1916] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:14.973809 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f498f551ff4767bd16628b03f55ae2" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:14.998270 887 tablet_service.cc:1511] Processing CreateTablet for tablet 81457401d47448e385735f910f8b632a (DEFAULT_TABLE table=default.Table_dc65c6594c234b77bfd660f740f07ae8 [id=f01879ac55694935a9498de6534ed044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:14.998590 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81457401d47448e385735f910f8b632a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.000180 754 tablet_service.cc:1511] Processing CreateTablet for tablet 715bf2540b8642d2b1c97d25e26d2a21 (DEFAULT_TABLE table=default.Table_055ace13aa294344aeb50420a4235f3d [id=4373bab5f9fc45cf92d2808390e1ad9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.000566 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715bf2540b8642d2b1c97d25e26d2a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.001319 880 tablet_service.cc:1511] Processing CreateTablet for tablet 715bf2540b8642d2b1c97d25e26d2a21 (DEFAULT_TABLE table=default.Table_055ace13aa294344aeb50420a4235f3d [id=4373bab5f9fc45cf92d2808390e1ad9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.001633 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715bf2540b8642d2b1c97d25e26d2a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.002565 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 715bf2540b8642d2b1c97d25e26d2a21 (DEFAULT_TABLE table=default.Table_055ace13aa294344aeb50420a4235f3d [id=4373bab5f9fc45cf92d2808390e1ad9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.002885 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715bf2540b8642d2b1c97d25e26d2a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.006007 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 8632bac802304dff85bd7effd711e2ae (DEFAULT_TABLE table=default.Table_79919723364a4f5982d7c530cbaf7be6 [id=ba26294f1d7044dfa88d1d4d787ae30c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.006415 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8632bac802304dff85bd7effd711e2ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.006685 1019 tablet_service.cc:1511] Processing CreateTablet for tablet c6b85e7ed0a64c128de5cc48c4d4435f (DEFAULT_TABLE table=default.Table_9b8de1903c2e4b32ae11268bcb7d6c49 [id=e91a97d0e77f48c294816c2837ff3f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.007022 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b85e7ed0a64c128de5cc48c4d4435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.986853 895 tablet_service.cc:1511] Processing CreateTablet for tablet 37406deefeeb4b9ea8ecb8656cf98832 (DEFAULT_TABLE table=default.Table_4d58dd10a2254fc383ba0cbde79c772b [id=ff5f41470c674efba709a427e8e67986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.009032 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37406deefeeb4b9ea8ecb8656cf98832. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.013932 988 leader_election.cc:343] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.014065 988 leader_election.cc:304] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:15.014513 2193 raft_consensus.cc:2749] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.014564 885 tablet_service.cc:1511] Processing CreateTablet for tablet c6b85e7ed0a64c128de5cc48c4d4435f (DEFAULT_TABLE table=default.Table_9b8de1903c2e4b32ae11268bcb7d6c49 [id=e91a97d0e77f48c294816c2837ff3f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.014966 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b85e7ed0a64c128de5cc48c4d4435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.017297 760 tablet_service.cc:1511] Processing CreateTablet for tablet 862e3df26b5b49038fc059e429ef0c02 (DEFAULT_TABLE table=default.Table_7c0e97b79dd9460c8437fa9bfe0ff607 [id=b06592d58dd646f4a8f02e596899e5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.017649 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e3df26b5b49038fc059e429ef0c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.017933 746 tablet_service.cc:1511] Processing CreateTablet for tablet 8632bac802304dff85bd7effd711e2ae (DEFAULT_TABLE table=default.Table_79919723364a4f5982d7c530cbaf7be6 [id=ba26294f1d7044dfa88d1d4d787ae30c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.018265 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8632bac802304dff85bd7effd711e2ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.019209 754 tablet_service.cc:1511] Processing CreateTablet for tablet c6b85e7ed0a64c128de5cc48c4d4435f (DEFAULT_TABLE table=default.Table_9b8de1903c2e4b32ae11268bcb7d6c49 [id=e91a97d0e77f48c294816c2837ff3f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.020143 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6b85e7ed0a64c128de5cc48c4d4435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.021378 897 tablet_service.cc:1511] Processing CreateTablet for tablet cf826fd2b76a4bc997b07a0539ff486c (DEFAULT_TABLE table=default.Table_980a7e52a5604063bedf7b9097cc3e2c [id=a0341852d6c044fb82ba34e538139a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.021759 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf826fd2b76a4bc997b07a0539ff486c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.022873 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 61eff078d7074b6f805571b18d59d154 (DEFAULT_TABLE table=default.Table_73fb62164ea041f2a6e1e1c5e877605b [id=15c1d24cf79f4714b65b7750d9b37106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.023537 758 tablet_service.cc:1511] Processing CreateTablet for tablet 63459bf3ce6145d6a277d0348d13a63f (DEFAULT_TABLE table=default.Table_442fbaeb953440b2a628c4c888990c9e [id=1a01f9b1457e46d99d0ab9bc70b2b505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.023836 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63459bf3ce6145d6a277d0348d13a63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.024940 1020 tablet_service.cc:1511] Processing CreateTablet for tablet cf826fd2b76a4bc997b07a0539ff486c (DEFAULT_TABLE table=default.Table_980a7e52a5604063bedf7b9097cc3e2c [id=a0341852d6c044fb82ba34e538139a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.026377 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 862e3df26b5b49038fc059e429ef0c02 (DEFAULT_TABLE table=default.Table_7c0e97b79dd9460c8437fa9bfe0ff607 [id=b06592d58dd646f4a8f02e596899e5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.026502 898 tablet_service.cc:1511] Processing CreateTablet for tablet 61eff078d7074b6f805571b18d59d154 (DEFAULT_TABLE table=default.Table_73fb62164ea041f2a6e1e1c5e877605b [id=15c1d24cf79f4714b65b7750d9b37106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.026732 1170 ts_tablet_manager.cc:1929] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.026827 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61eff078d7074b6f805571b18d59d154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.026847 1170 log.cc:1199] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0fd8cedb539748dc917128511325bbcc
I20260617 07:53:15.027140 1170 ts_tablet_manager.cc:1950] T 0fd8cedb539748dc917128511325bbcc P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.027432 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61eff078d7074b6f805571b18d59d154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:14.990193 1862 ts_tablet_manager.cc:1950] T 0cfb98aecc4546c88371436fcfbf8e86 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:15.029691 886 tablet_service.cc:1511] Processing CreateTablet for tablet 63459bf3ce6145d6a277d0348d13a63f (DEFAULT_TABLE table=default.Table_442fbaeb953440b2a628c4c888990c9e [id=1a01f9b1457e46d99d0ab9bc70b2b505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.030129 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63459bf3ce6145d6a277d0348d13a63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.032743 894 tablet_service.cc:1511] Processing CreateTablet for tablet dbe35d97f4c2441e878cfc2be6d71c87 (DEFAULT_TABLE table=default.Table_b2428f7dfbdf40a1998af9f8b4a4ce68 [id=1d6547d2fe50438280b9c2b0a519d858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.033058 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe35d97f4c2441e878cfc2be6d71c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.033746 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 100) took 3374 ms. Trace:
I20260617 07:53:15.033829 1170 rpcz_store.cc:276] 0617 07:53:11.658867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.658910 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:14.996902 (+3337992us) ts_tablet_manager.cc:1151] Deleting tablet 0fd8cedb539748dc917128511325bbcc
0617 07:53:14.996911 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.008916 (+ 12005us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.026683 (+ 17767us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.033708 (+ 7025us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3337845}
I20260617 07:53:15.033919 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 63459bf3ce6145d6a277d0348d13a63f (DEFAULT_TABLE table=default.Table_442fbaeb953440b2a628c4c888990c9e [id=1a01f9b1457e46d99d0ab9bc70b2b505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.033660 1025 tablet_service.cc:1511] Processing CreateTablet for tablet dbe35d97f4c2441e878cfc2be6d71c87 (DEFAULT_TABLE table=default.Table_b2428f7dfbdf40a1998af9f8b4a4ce68 [id=1d6547d2fe50438280b9c2b0a519d858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.034260 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 0fd8cedb539748dc917128511325bbcc (table default.Table_1dc0449b6b954c8c9b7bb09011250560 [id=9edba52661f941a387f42fad199f9860]) successfully deleted
I20260617 07:53:15.035626 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 101) took 3376 ms. Trace:
I20260617 07:53:15.035714 1170 rpcz_store.cc:276] 0617 07:53:11.659448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.659497 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:15.035512 (+3376015us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:15.035521 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.035610 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3375837}
W20260617 07:53:15.036159 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e9488e8a501e404f85540fb045d8916f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9488e8a501e404f85540fb045d8916f already in progress: creating tablet
I20260617 07:53:15.037495 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 0b85d49f255940eeaf343bfcf71e00e9 (DEFAULT_TABLE table=default.Table_912b307c6f95423883dad501646529f4 [id=c0ca0b05fe444d6baeaca00158a9a72b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.037982 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 96) took 3382 ms. Trace:
I20260617 07:53:15.039433 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e3df26b5b49038fc059e429ef0c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.039659 884 tablet_service.cc:1511] Processing CreateTablet for tablet 862e3df26b5b49038fc059e429ef0c02 (DEFAULT_TABLE table=default.Table_7c0e97b79dd9460c8437fa9bfe0ff607 [id=b06592d58dd646f4a8f02e596899e5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.039724 1170 rpcz_store.cc:276] 0617 07:53:11.656173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.661836 (+ 5663us) service_pool.cc:224] Handling call
0617 07:53:15.037872 (+3376036us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:15.037878 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.037968 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3375841}
I20260617 07:53:15.040009 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e3df26b5b49038fc059e429ef0c02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.040195 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet bbc3d13d519843a9bc38e97dc85b67c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbc3d13d519843a9bc38e97dc85b67c8 already in progress: creating tablet
I20260617 07:53:15.040488 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b85d49f255940eeaf343bfcf71e00e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.041617 1170 tablet_replica.cc:333] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.046108 883 tablet_service.cc:1511] Processing CreateTablet for tablet 0b85d49f255940eeaf343bfcf71e00e9 (DEFAULT_TABLE table=default.Table_912b307c6f95423883dad501646529f4 [id=c0ca0b05fe444d6baeaca00158a9a72b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.041858 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63459bf3ce6145d6a277d0348d13a63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.046353 1170 raft_consensus.cc:2243] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.046531 1170 raft_consensus.cc:2272] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.046658 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b85d49f255940eeaf343bfcf71e00e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.047103 1170 ts_tablet_manager.cc:1916] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.049808 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe35d97f4c2441e878cfc2be6d71c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.049943 895 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 (DEFAULT_TABLE table=default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 [id=d079dbab725b43c0807868020b551ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.050263 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.045482 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 (DEFAULT_TABLE table=default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 [id=d079dbab725b43c0807868020b551ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.053942 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.053953 887 tablet_service.cc:1511] Processing CreateTablet for tablet 8632bac802304dff85bd7effd711e2ae (DEFAULT_TABLE table=default.Table_79919723364a4f5982d7c530cbaf7be6 [id=ba26294f1d7044dfa88d1d4d787ae30c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.054242 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8632bac802304dff85bd7effd711e2ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.056535 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 9687dbd2616749f4bef7d9444bd89ddf (DEFAULT_TABLE table=default.Table_89bce7ee0b534345bafee7f0af6358e6 [id=cff5df610d05436da1e53a7d7383b35a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.056834 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9687dbd2616749f4bef7d9444bd89ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.057482 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f395f963a5a5400a966a8d4cc62aadf1 (DEFAULT_TABLE table=default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa [id=4d565f22e74c4c9d97a5b367e2b016b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.057811 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f395f963a5a5400a966a8d4cc62aadf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.061971 880 tablet_service.cc:1511] Processing CreateTablet for tablet 87b71c9533c246468af80df79e10847e (DEFAULT_TABLE table=default.Table_2c25119f0d73426f98bbbadf2d86ad6b [id=4ac59c8960d44f20acfe614b1a542f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.062397 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b71c9533c246468af80df79e10847e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.063953 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9687dbd2616749f4bef7d9444bd89ddf (DEFAULT_TABLE table=default.Table_89bce7ee0b534345bafee7f0af6358e6 [id=cff5df610d05436da1e53a7d7383b35a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.064431 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9687dbd2616749f4bef7d9444bd89ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.067286 894 tablet_service.cc:1511] Processing CreateTablet for tablet f395f963a5a5400a966a8d4cc62aadf1 (DEFAULT_TABLE table=default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa [id=4d565f22e74c4c9d97a5b367e2b016b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.067677 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f395f963a5a5400a966a8d4cc62aadf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.067627 886 tablet_service.cc:1511] Processing CreateTablet for tablet 262732996d6d47749830529ac025f42f (DEFAULT_TABLE table=default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.067621 897 tablet_service.cc:1511] Processing CreateTablet for tablet 71e40b7c13da45c6842e0af230060d60 (DEFAULT_TABLE table=default.Table_ed21cebfa20b4c13af92240c4698a476 [id=b0df65fae4504dfea46b7311a6ebf58b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.068570 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262732996d6d47749830529ac025f42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.068511 1171 raft_consensus.cc:359] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.068704 1171 raft_consensus.cc:385] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.068807 1171 raft_consensus.cc:740] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.068078 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 87b71c9533c246468af80df79e10847e (DEFAULT_TABLE table=default.Table_2c25119f0d73426f98bbbadf2d86ad6b [id=4ac59c8960d44f20acfe614b1a542f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.069010 1171 consensus_queue.cc:260] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.069404 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b71c9533c246468af80df79e10847e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.069478 1171 ts_tablet_manager.cc:1434] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.079s user 0.002s sys 0.000s
I20260617 07:53:15.068809 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 82) took 3253 ms. Trace:
I20260617 07:53:15.071846 1862 rpcz_store.cc:276] 0617 07:53:11.815712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.815751 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:14.935280 (+3119529us) ts_tablet_manager.cc:1151] Deleting tablet 0cfb98aecc4546c88371436fcfbf8e86
0617 07:53:14.935289 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.946370 (+ 11081us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:14.949164 (+ 2794us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.068790 (+119626us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31195,"tablet-delete.queue_time_us":3119378}
I20260617 07:53:15.072324 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0cfb98aecc4546c88371436fcfbf8e86 (table default.Table_49b1276fd8f846b19cac293aa9f64723 [id=cd79fc14ef8c46309788c945c6267661]) successfully deleted
I20260617 07:53:15.074298 2202 raft_consensus.cc:493] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.074455 2202 raft_consensus.cc:515] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.068066 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 262732996d6d47749830529ac025f42f (DEFAULT_TABLE table=default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.074998 2202 leader_election.cc:290] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.077447 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262732996d6d47749830529ac025f42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.077677 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ce60b466f7420992ef194d72b5718d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:15.077870 1048 raft_consensus.cc:2468] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:15.079082 851 leader_election.cc:304] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:15.079483 2087 raft_consensus.cc:2804] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:15.079563 2087 raft_consensus.cc:493] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:15.079635 2087 raft_consensus.cc:3060] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:15.079860 1171 tablet_bootstrap.cc:492] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:15.080957 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 71e40b7c13da45c6842e0af230060d60 (DEFAULT_TABLE table=default.Table_ed21cebfa20b4c13af92240c4698a476 [id=b0df65fae4504dfea46b7311a6ebf58b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.081375 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e40b7c13da45c6842e0af230060d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.082507 1862 tablet_replica.cc:333] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:15.082690 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf826fd2b76a4bc997b07a0539ff486c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.082690 1862 raft_consensus.cc:2243] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.082821 1862 raft_consensus.cc:2272] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.083001 2087 raft_consensus.cc:515] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.083375 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e40b7c13da45c6842e0af230060d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.083602 2087 leader_election.cc:290] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.084785 1171 tablet_bootstrap.cc:654] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.086308 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ce60b466f7420992ef194d72b5718d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:15.086464 1048 raft_consensus.cc:3060] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:15.087142 1170 ts_tablet_manager.cc:1929] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:15.087244 1170 log.cc:1199] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0f9db8a986b344548e435b77edc14cb6
I20260617 07:53:15.088438 1022 tablet_service.cc:1511] Processing CreateTablet for tablet fc5151d5d8ef4905a99ff6e7c895f932 (DEFAULT_TABLE table=default.Table_e698b8d28fd24f26a1a627bc6409bd57 [id=bc5860889f324a13b2470348a3e62ab0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.088817 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc5151d5d8ef4905a99ff6e7c895f932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.089188 1048 raft_consensus.cc:2468] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:15.089659 851 leader_election.cc:304] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:15.090118 1987 consensus_queue.cc:1048] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:15.090248 1898 raft_consensus.cc:2804] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:15.090358 1898 raft_consensus.cc:697] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:15.090611 1898 consensus_queue.cc:237] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.091858 1170 ts_tablet_manager.cc:1950] T 0f9db8a986b344548e435b77edc14cb6 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.091874 1025 tablet_service.cc:1511] Processing CreateTablet for tablet e5544753b3144c1989f2ed99bffc2246 (DEFAULT_TABLE table=default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.092054 1862 ts_tablet_manager.cc:1916] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.092216 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5544753b3144c1989f2ed99bffc2246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.098268 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 76) took 3490 ms. Trace:
I20260617 07:53:15.098376 1170 rpcz_store.cc:276] 0617 07:53:11.608023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.735466 (+127443us) service_pool.cc:224] Handling call
0617 07:53:15.041574 (+3306108us) ts_tablet_manager.cc:1151] Deleting tablet 0f9db8a986b344548e435b77edc14cb6
0617 07:53:15.041583 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.061698 (+ 20115us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.087097 (+ 25399us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.098246 (+ 11149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3305880}
I20260617 07:53:15.098860 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 0f9db8a986b344548e435b77edc14cb6 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]) successfully deleted
I20260617 07:53:15.103185 755 tablet_service.cc:1511] Processing CreateTablet for tablet 61eff078d7074b6f805571b18d59d154 (DEFAULT_TABLE table=default.Table_73fb62164ea041f2a6e1e1c5e877605b [id=15c1d24cf79f4714b65b7750d9b37106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.103688 751 tablet_service.cc:1511] Processing CreateTablet for tablet cf826fd2b76a4bc997b07a0539ff486c (DEFAULT_TABLE table=default.Table_980a7e52a5604063bedf7b9097cc3e2c [id=a0341852d6c044fb82ba34e538139a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.106019 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 115) took 2498 ms. Trace:
I20260617 07:53:15.106101 1170 rpcz_store.cc:276] 0617 07:53:12.607886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.608057 (+ 171us) service_pool.cc:224] Handling call
0617 07:53:15.099589 (+2491532us) ts_tablet_manager.cc:1151] Deleting tablet 737e9344fc824714a2c2596170637158
0617 07:53:15.105884 (+ 6295us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.106001 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2491320}
W20260617 07:53:15.106536 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 737e9344fc824714a2c2596170637158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 737e9344fc824714a2c2596170637158 already in progress: creating tablet
I20260617 07:53:15.106599 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 116) took 2498 ms. Trace:
I20260617 07:53:15.106696 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61eff078d7074b6f805571b18d59d154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.106675 1170 rpcz_store.cc:276] 0617 07:53:12.608009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.608307 (+ 298us) service_pool.cc:224] Handling call
0617 07:53:15.106502 (+2498195us) ts_tablet_manager.cc:1151] Deleting tablet 121339ab4842432e9fb7bc357750f8ad
0617 07:53:15.106510 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.106584 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2498071}
W20260617 07:53:15.107020 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 121339ab4842432e9fb7bc357750f8ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 121339ab4842432e9fb7bc357750f8ad already in progress: creating tablet
I20260617 07:53:15.107236 2125 raft_consensus.cc:493] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.107707 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 018a118f883e4005b139897e485d00b3 (DEFAULT_TABLE table=default.Table_1936829f95a944e1894b1d3e4021a5e0 [id=e0cfe47bd3db477ab2a5fd3b68d42323]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.108086 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018a118f883e4005b139897e485d00b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.108606 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 117) took 2477 ms. Trace:
I20260617 07:53:15.108701 1170 rpcz_store.cc:276] 0617 07:53:12.631042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.631182 (+ 140us) service_pool.cc:224] Handling call
0617 07:53:15.108487 (+2477305us) ts_tablet_manager.cc:1151] Deleting tablet 596ef68705c84791b54f07e03b219b4c
0617 07:53:15.108499 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.108588 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2477116}
W20260617 07:53:15.109120 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 596ef68705c84791b54f07e03b219b4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596ef68705c84791b54f07e03b219b4c already in progress: creating tablet
I20260617 07:53:15.114101 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8aec6545fc714008b397e880e5ab40e3 (DEFAULT_TABLE table=default.Table_9b4e5d09d2f2490983e5b3a74b033d65 [id=e434111073cc4a52b0c95dafab87af0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.114459 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aec6545fc714008b397e880e5ab40e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.114748 2125 raft_consensus.cc:515] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.115355 2125 leader_election.cc:290] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.116899 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 118) took 2485 ms. Trace:
I20260617 07:53:15.116969 1170 rpcz_store.cc:276] 0617 07:53:12.631134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.631399 (+ 265us) service_pool.cc:224] Handling call
0617 07:53:15.116781 (+2485382us) ts_tablet_manager.cc:1151] Deleting tablet 0be19ece3a0a4a51abad7b8e2f3b2420
0617 07:53:15.116790 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.116876 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2485224}
W20260617 07:53:15.117328 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0be19ece3a0a4a51abad7b8e2f3b2420 already in progress: creating tablet
I20260617 07:53:15.117650 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 119) took 2425 ms. Trace:
I20260617 07:53:15.117731 1170 rpcz_store.cc:276] 0617 07:53:12.691799 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.691879 (+ 80us) service_pool.cc:224] Handling call
0617 07:53:15.117555 (+2425676us) ts_tablet_manager.cc:1151] Deleting tablet e897b111e65c497591c7daaa81d783c7
0617 07:53:15.117565 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.117635 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2425377}
W20260617 07:53:15.118089 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e897b111e65c497591c7daaa81d783c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e897b111e65c497591c7daaa81d783c7 already in progress: creating tablet
I20260617 07:53:15.118618 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 122) took 2250 ms. Trace:
I20260617 07:53:15.118702 1170 rpcz_store.cc:276] 0617 07:53:12.868379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.868448 (+ 69us) service_pool.cc:224] Handling call
0617 07:53:15.118524 (+2250076us) ts_tablet_manager.cc:1151] Deleting tablet 4de8df5e15cb43c0b95ec5af3110db66
0617 07:53:15.118533 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.118602 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2249485}
W20260617 07:53:15.119081 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4de8df5e15cb43c0b95ec5af3110db66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4de8df5e15cb43c0b95ec5af3110db66 already in progress: creating tablet
I20260617 07:53:15.120518 1019 tablet_service.cc:1511] Processing CreateTablet for tablet a4a35e3b7bb74667aa498c58a856cacc (DEFAULT_TABLE table=default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.120896 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a35e3b7bb74667aa498c58a856cacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.121495 1170 tablet_replica.cc:333] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.121752 1170 raft_consensus.cc:2243] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.122723 756 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 (DEFAULT_TABLE table=default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 [id=d079dbab725b43c0807868020b551ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.123570 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf826fd2b76a4bc997b07a0539ff486c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.123531 753 tablet_service.cc:1511] Processing CreateTablet for tablet 9687dbd2616749f4bef7d9444bd89ddf (DEFAULT_TABLE table=default.Table_89bce7ee0b534345bafee7f0af6358e6 [id=cff5df610d05436da1e53a7d7383b35a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.124552 1170 raft_consensus.cc:2272] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.097689 1862 ts_tablet_manager.cc:1929] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.124759 747 tablet_service.cc:1511] Processing CreateTablet for tablet f395f963a5a5400a966a8d4cc62aadf1 (DEFAULT_TABLE table=default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa [id=4d565f22e74c4c9d97a5b367e2b016b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.124866 1862 log.cc:1199] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/df4f9101deaa4e6ebddacbce14f32810
I20260617 07:53:15.100764 886 tablet_service.cc:1511] Processing CreateTablet for tablet fc5151d5d8ef4905a99ff6e7c895f932 (DEFAULT_TABLE table=default.Table_e698b8d28fd24f26a1a627bc6409bd57 [id=bc5860889f324a13b2470348a3e62ab0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.101073 882 tablet_service.cc:1511] Processing CreateTablet for tablet adbb0c38ef9242a5bfbbcbe22faa5df9 (DEFAULT_TABLE table=default.Table_05a7c719161e4611a82fb48194a5fbc6 [id=65588c19789644b4a065fcfbecb5bd75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.125133 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc5151d5d8ef4905a99ff6e7c895f932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.110378 879 tablet_service.cc:1511] Processing CreateTablet for tablet 8aec6545fc714008b397e880e5ab40e3 (DEFAULT_TABLE table=default.Table_9b4e5d09d2f2490983e5b3a74b033d65 [id=e434111073cc4a52b0c95dafab87af0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.125437 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aec6545fc714008b397e880e5ab40e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.101341 881 tablet_service.cc:1511] Processing CreateTablet for tablet 018a118f883e4005b139897e485d00b3 (DEFAULT_TABLE table=default.Table_1936829f95a944e1894b1d3e4021a5e0 [id=e0cfe47bd3db477ab2a5fd3b68d42323]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.125783 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018a118f883e4005b139897e485d00b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.125782 745 tablet_service.cc:1511] Processing CreateTablet for tablet 87b71c9533c246468af80df79e10847e (DEFAULT_TABLE table=default.Table_2c25119f0d73426f98bbbadf2d86ad6b [id=4ac59c8960d44f20acfe614b1a542f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.126744 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbb0c38ef9242a5bfbbcbe22faa5df9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.133157 716 leader_election.cc:343] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: cc84665c7849469aa27e6505dbed1516
I20260617 07:53:15.133548 744 tablet_service.cc:1511] Processing CreateTablet for tablet 262732996d6d47749830529ac025f42f (DEFAULT_TABLE table=default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.106197 885 tablet_service.cc:1511] Processing CreateTablet for tablet e5544753b3144c1989f2ed99bffc2246 (DEFAULT_TABLE table=default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.140643 1846 ts_tablet_manager.cc:1929] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.140774 1846 log.cc:1199] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a882ae04eeb94276bb78ded81fbea708
I20260617 07:53:15.141006 887 tablet_service.cc:1511] Processing CreateTablet for tablet a4a35e3b7bb74667aa498c58a856cacc (DEFAULT_TABLE table=default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.141237 1170 ts_tablet_manager.cc:1916] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.141846 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6f85399f924f619dd09465bb74f689 (DEFAULT_TABLE table=default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.141650 743 tablet_service.cc:1511] Processing CreateTablet for tablet dbe35d97f4c2441e878cfc2be6d71c87 (DEFAULT_TABLE table=default.Table_b2428f7dfbdf40a1998af9f8b4a4ce68 [id=1d6547d2fe50438280b9c2b0a519d858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.142524 760 tablet_service.cc:1511] Processing CreateTablet for tablet 0b85d49f255940eeaf343bfcf71e00e9 (DEFAULT_TABLE table=default.Table_912b307c6f95423883dad501646529f4 [id=c0ca0b05fe444d6baeaca00158a9a72b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.143620 759 tablet_service.cc:1511] Processing CreateTablet for tablet 71e40b7c13da45c6842e0af230060d60 (DEFAULT_TABLE table=default.Table_ed21cebfa20b4c13af92240c4698a476 [id=b0df65fae4504dfea46b7311a6ebf58b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.145164 741 tablet_service.cc:1511] Processing CreateTablet for tablet e5544753b3144c1989f2ed99bffc2246 (DEFAULT_TABLE table=default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.146505 1862 ts_tablet_manager.cc:1950] T df4f9101deaa4e6ebddacbce14f32810 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:15.147068 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 83) took 3330 ms. Trace:
I20260617 07:53:15.147571 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9687dbd2616749f4bef7d9444bd89ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.147598 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:15.147841 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:15.148124 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 62b7746239c54ab6828299968d18628d (table default.Table_5de31344614842848efc0a8133386994 [id=0ab7b2d30cea43f0bcfee627747ca777]). Expected version 3 got 0
I20260617 07:53:15.148303 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]). Expected version 1 got 0
I20260617 07:53:15.148919 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 763581e2baeb46149bfb38d81301b9c5 (table default.Table_c66818ef6cba45cca125f04e646db3cc [id=2654154ff09642f28fd8510054d7178d]). Expected version 1 got 0
I20260617 07:53:15.149355 1846 ts_tablet_manager.cc:1950] T a882ae04eeb94276bb78ded81fbea708 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:15.149421 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f3cecc2572184f9a93f8d7715df1bd96 (DEFAULT_TABLE table=default.Table_acd61f61eb644016aee97330152bf01e [id=3aef3e33f3a8414d92c0f82962ee41b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.149617 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6f85399f924f619dd09465bb74f689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.149958 757 tablet_service.cc:1511] Processing CreateTablet for tablet adbb0c38ef9242a5bfbbcbe22faa5df9 (DEFAULT_TABLE table=default.Table_05a7c719161e4611a82fb48194a5fbc6 [id=65588c19789644b4a065fcfbecb5bd75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.150765 755 tablet_service.cc:1511] Processing CreateTablet for tablet fc5151d5d8ef4905a99ff6e7c895f932 (DEFAULT_TABLE table=default.Table_e698b8d28fd24f26a1a627bc6409bd57 [id=bc5860889f324a13b2470348a3e62ab0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.153855 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cecc2572184f9a93f8d7715df1bd96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.153946 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_0c3bb1ff748948298d93736f1a8583e4 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 1 got 0
I20260617 07:53:15.154646 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5544753b3144c1989f2ed99bffc2246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.157546 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a35e3b7bb74667aa498c58a856cacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.165043 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:15.149420 1020 tablet_service.cc:1511] Processing CreateTablet for tablet adbb0c38ef9242a5bfbbcbe22faa5df9 (DEFAULT_TABLE table=default.Table_05a7c719161e4611a82fb48194a5fbc6 [id=65588c19789644b4a065fcfbecb5bd75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.165434 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:15.165585 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
I20260617 07:53:15.165966 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 8c76bfcbd22e4bfb97346a1b56f68dab (table default.Table_3b87923865964ae78caae0e8d9231e27 [id=ed9c0eecb73c4c529138cdb71267fba1]). Expected version 1 got 0
I20260617 07:53:15.167913 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:15.168776 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:15.168001 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbb0c38ef9242a5bfbbcbe22faa5df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.169551 1170 ts_tablet_manager.cc:1929] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.169574 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:15.169664 1170 log.cc:1199] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/99ec78c123d448329b8442a0de0140d3
I20260617 07:53:15.169785 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d1c7ced951c34afa8dff243d275bfb36 (table default.Table_920f71d2a7bb466ea8426518f300ac86 [id=9726df7d693441359861876ae1179b4d]). Expected version 4 got 0
I20260617 07:53:15.170002 1170 ts_tablet_manager.cc:1950] T 99ec78c123d448329b8442a0de0140d3 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.170195 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
I20260617 07:53:15.170630 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:15.170725 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 123) took 2290 ms. Trace:
I20260617 07:53:15.170799 1170 rpcz_store.cc:276] 0617 07:53:12.880640 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.881949 (+ 1309us) service_pool.cc:224] Handling call
0617 07:53:15.121422 (+2239473us) ts_tablet_manager.cc:1151] Deleting tablet 99ec78c123d448329b8442a0de0140d3
0617 07:53:15.121430 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.144583 (+ 23153us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.169503 (+ 24920us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.170707 (+ 1204us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2239207}
I20260617 07:53:15.171276 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:15.174012 884 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6f85399f924f619dd09465bb74f689 (DEFAULT_TABLE table=default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.174382 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6f85399f924f619dd09465bb74f689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.174908 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 124) took 2265 ms. Trace:
I20260617 07:53:15.174985 1170 rpcz_store.cc:276] 0617 07:53:12.908965 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.910215 (+ 1250us) service_pool.cc:224] Handling call
0617 07:53:15.174785 (+2264570us) ts_tablet_manager.cc:1151] Deleting tablet 1f6264adc3994c22864ea73106ba2320
0617 07:53:15.174794 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.174883 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2264221}
I20260617 07:53:15.175566 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 125) took 2238 ms. Trace:
I20260617 07:53:15.175645 1170 rpcz_store.cc:276] 0617 07:53:12.937233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.937298 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:15.175480 (+2238182us) ts_tablet_manager.cc:1151] Deleting tablet 71e8f7118aaf4c6a9b9caab5abc030fa
0617 07:53:15.175488 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.175554 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2237811}
I20260617 07:53:15.176630 895 tablet_service.cc:1511] Processing CreateTablet for tablet f3cecc2572184f9a93f8d7715df1bd96 (DEFAULT_TABLE table=default.Table_acd61f61eb644016aee97330152bf01e [id=3aef3e33f3a8414d92c0f82962ee41b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.176659 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 134) took 1976 ms. Trace:
I20260617 07:53:15.176862 1170 rpcz_store.cc:276] 0617 07:53:13.199731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.199781 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:15.176589 (+1976808us) ts_tablet_manager.cc:1151] Deleting tablet 4e3b5cb887da4d86bdc3d69f350fdb40
0617 07:53:15.176597 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.176645 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1976647}
I20260617 07:53:15.177130 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cecc2572184f9a93f8d7715df1bd96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.177212 749 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6f85399f924f619dd09465bb74f689 (DEFAULT_TABLE table=default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.177451 752 tablet_service.cc:1511] Processing CreateTablet for tablet 018a118f883e4005b139897e485d00b3 (DEFAULT_TABLE table=default.Table_1936829f95a944e1894b1d3e4021a5e0 [id=e0cfe47bd3db477ab2a5fd3b68d42323]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.177590 750 tablet_service.cc:1511] Processing CreateTablet for tablet a4a35e3b7bb74667aa498c58a856cacc (DEFAULT_TABLE table=default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.177768 742 tablet_service.cc:1511] Processing CreateTablet for tablet 8aec6545fc714008b397e880e5ab40e3 (DEFAULT_TABLE table=default.Table_9b4e5d09d2f2490983e5b3a74b033d65 [id=e434111073cc4a52b0c95dafab87af0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.177932 748 tablet_service.cc:1511] Processing CreateTablet for tablet f3cecc2572184f9a93f8d7715df1bd96 (DEFAULT_TABLE table=default.Table_acd61f61eb644016aee97330152bf01e [id=3aef3e33f3a8414d92c0f82962ee41b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.147203 1862 rpcz_store.cc:276] 0617 07:53:11.816079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.816118 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:15.072183 (+3256065us) ts_tablet_manager.cc:1151] Deleting tablet df4f9101deaa4e6ebddacbce14f32810
0617 07:53:15.082460 (+ 10277us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.094995 (+ 12535us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.097647 (+ 2652us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.147028 (+ 49381us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3255878}
I20260617 07:53:15.179751 1862 tablet_replica.cc:333] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:15.179982 1862 raft_consensus.cc:2243] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:15.180351 1862 raft_consensus.cc:2272] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.180382 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 56) took 3476 ms. Trace:
I20260617 07:53:15.181005 1862 ts_tablet_manager.cc:1916] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.182433 762 raft_consensus.cc:3060] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:15.183569 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ce60b466f7420992ef194d72b5718d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:15.185905 1846 rpcz_store.cc:276] 0617 07:53:11.694771 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.694815 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:14.938634 (+3243819us) ts_tablet_manager.cc:1151] Deleting tablet a882ae04eeb94276bb78ded81fbea708
0617 07:53:14.938643 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:14.965402 (+ 26759us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.122366 (+156964us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.170908 (+ 48542us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3235440}
I20260617 07:53:15.186383 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ce60b466f7420992ef194d72b5718d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:15.186944 713 leader_election.cc:343] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: cc84665c7849469aa27e6505dbed1516
I20260617 07:53:15.188117 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f395f963a5a5400a966a8d4cc62aadf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.188967 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e40b7c13da45c6842e0af230060d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.189913 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aec6545fc714008b397e880e5ab40e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.190230 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b71c9533c246468af80df79e10847e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.190502 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.191710 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262732996d6d47749830529ac025f42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.192299 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a35e3b7bb74667aa498c58a856cacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.171352 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 99ec78c123d448329b8442a0de0140d3 (table default.Table_fc5f3ba5ab8a45c7bab81747fe42b662 [id=e65c9a5f1a1f479ea1804dfe806a2926]) successfully deleted
W20260617 07:53:15.195019 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 1f6264adc3994c22864ea73106ba2320 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6264adc3994c22864ea73106ba2320 already in progress: creating tablet
W20260617 07:53:15.195319 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 because the tablet was not found. No further retry: Not found: Tablet not found: 4e3b5cb887da4d86bdc3d69f350fdb40
I20260617 07:53:15.184947 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet df4f9101deaa4e6ebddacbce14f32810 (table default.Table_996d5685c9904502b299700425b29a1d [id=534b1a750b5a4b5db2ae4aaa7b47f379]) successfully deleted
I20260617 07:53:15.197865 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbb0c38ef9242a5bfbbcbe22faa5df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.198587 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018a118f883e4005b139897e485d00b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.200228 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:15.200546 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]). Expected version 3 got 0
I20260617 07:53:15.200969 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet df5bbdbcf3044128a4cb274f83d5d29b (table default.Table_aab2b789b2dc48719838e0704687a406 [id=e42c6141367a4922ace753fd8ccf8463]). Expected version 1 got 0
I20260617 07:53:15.201148 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:15.201287 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ce1cb2c879e6451886c55907678792de (table default.Table_0da48fe3fdde4465a7439aba33ec5d15 [id=03ababcd2bda4c96a8ead4f4fd3ae578]). Expected version 2 got 0
I20260617 07:53:15.201894 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6f85399f924f619dd09465bb74f689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.204749 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5544753b3144c1989f2ed99bffc2246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.206135 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cecc2572184f9a93f8d7715df1bd96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.206907 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:15.207203 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ca400838f5214d1a8f57e72c5068f0f9 (table default.Table_1a37fbbe9740440a8c245559a94b7f5f [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]). Expected version 1 got 0
I20260617 07:53:15.207366 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_8dd1d9e74c1245e1afe42a16f20e57f6 [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 3 got 0
I20260617 07:53:15.207546 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_a18dfbacf2d34929b9fd021add13fd7e [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 2 got 0
I20260617 07:53:15.216432 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:15.216727 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:15.216854 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
W20260617 07:53:15.218627 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63de833f7aa740b0b5bf2494b78aca5c consensus state has no leader
I20260617 07:53:15.222695 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 49) took 3558 ms. Trace:
I20260617 07:53:15.223681 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 133) took 2024 ms. Trace:
I20260617 07:53:15.223781 1170 rpcz_store.cc:276] 0617 07:53:13.199605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.199657 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:15.223547 (+2023890us) ts_tablet_manager.cc:1151] Deleting tablet 9436fb7fca094eaab925748e254b1a62
0617 07:53:15.223559 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.223659 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2023468}
W20260617 07:53:15.224220 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
I20260617 07:53:15.225071 1846 rpcz_store.cc:276] 0617 07:53:11.664667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.664710 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:15.222554 (+3557844us) ts_tablet_manager.cc:1151] Deleting tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
0617 07:53:15.222563 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.222661 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3517790}
I20260617 07:53:15.226703 1846 tablet_replica.cc:333] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:15.227016 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 132) took 2027 ms. Trace:
I20260617 07:53:15.227108 1170 rpcz_store.cc:276] 0617 07:53:13.199490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.200196 (+ 706us) service_pool.cc:224] Handling call
0617 07:53:15.226900 (+2026704us) ts_tablet_manager.cc:1151] Deleting tablet 11794aa70824476e9751a41ab305cc80
0617 07:53:15.226912 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.226996 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2026492}
I20260617 07:53:15.227573 1170 tablet_replica.cc:333] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.227766 1170 raft_consensus.cc:2243] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:15.227840 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 11794aa70824476e9751a41ab305cc80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11794aa70824476e9751a41ab305cc80 already in progress: creating tablet
I20260617 07:53:15.227926 1170 raft_consensus.cc:2272] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.228425 1170 ts_tablet_manager.cc:1916] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.233079 460 catalog_manager.cc:5696] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:15.187438 713 leader_election.cc:304] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:15.236974 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:15.237847 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:15.238835 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:15.241330 460 catalog_manager.cc:5696] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:15.242100 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:15.242479 460 catalog_manager.cc:5696] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:15.243008 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:15.243657 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet df5bbdbcf3044128a4cb274f83d5d29b (table default.Table_aab2b789b2dc48719838e0704687a406 [id=e42c6141367a4922ace753fd8ccf8463]). Expected version 1 got 0
I20260617 07:53:15.244375 1862 ts_tablet_manager.cc:1929] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:15.244522 1862 log.cc:1199] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/4996cde4d1514aa081257c802339abe6
I20260617 07:53:15.244915 1862 ts_tablet_manager.cc:1950] T 4996cde4d1514aa081257c802339abe6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:15.245270 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 84) took 3428 ms. Trace:
I20260617 07:53:15.245348 1862 rpcz_store.cc:276] 0617 07:53:11.816427 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.817113 (+ 686us) service_pool.cc:224] Handling call
0617 07:53:15.179699 (+3362586us) ts_tablet_manager.cc:1151] Deleting tablet 4996cde4d1514aa081257c802339abe6
0617 07:53:15.179711 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.210808 (+ 31097us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.244306 (+ 33498us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.245253 (+ 947us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3362414}
I20260617 07:53:15.245898 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 4996cde4d1514aa081257c802339abe6 (table default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]) successfully deleted
I20260617 07:53:15.246052 1862 tablet_replica.cc:333] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:15.248982 1862 raft_consensus.cc:2243] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.249264 1862 raft_consensus.cc:2272] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.249966 1862 ts_tablet_manager.cc:1916] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:15.253041 446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111) [suppressed 12 similar messages]
I20260617 07:53:15.253947 1171 tablet_bootstrap.cc:492] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:15.254765 1171 ts_tablet_manager.cc:1403] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.175s user 0.003s sys 0.019s
I20260617 07:53:15.255870 1171 raft_consensus.cc:359] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.256166 1171 raft_consensus.cc:385] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.256274 1171 raft_consensus.cc:740] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.256615 1171 consensus_queue.cc:260] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.257416 1171 ts_tablet_manager.cc:1434] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:15.257840 1171 tablet_bootstrap.cc:492] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:15.259595 1171 tablet_bootstrap.cc:654] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:15.260219 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 63de833f7aa740b0b5bf2494b78aca5c consensus state has no leader
I20260617 07:53:15.281268 1172 tablet_bootstrap.cc:492] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:15.281430 1172 ts_tablet_manager.cc:1403] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.353s user 0.006s sys 0.015s
I20260617 07:53:15.282181 1172 raft_consensus.cc:359] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.282366 1172 raft_consensus.cc:385] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.282420 1172 raft_consensus.cc:740] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.291334 1846 raft_consensus.cc:2243] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.291604 1846 raft_consensus.cc:2272] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.292768 1846 ts_tablet_manager.cc:1916] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:15.293514 713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 57511.8us
I20260617 07:53:15.301116 2125 raft_consensus.cc:2749] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:15.294078 852 leader_election.cc:343] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:15.303153 852 leader_election.cc:343] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:15.303573 852 consensus_peers.cc:597] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:15.303610 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe35d97f4c2441e878cfc2be6d71c87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.309967 446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:36505, user_credentials={real_user=slave}} blocked reactor thread for 56899.9us
I20260617 07:53:15.310531 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a882ae04eeb94276bb78ded81fbea708 (table default.Table_e57d7374905b4ff0b1e620e152b6d6c0 [id=b602ba9d92744e8bb82c4c57e9bfccab]) successfully deleted
I20260617 07:53:15.310771 1170 ts_tablet_manager.cc:1929] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.310894 1170 log.cc:1199] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/92e55be5f28740fba65c1199a571d97a
W20260617 07:53:15.311151 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 already in progress: creating tablet
I20260617 07:53:15.311219 1170 ts_tablet_manager.cc:1950] T 92e55be5f28740fba65c1199a571d97a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.311908 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b85d49f255940eeaf343bfcf71e00e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.312151 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 137) took 2014 ms. Trace:
I20260617 07:53:15.312258 1170 rpcz_store.cc:276] 0617 07:53:13.297657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.297705 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:15.227531 (+1929826us) ts_tablet_manager.cc:1151] Deleting tablet 92e55be5f28740fba65c1199a571d97a
0617 07:53:15.227540 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.251979 (+ 24439us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.310697 (+ 58718us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.312127 (+ 1430us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1893168}
I20260617 07:53:15.312824 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 92e55be5f28740fba65c1199a571d97a (table default.Table_93a6fb533319471aa6c304e5fe867477 [id=061cdaef8556415dad01eccb24949518]) successfully deleted
I20260617 07:53:15.313216 1170 tablet_replica.cc:333] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.313506 1170 raft_consensus.cc:2243] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.313758 1170 raft_consensus.cc:2272] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.315124 1172 consensus_queue.cc:260] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.315409 2193 raft_consensus.cc:493] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.315532 2193 raft_consensus.cc:515] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.315656 1171 tablet_bootstrap.cc:492] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:15.315834 1171 ts_tablet_manager.cc:1403] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.003s
I20260617 07:53:15.316324 2193 leader_election.cc:290] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:15.316450 2193 raft_consensus.cc:493] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.316543 2193 raft_consensus.cc:515] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.316797 1171 raft_consensus.cc:359] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.316965 2193 leader_election.cc:290] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:15.317011 1171 raft_consensus.cc:385] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.317155 1171 raft_consensus.cc:740] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.317422 1171 consensus_queue.cc:260] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.323397 1171 ts_tablet_manager.cc:1434] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260617 07:53:15.325268 1171 tablet_bootstrap.cc:492] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:15.317502 1862 ts_tablet_manager.cc:1929] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.326340 1862 log.cc:1199] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/57e05a97a4ab4ed7bff523d1fb1c59ae
I20260617 07:53:15.326714 1171 tablet_bootstrap.cc:654] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.328810 1178 tablet_bootstrap.cc:492] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:15.347038 1170 ts_tablet_manager.cc:1916] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.326737 1862 ts_tablet_manager.cc:1950] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:15.360532 1170 ts_tablet_manager.cc:1929] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:15.360656 1170 log.cc:1199] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/de030009192748118b388eec555d90da
I20260617 07:53:15.361137 2262 raft_consensus.cc:493] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.363054 2262 raft_consensus.cc:515] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.363612 2262 leader_election.cc:290] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:15.361070 1170 ts_tablet_manager.cc:1950] T de030009192748118b388eec555d90da P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.364917 1171 tablet_bootstrap.cc:492] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:15.365545 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 138) took 2067 ms. Trace:
I20260617 07:53:15.365648 1170 rpcz_store.cc:276] 0617 07:53:13.297986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.298116 (+ 130us) service_pool.cc:224] Handling call
0617 07:53:15.313157 (+2015041us) ts_tablet_manager.cc:1151] Deleting tablet de030009192748118b388eec555d90da
0617 07:53:15.313170 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.353247 (+ 40077us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.360474 (+ 7227us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.365133 (+ 4659us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1978731}
I20260617 07:53:15.366060 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet de030009192748118b388eec555d90da (table default.Table_a562036b19dd4c99a8981180a617b865 [id=22c75406c0674d11b3f9fd39af55cca8]) successfully deleted
I20260617 07:53:15.367933 1170 tablet_replica.cc:333] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.368124 1170 raft_consensus.cc:2243] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.366369 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28538804fd254dc8b4a341debf508a85" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:15.366407 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63de833f7aa740b0b5bf2494b78aca5c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:15.366576 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae9261c0ac94defaecfc7d14ba1ae61" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:15.370800 988 leader_election.cc:343] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:15.371097 988 leader_election.cc:343] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:15.371353 988 leader_election.cc:343] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.371668 1171 ts_tablet_manager.cc:1403] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.000s
I20260617 07:53:15.371935 1170 raft_consensus.cc:2272] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.372465 1170 ts_tablet_manager.cc:1916] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.372717 1171 raft_consensus.cc:359] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.372944 1171 raft_consensus.cc:385] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.373034 1171 raft_consensus.cc:740] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.341768 2229 tablet.cc:1724] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:15.342845 2125 raft_consensus.cc:493] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc3bec007846459a9da0c7b8211e477b)
I20260617 07:53:15.377277 2125 raft_consensus.cc:515] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.377928 2125 leader_election.cc:290] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.378309 1178 ts_tablet_manager.cc:1403] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.448s user 0.007s sys 0.016s
W20260617 07:53:15.379014 713 leader_election.cc:343] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 8fa23bb0929440b1820afdce4b9e8d8c
I20260617 07:53:15.347958 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc5151d5d8ef4905a99ff6e7c895f932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.379779 1170 ts_tablet_manager.cc:1929] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.379693 1171 consensus_queue.cc:260] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:15.379810 716 leader_election.cc:343] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 8fa23bb0929440b1820afdce4b9e8d8c
I20260617 07:53:15.379894 1170 log.cc:1199] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/36ce60b466f7420992ef194d72b5718d
I20260617 07:53:15.379913 716 leader_election.cc:304] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:15.348620 762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28538804fd254dc8b4a341debf508a85" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:15.380208 1171 ts_tablet_manager.cc:1434] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260617 07:53:15.375615 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae9261c0ac94defaecfc7d14ba1ae61" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:15.375813 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63de833f7aa740b0b5bf2494b78aca5c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:15.381541 986 leader_election.cc:343] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.381644 986 leader_election.cc:304] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:15.381978 986 leader_election.cc:343] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.382061 986 leader_election.cc:304] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:15.382332 986 leader_election.cc:343] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.382414 986 leader_election.cc:304] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:15.382575 1170 ts_tablet_manager.cc:1950] T 36ce60b466f7420992ef194d72b5718d P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.382685 2262 raft_consensus.cc:2749] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.382823 2262 raft_consensus.cc:2749] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.382932 2193 raft_consensus.cc:2749] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.383771 1171 tablet_bootstrap.cc:492] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:15.383888 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 139) took 2084 ms. Trace:
I20260617 07:53:15.383965 1170 rpcz_store.cc:276] 0617 07:53:13.299372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.299428 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:15.367882 (+2068454us) ts_tablet_manager.cc:1151] Deleting tablet 36ce60b466f7420992ef194d72b5718d
0617 07:53:15.367892 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.375311 (+ 7419us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.379740 (+ 4429us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.383858 (+ 4118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3636,"tablet-delete.queue_time_us":2033401}
I20260617 07:53:15.384258 1170 tablet_replica.cc:333] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.384423 1170 raft_consensus.cc:2243] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.384567 1170 raft_consensus.cc:2272] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.385070 1170 ts_tablet_manager.cc:1916] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.385944 2125 raft_consensus.cc:2749] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:15.389263 1846 ts_tablet_manager.cc:1929] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:15.389844 1846 log.cc:1199] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/c7e43e1a3df54efe992a86dd0bd0c149
I20260617 07:53:15.390210 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 36ce60b466f7420992ef194d72b5718d (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
I20260617 07:53:15.393155 1846 ts_tablet_manager.cc:1950] T c7e43e1a3df54efe992a86dd0bd0c149 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:15.379580 1178 raft_consensus.cc:359] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.394950 1178 raft_consensus.cc:385] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.395030 1178 raft_consensus.cc:740] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.395226 1178 consensus_queue.cc:260] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.395696 1178 ts_tablet_manager.cc:1434] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.017s user 0.000s sys 0.001s
I20260617 07:53:15.396535 1172 ts_tablet_manager.cc:1434] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.115s user 0.002s sys 0.000s
I20260617 07:53:15.397053 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 66) took 3670 ms. Trace:
I20260617 07:53:15.397125 1846 rpcz_store.cc:276] 0617 07:53:11.726631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.726829 (+ 198us) service_pool.cc:224] Handling call
0617 07:53:15.226637 (+3499808us) ts_tablet_manager.cc:1151] Deleting tablet c7e43e1a3df54efe992a86dd0bd0c149
0617 07:53:15.226649 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.375324 (+148675us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.389189 (+ 13865us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.397036 (+ 7847us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3496994}
I20260617 07:53:15.397415 1846 tablet_replica.cc:333] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:15.397562 1846 raft_consensus.cc:2243] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.397682 1846 raft_consensus.cc:2272] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.398159 1846 ts_tablet_manager.cc:1916] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.399441 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet c7e43e1a3df54efe992a86dd0bd0c149 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
I20260617 07:53:15.385699 1171 tablet_bootstrap.cc:654] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.402581 1172 tablet_bootstrap.cc:492] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:15.402618 1022 tablet_service.cc:1511] Processing CreateTablet for tablet ecd880890df5494f8500d623b0524e9c (DEFAULT_TABLE table=default.Table_d018eef700b3482a83212d8b4a10041e [id=dbc5752bd46a4b92a6399a02b8b9d8dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.402952 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd880890df5494f8500d623b0524e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.404125 1172 tablet_bootstrap.cc:654] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.392218 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 85) took 3574 ms. Trace:
I20260617 07:53:15.405014 1862 rpcz_store.cc:276] 0617 07:53:11.817541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.817581 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:15.245700 (+3428119us) ts_tablet_manager.cc:1151] Deleting tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
0617 07:53:15.246008 (+ 308us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.253460 (+ 7452us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.317452 (+ 63992us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.392198 (+ 74746us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2663,"tablet-delete.queue_time_us":3427866}
I20260617 07:53:15.405594 1862 tablet_replica.cc:333] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:15.405834 1862 raft_consensus.cc:2243] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.406040 1862 raft_consensus.cc:2272] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.405999 887 tablet_service.cc:1511] Processing CreateTablet for tablet ecd880890df5494f8500d623b0524e9c (DEFAULT_TABLE table=default.Table_d018eef700b3482a83212d8b4a10041e [id=dbc5752bd46a4b92a6399a02b8b9d8dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.406754 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 57e05a97a4ab4ed7bff523d1fb1c59ae (table default.Table_724c24f5d49244fa91caa9fc9603eead [id=bf143b9baca647f0b25452d16dff2ae6]) successfully deleted
I20260617 07:53:15.408686 1019 tablet_service.cc:1511] Processing CreateTablet for tablet ce7cc6cbd4a0474880ed62aebc035226 (DEFAULT_TABLE table=default.Table_8f6fcc4db43e45beb5146c43fcb3d19d [id=933812b42f6b45c6a79064536d9b437a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.409089 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd880890df5494f8500d623b0524e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.409106 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7cc6cbd4a0474880ed62aebc035226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.408696 1030 tablet_service.cc:1511] Processing CreateTablet for tablet b1f0572db4374b49836096011d63a522 (DEFAULT_TABLE table=default.Table_16971ccf055b46f0b31b36cc72ae619c [id=f104c8ea8ac04bd6b41ce8b67118241d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.414182 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f0572db4374b49836096011d63a522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.414140 745 tablet_service.cc:1511] Processing CreateTablet for tablet ca6c265c771745fa8eac4b5c410b5f7b (DEFAULT_TABLE table=default.Table_513f8c4d25114eb89041a6f10d07af8b [id=f47262f86e0b452a902fd1b1cf371706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.414533 759 tablet_service.cc:1511] Processing CreateTablet for tablet ce7cc6cbd4a0474880ed62aebc035226 (DEFAULT_TABLE table=default.Table_8f6fcc4db43e45beb5146c43fcb3d19d [id=933812b42f6b45c6a79064536d9b437a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.415592 894 tablet_service.cc:1511] Processing CreateTablet for tablet ca6c265c771745fa8eac4b5c410b5f7b (DEFAULT_TABLE table=default.Table_513f8c4d25114eb89041a6f10d07af8b [id=f47262f86e0b452a902fd1b1cf371706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.415809 885 tablet_service.cc:1511] Processing CreateTablet for tablet 17c8a945eca643f3b3f4807406e9a24e (DEFAULT_TABLE table=default.Table_611568f3c8e3430381233e6f3ee4ac1f [id=46cf00da96904c4ea8be6c6344e29f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.415923 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6c265c771745fa8eac4b5c410b5f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.416119 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c8a945eca643f3b3f4807406e9a24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.416857 898 tablet_service.cc:1511] Processing CreateTablet for tablet b1f0572db4374b49836096011d63a522 (DEFAULT_TABLE table=default.Table_16971ccf055b46f0b31b36cc72ae619c [id=f104c8ea8ac04bd6b41ce8b67118241d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.417141 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f0572db4374b49836096011d63a522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.419795 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7cc6cbd4a0474880ed62aebc035226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.421010 895 tablet_service.cc:1511] Processing CreateTablet for tablet ce7cc6cbd4a0474880ed62aebc035226 (DEFAULT_TABLE table=default.Table_8f6fcc4db43e45beb5146c43fcb3d19d [id=933812b42f6b45c6a79064536d9b437a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.421303 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7cc6cbd4a0474880ed62aebc035226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.398425 1170 ts_tablet_manager.cc:1929] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.421416 1170 log.cc:1199] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a38bb8a140ef4bcab65aaa03bdb79040
I20260617 07:53:15.421759 1170 ts_tablet_manager.cc:1950] T a38bb8a140ef4bcab65aaa03bdb79040 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.423182 744 tablet_service.cc:1511] Processing CreateTablet for tablet b1f0572db4374b49836096011d63a522 (DEFAULT_TABLE table=default.Table_16971ccf055b46f0b31b36cc72ae619c [id=f104c8ea8ac04bd6b41ce8b67118241d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.423628 2086 raft_consensus.cc:493] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.423750 2086 raft_consensus.cc:515] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.423950 1846 ts_tablet_manager.cc:1929] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:15.424034 1846 log.cc:1199] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/82d682ae37d74b4b967da0f8e2de6301
I20260617 07:53:15.424361 1846 ts_tablet_manager.cc:1950] T 82d682ae37d74b4b967da0f8e2de6301 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:15.424436 2086 leader_election.cc:290] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.424525 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 140) took 2124 ms. Trace:
I20260617 07:53:15.424607 1170 rpcz_store.cc:276] 0617 07:53:13.299910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.299962 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:15.384217 (+2084255us) ts_tablet_manager.cc:1151] Deleting tablet a38bb8a140ef4bcab65aaa03bdb79040
0617 07:53:15.384226 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.391849 (+ 7623us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.398375 (+ 6526us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.424503 (+ 26128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2049710}
I20260617 07:53:15.424793 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6c265c771745fa8eac4b5c410b5f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.424953 1170 tablet_replica.cc:333] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.425124 1170 raft_consensus.cc:2243] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.425244 1170 raft_consensus.cc:2272] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.425690 1170 ts_tablet_manager.cc:1916] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.426401 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a38bb8a140ef4bcab65aaa03bdb79040 (table default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]) successfully deleted
W20260617 07:53:15.429062 851 leader_election.cc:343] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a38bb8a140ef4bcab65aaa03bdb79040
I20260617 07:53:15.430060 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38bb8a140ef4bcab65aaa03bdb79040" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:15.430500 852 leader_election.cc:343] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.430604 852 leader_election.cc:304] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:15.430936 2086 raft_consensus.cc:2749] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.433563 746 tablet_service.cc:1511] Processing CreateTablet for tablet 17c8a945eca643f3b3f4807406e9a24e (DEFAULT_TABLE table=default.Table_611568f3c8e3430381233e6f3ee4ac1f [id=46cf00da96904c4ea8be6c6344e29f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.433950 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c8a945eca643f3b3f4807406e9a24e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.434645 851 consensus_peers.cc:597] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df705c2300064db680bec1fefab08d2f. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:15.439484 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:15.442708 1170 ts_tablet_manager.cc:1929] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.443414 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f0572db4374b49836096011d63a522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.444407 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:15.444767 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]). Expected version 1 got 0
I20260617 07:53:15.444994 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_4b11386c9de448719673afea74a4e6a0 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 1 got 0
I20260617 07:53:15.445263 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:15.445395 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_f86c4a5d30d546a890795712293d1a2f [id=b20987ff1f1c43098b1408b126b32913]). Expected version 2 got 0
I20260617 07:53:15.446987 1171 tablet_bootstrap.cc:492] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:15.447049 1170 log.cc:1199] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/3ae9261c0ac94defaecfc7d14ba1ae61
I20260617 07:53:15.447235 1171 ts_tablet_manager.cc:1403] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.002s
I20260617 07:53:15.447371 1170 ts_tablet_manager.cc:1950] T 3ae9261c0ac94defaecfc7d14ba1ae61 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.448102 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 136) took 2150 ms. Trace:
I20260617 07:53:15.448076 1171 raft_consensus.cc:359] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.448189 1170 rpcz_store.cc:276] 0617 07:53:13.297545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.300080 (+ 2535us) service_pool.cc:224] Handling call
0617 07:53:15.424911 (+2124831us) ts_tablet_manager.cc:1151] Deleting tablet 3ae9261c0ac94defaecfc7d14ba1ae61
0617 07:53:15.424920 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.428484 (+ 3564us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.442661 (+ 14177us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.448083 (+ 5422us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2090302}
I20260617 07:53:15.448524 1170 tablet_replica.cc:333] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.448705 1170 raft_consensus.cc:2243] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.449246 1170 raft_consensus.cc:2272] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.448354 1171 raft_consensus.cc:385] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.449456 1171 raft_consensus.cc:740] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.446085 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 17c8a945eca643f3b3f4807406e9a24e (DEFAULT_TABLE table=default.Table_611568f3c8e3430381233e6f3ee4ac1f [id=46cf00da96904c4ea8be6c6344e29f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.449168 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 3ae9261c0ac94defaecfc7d14ba1ae61 (table default.Table_f906af88bdcd40169dad534822931936 [id=cd20d0490cb74168b4ff032d0f943992]) successfully deleted
I20260617 07:53:15.449756 1171 consensus_queue.cc:260] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.450315 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c8a945eca643f3b3f4807406e9a24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.451187 773 raft_consensus.cc:1275] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260617 07:53:15.450588 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:15.451488 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:15.451649 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:15.452425 2086 consensus_queue.cc:1048] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:15.453590 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_0c3bb1ff748948298d93736f1a8583e4 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 1 got 0
I20260617 07:53:15.454221 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:15.454564 1171 ts_tablet_manager.cc:1434] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260617 07:53:15.454900 1171 tablet_bootstrap.cc:492] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:15.454912 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:15.455801 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:15.456768 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:15.456986 1171 tablet_bootstrap.cc:654] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.457139 1170 ts_tablet_manager.cc:1916] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.457983 1030 tablet_service.cc:1511] Processing CreateTablet for tablet ca6c265c771745fa8eac4b5c410b5f7b (DEFAULT_TABLE table=default.Table_513f8c4d25114eb89041a6f10d07af8b [id=f47262f86e0b452a902fd1b1cf371706]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.458377 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6c265c771745fa8eac4b5c410b5f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.459895 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 739cadc7ad124e229441333de949f2c6 (DEFAULT_TABLE table=default.Table_360fa4c3327249579a54f68d3a81e327 [id=991ca120d90a4775a9c19d8a63092120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.460570 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739cadc7ad124e229441333de949f2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.460750 1022 tablet_service.cc:1511] Processing CreateTablet for tablet e9bed1de333b4944a9a72ae26a9f8542 (DEFAULT_TABLE table=default.Table_8e82234c43f24c1c8a1d9275a00ddad8 [id=d64836c156cb454cbc71df5254b8dae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.461063 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9bed1de333b4944a9a72ae26a9f8542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.461866 895 tablet_service.cc:1511] Processing CreateTablet for tablet e9bed1de333b4944a9a72ae26a9f8542 (DEFAULT_TABLE table=default.Table_8e82234c43f24c1c8a1d9275a00ddad8 [id=d64836c156cb454cbc71df5254b8dae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.462198 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9bed1de333b4944a9a72ae26a9f8542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.464095 759 tablet_service.cc:1511] Processing CreateTablet for tablet e9bed1de333b4944a9a72ae26a9f8542 (DEFAULT_TABLE table=default.Table_8e82234c43f24c1c8a1d9275a00ddad8 [id=d64836c156cb454cbc71df5254b8dae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.464449 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9bed1de333b4944a9a72ae26a9f8542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.465931 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 213d76d2aa1a41d5951aa093d09d9ce6 (DEFAULT_TABLE table=default.Table_3dc653e501984d0b9ab8f960d94fb7a3 [id=86d03ec198f843a1ba2caaa8608ce1e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.466207 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213d76d2aa1a41d5951aa093d09d9ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.461866 887 tablet_service.cc:1511] Processing CreateTablet for tablet 739cadc7ad124e229441333de949f2c6 (DEFAULT_TABLE table=default.Table_360fa4c3327249579a54f68d3a81e327 [id=991ca120d90a4775a9c19d8a63092120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.467989 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739cadc7ad124e229441333de949f2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.468009 745 tablet_service.cc:1511] Processing CreateTablet for tablet 739cadc7ad124e229441333de949f2c6 (DEFAULT_TABLE table=default.Table_360fa4c3327249579a54f68d3a81e327 [id=991ca120d90a4775a9c19d8a63092120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.468317 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739cadc7ad124e229441333de949f2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.473214 744 tablet_service.cc:1511] Processing CreateTablet for tablet 213d76d2aa1a41d5951aa093d09d9ce6 (DEFAULT_TABLE table=default.Table_3dc653e501984d0b9ab8f960d94fb7a3 [id=86d03ec198f843a1ba2caaa8608ce1e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.473285 895 tablet_service.cc:1511] Processing CreateTablet for tablet 213d76d2aa1a41d5951aa093d09d9ce6 (DEFAULT_TABLE table=default.Table_3dc653e501984d0b9ab8f960d94fb7a3 [id=86d03ec198f843a1ba2caaa8608ce1e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.473591 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213d76d2aa1a41d5951aa093d09d9ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.473749 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213d76d2aa1a41d5951aa093d09d9ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.478366 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (table default.Table_78c4ad680e8849b18da7d278b7ecaf51 [id=494c90461b61486ab6dad26bbd3acab5]). Expected version 1 got 0
I20260617 07:53:15.478535 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 58) took 3759 ms. Trace:
I20260617 07:53:15.478701 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:15.478663 1846 rpcz_store.cc:276] 0617 07:53:11.718965 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.719411 (+ 446us) service_pool.cc:224] Handling call
0617 07:53:15.397362 (+3677951us) ts_tablet_manager.cc:1151] Deleting tablet 82d682ae37d74b4b967da0f8e2de6301
0617 07:53:15.397370 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.402007 (+ 4637us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.423905 (+ 21898us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.478448 (+ 54543us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3667423}
I20260617 07:53:15.479279 1846 tablet_replica.cc:333] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:15.479403 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 82d682ae37d74b4b967da0f8e2de6301 (table default.Table_a4842e83c9b04eb0ba7f546b71836f8f [id=d7a60816feba47a6a4a0a7dabd878d07]) successfully deleted
I20260617 07:53:15.479571 1846 raft_consensus.cc:2243] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.479610 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 8c76bfcbd22e4bfb97346a1b56f68dab (table default.Table_3b87923865964ae78caae0e8d9231e27 [id=ed9c0eecb73c4c529138cdb71267fba1]). Expected version 1 got 0
I20260617 07:53:15.479869 1846 raft_consensus.cc:2272] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.480007 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
I20260617 07:53:15.480247 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
I20260617 07:53:15.480608 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:15.481037 1846 ts_tablet_manager.cc:1916] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.481508 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:15.483009 1862 ts_tablet_manager.cc:1916] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.483789 885 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf32132ef3e4d1e84a1befe015ad361 (DEFAULT_TABLE table=default.Table_9fe905fdfa404b8484be742e4c275d96 [id=6bb79c68f7014eb5886588b4dd37bd1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.484669 758 tablet_service.cc:1511] Processing CreateTablet for tablet 44b06e32039e4ad28924f5173035820a (DEFAULT_TABLE table=default.Table_9e0d150692fa47c5971861b6614f2b62 [id=30a4e0bd9937460582c5f9841fae2b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.484732 898 tablet_service.cc:1511] Processing CreateTablet for tablet 44b06e32039e4ad28924f5173035820a (DEFAULT_TABLE table=default.Table_9e0d150692fa47c5971861b6614f2b62 [id=30a4e0bd9937460582c5f9841fae2b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.484882 755 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf32132ef3e4d1e84a1befe015ad361 (DEFAULT_TABLE table=default.Table_9fe905fdfa404b8484be742e4c275d96 [id=6bb79c68f7014eb5886588b4dd37bd1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.485322 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 752b6cf345384750bf9b62158ae50f26 (DEFAULT_TABLE table=default.Table_e3c486f7fa954fc68ec3f00121664da5 [id=74d6ae8925c34a64ab9ade15d8fde841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.485677 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752b6cf345384750bf9b62158ae50f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.485018 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b06e32039e4ad28924f5173035820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.486599 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf32132ef3e4d1e84a1befe015ad361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.486965 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b06e32039e4ad28924f5173035820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.488456 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf32132ef3e4d1e84a1befe015ad361 (DEFAULT_TABLE table=default.Table_9fe905fdfa404b8484be742e4c275d96 [id=6bb79c68f7014eb5886588b4dd37bd1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.489090 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf32132ef3e4d1e84a1befe015ad361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.485540 748 tablet_service.cc:1511] Processing CreateTablet for tablet 843c2afd54ee451a948cc8b92c556a31 (DEFAULT_TABLE table=default.Table_1a5905f1182a42e49a2f920255c65e18 [id=d6667419b3644050bd4a7286e21f9214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.489975 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843c2afd54ee451a948cc8b92c556a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.494084 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 44b06e32039e4ad28924f5173035820a (DEFAULT_TABLE table=default.Table_9e0d150692fa47c5971861b6614f2b62 [id=30a4e0bd9937460582c5f9841fae2b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.494385 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b06e32039e4ad28924f5173035820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.497341 1170 ts_tablet_manager.cc:1929] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.497442 1170 log.cc:1199] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/66140c5d364f453a8089f143cc96ede8
I20260617 07:53:15.497759 1170 ts_tablet_manager.cc:1950] T 66140c5d364f453a8089f143cc96ede8 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.486591 887 tablet_service.cc:1511] Processing CreateTablet for tablet 752b6cf345384750bf9b62158ae50f26 (DEFAULT_TABLE table=default.Table_e3c486f7fa954fc68ec3f00121664da5 [id=74d6ae8925c34a64ab9ade15d8fde841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.485898 1178 tablet_bootstrap.cc:492] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:15.498471 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 143) took 2146 ms. Trace:
I20260617 07:53:15.498544 1170 rpcz_store.cc:276] 0617 07:53:13.351971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.352013 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:15.448474 (+2096461us) ts_tablet_manager.cc:1151] Deleting tablet 66140c5d364f453a8089f143cc96ede8
0617 07:53:15.448485 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.484438 (+ 35953us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.497300 (+ 12862us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.498455 (+ 1155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2096236}
I20260617 07:53:15.498865 1170 tablet_replica.cc:333] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.499022 1170 raft_consensus.cc:2243] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.499137 1170 raft_consensus.cc:2272] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.499585 1170 ts_tablet_manager.cc:1916] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.499895 1178 tablet_bootstrap.cc:654] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.500838 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752b6cf345384750bf9b62158ae50f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.506022 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf32132ef3e4d1e84a1befe015ad361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.506171 2277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.189:36505 every 8 connection(s)
I20260617 07:53:15.507002 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 66140c5d364f453a8089f143cc96ede8 (table default.Table_bda16d6b118048ceb24acecf1a6864ce [id=2adce07b80e24a6eaf19d88d3444701d]) successfully deleted
I20260617 07:53:15.507297 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]). Expected version 1 got 0
I20260617 07:53:15.507925 2086 raft_consensus.cc:493] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.508046 2086 raft_consensus.cc:515] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.507673 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:15.508325 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 843c2afd54ee451a948cc8b92c556a31 (DEFAULT_TABLE table=default.Table_1a5905f1182a42e49a2f920255c65e18 [id=d6667419b3644050bd4a7286e21f9214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.508654 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843c2afd54ee451a948cc8b92c556a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.508651 2086 leader_election.cc:290] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.509049 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0e12aa4c60457182201a94caecda45" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:15.509137 1027 tablet_service.cc:1511] Processing CreateTablet for tablet bc57a1e3bc8b434da43f484705476b9b (DEFAULT_TABLE table=default.Table_2a9cd90a401b43569e0065aca5940892 [id=07868985fae742ce95c082e85caa6267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.509212 1046 raft_consensus.cc:2468] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:15.509444 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc57a1e3bc8b434da43f484705476b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.509523 758 tablet_service.cc:1511] Processing CreateTablet for tablet bc57a1e3bc8b434da43f484705476b9b (DEFAULT_TABLE table=default.Table_2a9cd90a401b43569e0065aca5940892 [id=07868985fae742ce95c082e85caa6267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.509634 851 leader_election.cc:304] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:15.509840 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc57a1e3bc8b434da43f484705476b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.510224 885 tablet_service.cc:1511] Processing CreateTablet for tablet 843c2afd54ee451a948cc8b92c556a31 (DEFAULT_TABLE table=default.Table_1a5905f1182a42e49a2f920255c65e18 [id=d6667419b3644050bd4a7286e21f9214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.510591 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843c2afd54ee451a948cc8b92c556a31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.512933 2086 raft_consensus.cc:2804] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:15.513020 2086 raft_consensus.cc:493] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:15.513083 2086 raft_consensus.cc:3060] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:15.513859 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0e12aa4c60457182201a94caecda45" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:15.514950 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:15.515362 2086 raft_consensus.cc:515] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.515763 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]). Expected version 1 got 0
I20260617 07:53:15.515904 2086 leader_election.cc:290] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.516283 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ca400838f5214d1a8f57e72c5068f0f9 (table default.Table_1a37fbbe9740440a8c245559a94b7f5f [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]). Expected version 1 got 0
I20260617 07:53:15.516332 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0e12aa4c60457182201a94caecda45" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:15.516497 1046 raft_consensus.cc:3060] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:15.516909 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:15.517180 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:15.517407 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:15.517696 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
W20260617 07:53:15.517954 852 leader_election.cc:343] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.518036 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:15.518091 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0e12aa4c60457182201a94caecda45" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:15.518450 852 leader_election.cc:343] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.518497 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:15.518756 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:15.519050 460 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_8dd1d9e74c1245e1afe42a16f20e57f6 [id=3824f4c443804be49d851e39e23ce3f7] alter complete (version 3)
I20260617 07:53:15.519074 1046 raft_consensus.cc:2468] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:15.486300 760 tablet_service.cc:1511] Processing CreateTablet for tablet 752b6cf345384750bf9b62158ae50f26 (DEFAULT_TABLE table=default.Table_e3c486f7fa954fc68ec3f00121664da5 [id=74d6ae8925c34a64ab9ade15d8fde841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.519543 851 leader_election.cc:304] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:15.519840 2086 raft_consensus.cc:2804] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:15.519953 2086 raft_consensus.cc:697] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:15.520169 2086 consensus_queue.cc:237] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.520311 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 3aa1c1fdede041d28570b85e63c401b7
I20260617 07:53:15.520813 457 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 164) took 1012 ms. Trace:
I20260617 07:53:15.520953 457 rpcz_store.cc:276] 0617 07:53:14.508226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.510043 (+ 1817us) service_pool.cc:224] Handling call
0617 07:53:14.510538 (+ 495us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:14.510689 (+ 151us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:14.510758 (+ 69us) catalog_manager.cc:2849] Locking tablets
0617 07:53:14.882409 (+371651us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:14.898477 (+ 16068us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:14.898579 (+ 102us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:15.520241 (+621662us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:15.520769 (+ 528us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:14.885813 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:14.885938 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:14.885945 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:14.885948 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:14.886078 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:14.886093 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:14.886098 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:14.886210 (+ 112us) tablet.cc:701] Row locks acquired
0617 07:53:14.886214 (+ 4us) write_op.cc:260] PREPARE: finished
0617 07:53:14.886250 (+ 36us) write_op.cc:270] Start()
0617 07:53:14.886284 (+ 34us) write_op.cc:276] Timestamp: P: 1781682794886217 usec, L: 0
0617 07:53:14.886289 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 07:53:14.886473 (+ 184us) log.cc:844] Serialized 762 byte log entry
0617 07:53:14.893946 (+ 7473us) op_driver.cc:464] REPLICATION: finished
0617 07:53:14.894051 (+ 105us) write_op.cc:301] APPLY: starting
0617 07:53:14.894068 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:14.894116 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:14.894148 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:14.894218 (+ 70us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:14.894256 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:14.894263 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:14.894342 (+ 79us) log.cc:844] Serialized 29 byte log entry
0617 07:53:14.894406 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.894427 (+ 21us) write_op.cc:454] Released schema lock
0617 07:53:14.894434 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:14.894506 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:14.894511 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":44,"apply.run_cpu_time_us":450,"apply.run_wall_time_us":451,"num_ops":2,"prepare.queue_time_us":2301,"prepare.run_cpu_time_us":778,"prepare.run_wall_time_us":778,"raft.queue_time_us":373,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":200,"replication_time_us":7625}]]}
I20260617 07:53:15.521782 2125 raft_consensus.cc:493] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:15.521926 2125 raft_consensus.cc:515] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.522053 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a5077d1cb030456e91d1a015037c71fc" } modify_external_catalogs: true
I20260617 07:53:15.522264 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a5077d1cb030456e91d1a015037c71fc" } modify_external_catalogs: true
I20260617 07:53:15.522607 2125 leader_election.cc:290] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:15.523329 713 leader_election.cc:343] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: f030d59f4e124f64bb62d05f0bb0f560
I20260617 07:53:15.525837 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752b6cf345384750bf9b62158ae50f26. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.526638 716 leader_election.cc:343] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: f030d59f4e124f64bb62d05f0bb0f560
I20260617 07:53:15.526736 716 leader_election.cc:304] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:15.527125 2125 raft_consensus.cc:2749] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:15.527725 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.528502 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:15.529704 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49f0f68dcef34228a1b2a018e8aa329e consensus state has no leader
I20260617 07:53:15.530130 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8ab7027f53c74106b61571eba9efc384"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:15.530648 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ab7027f53c74106b61571eba9efc384 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:15.533203 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.533414 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.533608 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.533776 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.534056 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.534053 460 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_920f71d2a7bb466ea8426518f300ac86 [id=9726df7d693441359861876ae1179b4d] alter complete (version 4)
I20260617 07:53:15.535552 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 488cc3a082b14dee8f70153e6f2925a4
I20260617 07:53:15.535637 1856 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.189:36505
I20260617 07:53:15.536244 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_899f77e8e1154e7fb9f0983ba586ce47" } new_table_name: "default.Table_832c0052f588434faa10b821b4d09514" modify_external_catalogs: true
I20260617 07:53:15.536427 743 tablet_service.cc:1511] Processing CreateTablet for tablet ecd880890df5494f8500d623b0524e9c (DEFAULT_TABLE table=default.Table_d018eef700b3482a83212d8b4a10041e [id=dbc5752bd46a4b92a6399a02b8b9d8dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.536770 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd880890df5494f8500d623b0524e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.538463 1856 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/info.pb
I20260617 07:53:15.538676 1172 tablet_bootstrap.cc:492] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:15.538786 1172 ts_tablet_manager.cc:1403] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.136s user 0.001s sys 0.003s
I20260617 07:53:15.539295 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 4e8e9692227147d6a8c6854133941b44
I20260617 07:53:15.539418 1172 raft_consensus.cc:359] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.539556 1172 raft_consensus.cc:385] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.539597 1172 raft_consensus.cc:740] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.539927 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_665c19b8c9d14ccc9f5beb633b690e13" } modify_external_catalogs: true
I20260617 07:53:15.540102 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_665c19b8c9d14ccc9f5beb633b690e13" } modify_external_catalogs: true
W20260617 07:53:15.544703 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 361845f7627b4b9f8481b4a66bc53e9c consensus state has no leader
I20260617 07:53:15.545007 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 5578fd5cb3724ed5b92b313bd52889ad from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:15.545310 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu as pid 1856
I20260617 07:53:15.555145 1170 ts_tablet_manager.cc:1929] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.555269 1170 log.cc:1199] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/3bee4c9cd9f2415ca54b8e85dbd326a7
I20260617 07:53:15.555642 1170 ts_tablet_manager.cc:1950] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.557296 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.557492 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e8e9692227147d6a8c6854133941b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.557651 2125 raft_consensus.cc:493] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.557793 2125 raft_consensus.cc:515] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.558344 2125 leader_election.cc:290] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:15.559222 716 leader_election.cc:343] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:15.560245 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.560442 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa with delete_type TABLET_DATA_DELETED (replaced by tablet 52af94bd46c941b8a27136ca0506e744) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.560592 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.560729 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.560837 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.560953 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.561057 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.561158 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 121339ab4842432e9fb7bc357750f8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.561302 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.561467 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.561605 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.561774 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet e897b111e65c497591c7daaa81d783c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.561802 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.561936 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f9db8a986b344548e435b77edc14cb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 63bf519b83c445798bddda3120b542ce) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.562057 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.562167 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:15.563755 713 leader_election.cc:343] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:15.563887 713 leader_election.cc:304] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:15.556356 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 142) took 2204 ms. Trace:
I20260617 07:53:15.563844 1172 consensus_queue.cc:260] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.564091 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.564113 2125 raft_consensus.cc:2749] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.564345 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e8e9692227147d6a8c6854133941b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.566381 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.563997 1170 rpcz_store.cc:276] 0617 07:53:13.351853 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.352266 (+ 413us) service_pool.cc:224] Handling call
0617 07:53:15.498819 (+2146553us) ts_tablet_manager.cc:1151] Deleting tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
0617 07:53:15.498827 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.552399 (+ 53572us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.555096 (+ 2697us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.556338 (+ 1242us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2146335}
I20260617 07:53:15.566735 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 144) took 2211 ms. Trace:
I20260617 07:53:15.566815 1170 rpcz_store.cc:276] 0617 07:53:13.355303 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.355701 (+ 398us) service_pool.cc:224] Handling call
0617 07:53:15.566623 (+2210922us) ts_tablet_manager.cc:1151] Deleting tablet 8a4f81daf583464e988521e189ca39b6
0617 07:53:15.566631 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.566718 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2210755}
I20260617 07:53:15.567138 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 145) took 2211 ms. Trace:
I20260617 07:53:15.567210 1170 rpcz_store.cc:276] 0617 07:53:13.356129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.356753 (+ 624us) service_pool.cc:224] Handling call
0617 07:53:15.567043 (+2210290us) ts_tablet_manager.cc:1151] Deleting tablet 630e540a77374c11895ab5a0e394b3bb
0617 07:53:15.567051 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.567124 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2209989}
I20260617 07:53:15.567441 1172 ts_tablet_manager.cc:1434] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
I20260617 07:53:15.567788 1172 tablet_bootstrap.cc:492] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:15.567494 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 146) took 2186 ms. Trace:
I20260617 07:53:15.569743 1170 rpcz_store.cc:276] 0617 07:53:13.380980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.381032 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:15.567398 (+2186366us) ts_tablet_manager.cc:1151] Deleting tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
0617 07:53:15.567406 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.567478 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2158903}
I20260617 07:53:15.570009 1170 tablet_replica.cc:333] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.570181 1170 raft_consensus.cc:2243] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.570336 1170 raft_consensus.cc:2272] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.570847 1170 ts_tablet_manager.cc:1916] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.572933 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 (table default.Table_47a904a2ae6045519235b5988330eeff [id=a2296f2b299d464f8e70d9dce376b4a6]) successfully deleted
W20260617 07:53:15.573249 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
W20260617 07:53:15.573455 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
W20260617 07:53:15.573601 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 because the tablet was not found. No further retry: Not found: Tablet not found: 7e90ad3b80f24bc7aeb2e92ba5c84b63
I20260617 07:53:15.576052 460 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_a18dfbacf2d34929b9fd021add13fd7e [id=6a3de6cd076144ecabdfe3c5fe5498bb] alter complete (version 2)
W20260617 07:53:15.576679 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b62ae096bfd347029ef8d7f0462dd111 consensus state has no leader
I20260617 07:53:15.578675 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e8e9692227147d6a8c6854133941b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.579303 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.584087 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.584508 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.584933 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.586925 2280 sys_catalog.cc:263] Verifying existing consensus state
I20260617 07:53:15.587498 826 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:15.588824 1178 tablet_bootstrap.cc:492] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:15.588943 1178 ts_tablet_manager.cc:1403] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.193s user 0.001s sys 0.001s
I20260617 07:53:15.589567 1178 raft_consensus.cc:359] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.589751 1178 raft_consensus.cc:385] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.589805 1178 raft_consensus.cc:740] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.589998 1178 consensus_queue.cc:260] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.590471 1178 ts_tablet_manager.cc:1434] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260617 07:53:15.591109 1178 tablet_bootstrap.cc:492] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:15.591359 1170 ts_tablet_manager.cc:1929] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.592504 1178 tablet_bootstrap.cc:654] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.594417 1862 ts_tablet_manager.cc:1929] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.594529 1170 log.cc:1199] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5dcfb101cf51487692ef9a6a17f40804
I20260617 07:53:15.595762 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0cbd12d27d174b7d8addf48d4cf581b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:15.596378 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cbd12d27d174b7d8addf48d4cf581b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:15.597365 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0c3bb1ff748948298d93736f1a8583e4" } new_table_name: "default.Table_3ee4b4c000fd46a6b571c382ac2b7134" modify_external_catalogs: true
I20260617 07:53:15.597784 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 5364dfe28b8d4042941c8d8d4d1cf503
I20260617 07:53:15.598573 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ad2a6d2f10ea483bab983124a363296c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:15.599059 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad2a6d2f10ea483bab983124a363296c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:15.600123 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 68b448c65e684f49bf142ce2b5084d33
I20260617 07:53:15.600806 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3b086f032069480d951fb2ca2822d444"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:15.601302 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b086f032069480d951fb2ca2822d444 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:15.602586 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.602793 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 245cff69d83b43e98b1c72b8d3011347 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.603274 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.603305 1846 ts_tablet_manager.cc:1929] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:15.603401 1846 log.cc:1199] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/3f51c76d93674a91b5ada7821393020a
I20260617 07:53:15.603583 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.603744 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ec78c123d448329b8442a0de0140d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.603765 1846 ts_tablet_manager.cc:1950] T 3f51c76d93674a91b5ada7821393020a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:15.604022 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.604080 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 62) took 3877 ms. Trace:
I20260617 07:53:15.604146 1846 rpcz_store.cc:276] 0617 07:53:11.726230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.726893 (+ 663us) service_pool.cc:224] Handling call
0617 07:53:15.479234 (+3752341us) ts_tablet_manager.cc:1151] Deleting tablet 3f51c76d93674a91b5ada7821393020a
0617 07:53:15.479244 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.561463 (+ 82219us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.603250 (+ 41787us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.604067 (+ 817us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3748101}
I20260617 07:53:15.604293 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.604579 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.604866 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.604943 1862 log.cc:1199] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a2f21861cb6f481eae968edc733e6e6f
I20260617 07:53:15.605135 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.605273 1862 ts_tablet_manager.cc:1950] T a2f21861cb6f481eae968edc733e6e6f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:15.606034 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 86) took 3788 ms. Trace:
I20260617 07:53:15.606218 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 68b448c65e684f49bf142ce2b5084d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.606432 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.606575 1862 rpcz_store.cc:276] 0617 07:53:11.818002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.818044 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:15.405546 (+3587502us) ts_tablet_manager.cc:1151] Deleting tablet a2f21861cb6f481eae968edc733e6e6f
0617 07:53:15.405557 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.503718 (+ 98161us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.594360 (+ 90642us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.606014 (+ 11654us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3587346}
I20260617 07:53:15.607080 1862 tablet_replica.cc:333] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:15.607309 1862 raft_consensus.cc:2243] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 2 LEADER]: Raft consensus shutting down.
I20260617 07:53:15.607764 1862 raft_consensus.cc:2272] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.608116 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 74) took 3879 ms. Trace:
I20260617 07:53:15.609061 1862 ts_tablet_manager.cc:1916] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.609201 1846 rpcz_store.cc:276] 0617 07:53:11.728219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.728812 (+ 593us) service_pool.cc:224] Handling call
0617 07:53:15.607974 (+3879162us) ts_tablet_manager.cc:1151] Deleting tablet 66140c5d364f453a8089f143cc96ede8
0617 07:53:15.607986 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.608096 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3876299}
I20260617 07:53:15.609936 1846 tablet_replica.cc:333] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:15.610229 1846 raft_consensus.cc:2243] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.610571 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a2f21861cb6f481eae968edc733e6e6f (table default.Table_35ca50ee926746e499128390bf83c078 [id=12d27e43b2da42f7b55dbf5c9f4b103f]) successfully deleted
I20260617 07:53:15.611284 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 68b448c65e684f49bf142ce2b5084d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.613209 1846 raft_consensus.cc:2272] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.614826 1846 ts_tablet_manager.cc:1916] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.615717 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 3f51c76d93674a91b5ada7821393020a (table default.Table_c651ebd3c3eb4bc8a82dea4cf194f571 [id=cdace7368624415da1cd61263240f706]) successfully deleted
W20260617 07:53:15.616057 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66140c5d364f453a8089f143cc96ede8 already in progress: creating tablet
I20260617 07:53:15.616433 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.616813 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:15.620898 461 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:57237 (request call id 192) took 1730 ms (client timeout 1000 ms). Trace:
W20260617 07:53:15.621069 461 rpcz_store.cc:269] 0617 07:53:13.889991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.913465 (+ 23474us) service_pool.cc:224] Handling call
0617 07:53:15.620854 (+1707389us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212,"reported_tablets":187}
I20260617 07:53:15.622505 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 570ae1e189a64da6bad10156b401ec46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.623052 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 4681e8e3f1174b299d89ec541ca8e6b3 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:15.623951 460 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d] alter complete (version 3)
I20260617 07:53:15.624619 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 5578fd5cb3724ed5b92b313bd52889ad
I20260617 07:53:15.625211 456 catalog_manager.cc:6784] ReplaceTablet: tablet 5578fd5cb3724ed5b92b313bd52889ad deleted and replaced by tablet 01abd7aed0fd4d2b90db9f40029b5b37
W20260617 07:53:15.628048 460 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:46601 (request call id 216) took 871 ms (client timeout 1000 ms). Trace:
I20260617 07:53:15.629865 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad with delete_type TABLET_DATA_DELETED (replaced by tablet 01abd7aed0fd4d2b90db9f40029b5b37) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.629781 895 tablet_service.cc:1511] Processing CreateTablet for tablet bc57a1e3bc8b434da43f484705476b9b (DEFAULT_TABLE table=default.Table_2a9cd90a401b43569e0065aca5940892 [id=07868985fae742ce95c082e85caa6267]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:15.628786 460 rpcz_store.cc:269] 0617 07:53:14.756920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.927720 (+170800us) service_pool.cc:224] Handling call
0617 07:53:15.268764 (+341044us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.268773 (+ 9us) write_op.cc:454] Released schema lock
0617 07:53:15.290428 (+ 21655us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.290437 (+ 9us) write_op.cc:454] Released schema lock
0617 07:53:15.628016 (+337579us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:15.258551 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:15.258681 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:15.258688 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:15.258691 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:15.258879 (+ 188us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:15.258914 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:15.258923 (+ 9us) tablet.cc:685] Acquiring locks for 3 operations
0617 07:53:15.259065 (+ 142us) tablet.cc:701] Row locks acquired
0617 07:53:15.259070 (+ 5us) write_op.cc:260] PREPARE: finished
0617 07:53:15.259114 (+ 44us) write_op.cc:270] Start()
0617 07:53:15.259160 (+ 46us) write_op.cc:276] Timestamp: P: 1781682795258967 usec, L: 0
0617 07:53:15.259166 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:15.259396 (+ 230us) log.cc:844] Serialized 1293 byte log entry
0617 07:53:15.263811 (+ 4415us) op_driver.cc:464] REPLICATION: finished
0617 07:53:15.263910 (+ 99us) write_op.cc:301] APPLY: starting
0617 07:53:15.263924 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:15.264016 (+ 92us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:15.264049 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:15.264131 (+ 82us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:15.264166 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0617 07:53:15.264173 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:15.264251 (+ 78us) log.cc:844] Serialized 35 byte log entry
0617 07:53:15.264325 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.264344 (+ 19us) write_op.cc:454] Released schema lock
0617 07:53:15.264350 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0617 07:53:15.280964 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:15.281143 (+ 179us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:15.281153 (+ 10us) write_op.cc:435] Acquired schema lock
0617 07:53:15.281158 (+ 5us) tablet.cc:662] Decoding operations
0617 07:53:15.281300 (+ 142us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:15.281319 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:15.281329 (+ 10us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:15.281432 (+ 103us) tablet.cc:701] Row locks acquired
0617 07:53:15.281436 (+ 4us) write_op.cc:260] PREPARE: finished
0617 07:53:15.281479 (+ 43us) write_op.cc:270] Start()
0617 07:53:15.281522 (+ 43us) write_op.cc:276] Timestamp: P: 1781682795281329 usec, L: 0
0617 07:53:15.281528 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:15.281800 (+ 272us) log.cc:844] Serialized 356 byte log entry
0617 07:53:15.286377 (+ 4577us) op_driver.cc:464] REPLICATION: finished
0617 07:53:15.286530 (+ 153us) write_op.cc:301] APPLY: starting
0617 07:53:15.286550 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:15.286611 (+ 61us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:15.286647 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:15.286719 (+ 72us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:15.286766 (+ 47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:15.286778 (+ 12us) write_op.cc:312] APPLY: finished
0617 07:53:15.286883 (+ 105us) log.cc:844] Serialized 23 byte log entry
0617 07:53:15.286966 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.286992 (+ 26us) write_op.cc:454] Released schema lock
0617 07:53:15.287001 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0617 07:53:15.520100 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:15.520250 (+ 150us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:15.520255 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:15.520257 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:15.520384 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:15.520398 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:15.520403 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:15.520476 (+ 73us) tablet.cc:701] Row locks acquired
0617 07:53:15.520478 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:15.520513 (+ 35us) write_op.cc:270] Start()
0617 07:53:15.520545 (+ 32us) write_op.cc:276] Timestamp: P: 1781682795520343 usec, L: 0
0617 07:53:15.520548 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:15.520718 (+ 170us) log.cc:844] Serialized 356 byte log entry
0617 07:53:15.528702 (+ 7984us) op_driver.cc:464] REPLICATION: finished
0617 07:53:15.528851 (+ 149us) write_op.cc:301] APPLY: starting
0617 07:53:15.528866 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:15.528910 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:15.528951 (+ 41us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:15.529004 (+ 53us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:15.529042 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:15.529051 (+ 9us) write_op.cc:312] APPLY: finished
0617 07:53:15.529121 (+ 70us) log.cc:844] Serialized 23 byte log entry
0617 07:53:15.529191 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.529211 (+ 20us) write_op.cc:454] Released schema lock
0617 07:53:15.529217 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:15.529294 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.529299 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 07:53:15.546193 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:15.546305 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:15.546312 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:15.546315 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:15.546452 (+ 137us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:15.546465 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:15.546472 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:15.546530 (+ 58us) tablet.cc:701] Row locks acquired
0617 07:53:15.546532 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:15.546565 (+ 33us) write_op.cc:270] Start()
0617 07:53:15.546594 (+ 29us) write_op.cc:276] Timestamp: P: 1781682795546393 usec, L: 0
0617 07:53:15.546597 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:15.546735 (+ 138us) log.cc:844] Serialized 356 byte log entry
0617 07:53:15.575458 (+ 28723us) op_driver.cc:464] REPLICATION: finished
0617 07:53:15.575542 (+ 84us) write_op.cc:301] APPLY: starting
0617 07:53:15.575561 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:15.575610 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:15.575646 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:15.575695 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:15.575721 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:15.575727 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:15.575797 (+ 70us) log.cc:844] Serialized 23 byte log entry
0617 07:53:15.575874 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.575893 (+ 19us) write_op.cc:454] Released schema lock
0617 07:53:15.575901 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:15.575970 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.575974 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 07:53:15.599433 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:15.599535 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:15.599542 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:15.599546 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:15.599630 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:15.599640 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:15.599644 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:15.599697 (+ 53us) tablet.cc:701] Row locks acquired
0617 07:53:15.599699 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:15.599732 (+ 33us) write_op.cc:270] Start()
0617 07:53:15.599759 (+ 27us) write_op.cc:276] Timestamp: P: 1781682795599554 usec, L: 0
0617 07:53:15.599763 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:15.599918 (+ 155us) log.cc:844] Serialized 356 byte log entry
0617 07:53:15.623363 (+ 23445us) op_driver.cc:464] REPLICATION: finished
0617 07:53:15.623457 (+ 94us) write_op.cc:301] APPLY: starting
0617 07:53:15.623467 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:15.623511 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:15.623554 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:15.623589 (+ 35us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:15.623612 (+ 23us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:15.623618 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:15.623694 (+ 76us) log.cc:844] Serialized 23 byte log entry
0617 07:53:15.623756 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.623770 (+ 14us) write_op.cc:454] Released schema lock
0617 07:53:15.623778 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:15.623843 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.623846 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":37,"apply.run_cpu_time_us":526,"apply.run_wall_time_us":526,"num_ops":3,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":989,"prepare.run_wall_time_us":989,"raft.queue_time_us":144,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":386,"replication_time_us":4608,"spinlock_wait_cycles":98688}],["op",{"apply.queue_time_us":90,"apply.run_cpu_time_us":536,"apply.run_wall_time_us":536,"num_ops":1,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":964,"prepare.run_wall_time_us":964,"raft.queue_time_us":81,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":333,"replication_time_us":4796}],["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":434,"apply.run_wall_time_us":433,"num_ops":1,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":745,"prepare.run_wall_time_us":745,"raft.queue_time_us":4664,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":287,"replication_time_us":8122}],["op",{"apply.queue_time_us":35,"apply.run_cpu_time_us":421,"apply.run_wall_time_us":421,"num_ops":1,"prepare.queue_time_us":11200,"prepare.run_cpu_time_us":647,"prepare.run_wall_time_us":648,"raft.queue_time_us":2096,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":8,"replication_time_us":28833}],["op",{"apply.queue_time_us":56,"apply.run_cpu_time_us":376,"apply.run_wall_time_us":376,"num_ops":1,"prepare.queue_time_us":22389,"prepare.run_cpu_time_us":576,"prepare.run_wall_time_us":626,"raft.queue_time_us":32,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":23578}]]}
I20260617 07:53:15.632041 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 4996cde4d1514aa081257c802339abe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.632208 884 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.632248 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.632350 886 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.632707 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.633486 1170 ts_tablet_manager.cc:1950] T 5dcfb101cf51487692ef9a6a17f40804 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.634661 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.635689 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.635955 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.636139 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.636291 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.636442 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.636598 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 68b448c65e684f49bf142ce2b5084d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.636739 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.636868 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.636762 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9403db56c480454c99bfdbae7da6e03b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:15.637319 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9403db56c480454c99bfdbae7da6e03b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:15.637980 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 770a5216299842b890d483ca37b0ee86 consensus state has no leader
I20260617 07:53:15.638366 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_d97e42eee9e14d7ca1ec6f5caf5744e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:15.638474 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad with delete_type TABLET_DATA_DELETED (replaced by tablet 01abd7aed0fd4d2b90db9f40029b5b37) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.638844 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8c64bc25628540029359a55cc8dde053"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:15.639467 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c64bc25628540029359a55cc8dde053 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:15.640201 852 consensus_peers.cc:597] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:15.641136 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f1ff983b5f414960bb16a56ef5f1c082"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:15.641655 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1ff983b5f414960bb16a56ef5f1c082 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:15.638866 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d97e42eee9e14d7ca1ec6f5caf5744e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:15.642380 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad with delete_type TABLET_DATA_DELETED (replaced by tablet 01abd7aed0fd4d2b90db9f40029b5b37) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.642866 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a50277d75b6b4544961f33c42a936cd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:15.643441 1172 tablet_bootstrap.cc:654] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:15.643440 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a50277d75b6b4544961f33c42a936cd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:15.644574 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.644829 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8a49b4155d9145c1bf5511215596a162"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:15.645643 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a49b4155d9145c1bf5511215596a162 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:15.647869 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.648236 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 147) took 2217 ms. Trace:
I20260617 07:53:15.648355 1170 rpcz_store.cc:276] 0617 07:53:13.430628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.431542 (+ 914us) service_pool.cc:224] Handling call
0617 07:53:15.569970 (+2138428us) ts_tablet_manager.cc:1151] Deleting tablet 5dcfb101cf51487692ef9a6a17f40804
0617 07:53:15.569978 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.574184 (+ 4206us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.591301 (+ 17117us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.648208 (+ 56907us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2138202}
I20260617 07:53:15.648743 1170 tablet_replica.cc:333] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.648957 1170 raft_consensus.cc:2243] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.649158 1170 raft_consensus.cc:2272] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.649785 1170 ts_tablet_manager.cc:1916] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.653286 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 5dcfb101cf51487692ef9a6a17f40804 (table default.Table_34fb38a5ef96468bbf08872ea10e8a5f [id=01a22a92af6f4e8ba076834cad8ba182]) successfully deleted
I20260617 07:53:15.657954 1171 tablet_bootstrap.cc:492] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:15.658191 1171 ts_tablet_manager.cc:1403] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.203s user 0.002s sys 0.004s
I20260617 07:53:15.659396 1171 raft_consensus.cc:359] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.659713 1171 raft_consensus.cc:385] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.659817 1171 raft_consensus.cc:740] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.659919 1172 tablet_bootstrap.cc:492] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:15.660176 1172 ts_tablet_manager.cc:1403] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.092s user 0.001s sys 0.009s
I20260617 07:53:15.660107 1171 consensus_queue.cc:260] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.660828 2280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Bootstrap starting.
I20260617 07:53:15.660983 1172 raft_consensus.cc:359] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.661187 1172 raft_consensus.cc:385] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.661275 1172 raft_consensus.cc:740] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.661514 1172 consensus_queue.cc:260] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.665023 1172 ts_tablet_manager.cc:1434] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 07:53:15.665340 1172 tablet_bootstrap.cc:492] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:15.665961 2260 raft_consensus.cc:493] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.666087 2260 raft_consensus.cc:515] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.666741 2260 leader_election.cc:290] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:15.667336 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7611958cf143438497c93f5f2bc098" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:15.668056 986 leader_election.cc:343] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.668699 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc57a1e3bc8b434da43f484705476b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.668670 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7611958cf143438497c93f5f2bc098" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:15.668829 1172 tablet_bootstrap.cc:654] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:15.669216 988 leader_election.cc:343] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.669341 988 leader_election.cc:304] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:15.669690 2260 raft_consensus.cc:2749] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.684464 1170 ts_tablet_manager.cc:1929] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.684609 1170 log.cc:1199] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/6f2d9e473fd444efa6ab63cc51dbb2bd
I20260617 07:53:15.684896 1170 ts_tablet_manager.cc:1950] T 6f2d9e473fd444efa6ab63cc51dbb2bd P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.685101 1846 ts_tablet_manager.cc:1929] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.686501 1862 ts_tablet_manager.cc:1929] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
W20260617 07:53:15.688838 454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:57237 (request call id 191) took 2918 ms (client timeout 1000 ms). Trace:
I20260617 07:53:15.685693 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 148) took 2253 ms. Trace:
I20260617 07:53:15.687563 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.689133 1170 rpcz_store.cc:276] 0617 07:53:13.432058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.432703 (+ 645us) service_pool.cc:224] Handling call
0617 07:53:15.648680 (+2215977us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:15.648695 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.673473 (+ 24778us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.684397 (+ 10924us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.685672 (+ 1275us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2215804}
I20260617 07:53:15.688623 1172 tablet_bootstrap.cc:492] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:15.689517 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 149) took 2256 ms. Trace:
I20260617 07:53:15.689550 1172 ts_tablet_manager.cc:1403] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260617 07:53:15.689595 1170 rpcz_store.cc:276] 0617 07:53:13.433018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.433880 (+ 862us) service_pool.cc:224] Handling call
0617 07:53:15.689414 (+2255534us) ts_tablet_manager.cc:1151] Deleting tablet 0c21efcad98348ebabcee4821dc4682e
0617 07:53:15.689424 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.689500 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2255347}
I20260617 07:53:15.689951 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 150) took 2255 ms. Trace:
I20260617 07:53:15.690018 1862 log.cc:1199] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/df705c2300064db680bec1fefab08d2f
I20260617 07:53:15.690034 1170 rpcz_store.cc:276] 0617 07:53:13.434237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.434574 (+ 337us) service_pool.cc:224] Handling call
0617 07:53:15.689851 (+2255277us) ts_tablet_manager.cc:1151] Deleting tablet 2f8cd6ff8fa44536acdd84a107ab1525
0617 07:53:15.689859 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.689937 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2255130}
I20260617 07:53:15.690325 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 151) took 2255 ms. Trace:
I20260617 07:53:15.690394 1170 rpcz_store.cc:276] 0617 07:53:13.434842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.435107 (+ 265us) service_pool.cc:224] Handling call
0617 07:53:15.690236 (+2255129us) ts_tablet_manager.cc:1151] Deleting tablet e55d63a25a2845dbbcce20e560361007
0617 07:53:15.690244 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.690310 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2254968}
I20260617 07:53:15.690743 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 152) took 2255 ms. Trace:
I20260617 07:53:15.690686 1172 raft_consensus.cc:359] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.690820 1170 rpcz_store.cc:276] 0617 07:53:13.435395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.435656 (+ 261us) service_pool.cc:224] Handling call
0617 07:53:15.690583 (+2254927us) ts_tablet_manager.cc:1151] Deleting tablet 51e757e6f4ce4c6eb8223c4b6955245e
0617 07:53:15.690591 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.690729 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2254780}
I20260617 07:53:15.691118 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 153) took 2255 ms. Trace:
I20260617 07:53:15.690917 1172 raft_consensus.cc:385] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.691190 1170 rpcz_store.cc:276] 0617 07:53:13.435939 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.436680 (+ 741us) service_pool.cc:224] Handling call
0617 07:53:15.691044 (+2254364us) ts_tablet_manager.cc:1151] Deleting tablet 89783bab2e584fe9a8eda963f78bf3ec
0617 07:53:15.691052 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.691103 (+ 51us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2254186}
I20260617 07:53:15.691286 1172 raft_consensus.cc:740] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.691439 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 154) took 2254 ms. Trace:
I20260617 07:53:15.691506 1170 rpcz_store.cc:276] 0617 07:53:13.437230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.438449 (+ 1219us) service_pool.cc:224] Handling call
0617 07:53:15.691376 (+2252927us) ts_tablet_manager.cc:1151] Deleting tablet be14a95f458d440e86133ef65c484571
0617 07:53:15.691384 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.691428 (+ 44us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2252770}
I20260617 07:53:15.691751 1172 consensus_queue.cc:260] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.691900 1862 ts_tablet_manager.cc:1950] T df705c2300064db680bec1fefab08d2f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:15.692492 1172 ts_tablet_manager.cc:1434] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:15.692796 1172 tablet_bootstrap.cc:492] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:15.693547 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 87) took 3875 ms. Trace:
I20260617 07:53:15.694509 1846 log.cc:1199] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/cc84665c7849469aa27e6505dbed1516
I20260617 07:53:15.694747 1862 rpcz_store.cc:276] 0617 07:53:11.818321 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.820776 (+ 2455us) service_pool.cc:224] Handling call
0617 07:53:15.607033 (+3786257us) ts_tablet_manager.cc:1151] Deleting tablet df705c2300064db680bec1fefab08d2f
0617 07:53:15.607043 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.666949 (+ 59906us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.686430 (+ 19481us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.693528 (+ 7098us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3786039}
I20260617 07:53:15.695472 1846 ts_tablet_manager.cc:1950] T cc84665c7849469aa27e6505dbed1516 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:15.694272 1171 ts_tablet_manager.cc:1434] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.036s user 0.000s sys 0.001s
I20260617 07:53:15.696341 1171 tablet_bootstrap.cc:492] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:15.691761 1170 tablet_replica.cc:333] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.698015 1170 raft_consensus.cc:2243] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.698155 1170 raft_consensus.cc:2272] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.698433 1171 tablet_bootstrap.cc:654] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.698633 1170 ts_tablet_manager.cc:1916] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.698575 2201 consensus_queue.cc:1048] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:15.700215 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 72) took 3972 ms. Trace:
I20260617 07:53:15.700464 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 88) took 3879 ms. Trace:
I20260617 07:53:15.700781 1862 rpcz_store.cc:276] 0617 07:53:11.821158 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.821198 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:15.699657 (+3878459us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:15.699668 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.700432 (+ 764us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3878309}
I20260617 07:53:15.705875 1846 rpcz_store.cc:276] 0617 07:53:11.728010 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.728772 (+ 762us) service_pool.cc:224] Handling call
0617 07:53:15.609884 (+3881112us) ts_tablet_manager.cc:1151] Deleting tablet cc84665c7849469aa27e6505dbed1516
0617 07:53:15.609896 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.665734 (+ 55838us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.685042 (+ 19308us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.700194 (+ 15152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3877606}
I20260617 07:53:15.706724 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 89) took 3885 ms. Trace:
I20260617 07:53:15.707782 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 75) took 3979 ms. Trace:
I20260617 07:53:15.708017 1862 rpcz_store.cc:276] 0617 07:53:11.821461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.821500 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:15.706595 (+3885095us) ts_tablet_manager.cc:1151] Deleting tablet d03d6dc473fc4be1a436fd71a06f403e
0617 07:53:15.706606 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.706706 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3884919}
I20260617 07:53:15.709951 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 90) took 3888 ms. Trace:
I20260617 07:53:15.710227 1846 rpcz_store.cc:276] 0617 07:53:11.728304 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.728830 (+ 526us) service_pool.cc:224] Handling call
0617 07:53:15.707633 (+3978803us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:15.707647 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.707763 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3975131}
I20260617 07:53:15.711045 1846 tablet_replica.cc:333] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:15.711163 1862 rpcz_store.cc:276] 0617 07:53:11.821805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.821841 (+ 36us) service_pool.cc:224] Handling call
0617 07:53:15.709829 (+3887988us) ts_tablet_manager.cc:1151] Deleting tablet 3ae9261c0ac94defaecfc7d14ba1ae61
0617 07:53:15.709840 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.709934 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3887796}
I20260617 07:53:15.711850 1846 raft_consensus.cc:2243] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:15.712507 1862 tablet_replica.cc:333] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:15.713034 1846 pending_rounds.cc:70] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: Trying to abort 1 pending ops.
I20260617 07:53:15.713275 1862 raft_consensus.cc:2243] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:15.711607 1171 tablet_bootstrap.cc:492] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:15.715824 1171 ts_tablet_manager.cc:1403] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260617 07:53:15.716550 1171 raft_consensus.cc:359] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.716848 1846 pending_rounds.cc:77] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772715167014912 op_type: NO_OP noop_request { }
I20260617 07:53:15.717139 1846 raft_consensus.cc:2889] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:15.717336 1846 raft_consensus.cc:2272] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.718236 1846 ts_tablet_manager.cc:1916] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.718413 1171 raft_consensus.cc:385] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.718622 1171 raft_consensus.cc:740] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.713860 1862 raft_consensus.cc:2272] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.719326 1862 ts_tablet_manager.cc:1916] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.719583 1171 consensus_queue.cc:260] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.721197 1172 tablet_bootstrap.cc:654] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.721596 1171 ts_tablet_manager.cc:1434] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 07:53:15.725350 1170 ts_tablet_manager.cc:1929] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.725481 1170 log.cc:1199] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/84f498f551ff4767bd16628b03f55ae2
I20260617 07:53:15.725858 1170 ts_tablet_manager.cc:1950] T 84f498f551ff4767bd16628b03f55ae2 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.726608 1171 tablet_bootstrap.cc:492] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:15.726773 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 155) took 2288 ms. Trace:
I20260617 07:53:15.726877 1170 rpcz_store.cc:276] 0617 07:53:13.438774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.439049 (+ 275us) service_pool.cc:224] Handling call
0617 07:53:15.691725 (+2252676us) ts_tablet_manager.cc:1151] Deleting tablet 84f498f551ff4767bd16628b03f55ae2
0617 07:53:15.691732 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.709686 (+ 17954us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.725282 (+ 15596us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.726748 (+ 1466us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2252507}
I20260617 07:53:15.727300 1170 tablet_replica.cc:333] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.730649 1172 tablet_bootstrap.cc:492] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:15.730821 1172 ts_tablet_manager.cc:1403] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20260617 07:53:15.732537 1172 raft_consensus.cc:359] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.733006 1172 raft_consensus.cc:385] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.733194 1172 raft_consensus.cc:740] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.733505 1172 consensus_queue.cc:260] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.734295 1172 ts_tablet_manager.cc:1434] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 07:53:15.735069 1172 tablet_bootstrap.cc:492] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:15.742553 1170 raft_consensus.cc:2243] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.743036 1171 tablet_bootstrap.cc:654] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.743539 1170 raft_consensus.cc:2272] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.743266 1172 tablet_bootstrap.cc:654] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.744601 1170 ts_tablet_manager.cc:1916] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.749910 1172 tablet_bootstrap.cc:492] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:15.750525 1172 ts_tablet_manager.cc:1403] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260617 07:53:15.751338 1172 raft_consensus.cc:359] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.757059 1172 raft_consensus.cc:385] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.757054 1846 ts_tablet_manager.cc:1929] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:15.757166 1846 log.cc:1199] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d80c2ffcf1b84df0bc6a468ea0929e80
I20260617 07:53:15.757354 1172 raft_consensus.cc:740] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.757565 1846 ts_tablet_manager.cc:1950] T d80c2ffcf1b84df0bc6a468ea0929e80 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:15.757814 1172 consensus_queue.cc:260] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.757927 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 69) took 4030 ms. Trace:
I20260617 07:53:15.758003 1846 rpcz_store.cc:276] 0617 07:53:11.727681 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.728712 (+ 1031us) service_pool.cc:224] Handling call
0617 07:53:15.710998 (+3982286us) ts_tablet_manager.cc:1151] Deleting tablet d80c2ffcf1b84df0bc6a468ea0929e80
0617 07:53:15.711009 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.735158 (+ 24149us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.756984 (+ 21826us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.757912 (+ 928us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3973759}
I20260617 07:53:15.758280 1862 ts_tablet_manager.cc:1929] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:15.758553 1862 log.cc:1199] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/ab8388648475499db50cc16a7c36775a
I20260617 07:53:15.758913 2305 tablet.cc:1724] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:15.689630 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 6f2d9e473fd444efa6ab63cc51dbb2bd (table default.Table_378c24318c924a5e8dcfb5295dc43493 [id=daa30b155c944cb098436474cfd8321c]) successfully deleted
I20260617 07:53:15.696139 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet df705c2300064db680bec1fefab08d2f (table default.Table_5d59656f1cf74e4dbea879fb08583021 [id=e6636bb52b0b42028b8a92ebeee0a41d]) successfully deleted
W20260617 07:53:15.710963 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bbc3d13d519843a9bc38e97dc85b67c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbc3d13d519843a9bc38e97dc85b67c8 already in progress: creating tablet
W20260617 07:53:15.765978 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 55016.3us
I20260617 07:53:15.721491 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 18f9bace06e34602acc7fcd7501b3671 from {username='slave'} at 127.0.0.1:33390
W20260617 07:53:15.766562 454 rpcz_store.cc:269] 0617 07:53:12.770019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.770078 (+ 59us) service_pool.cc:224] Handling call
0617 07:53:15.688768 (+2918690us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":295593,"reported_tablets":184,"spinlock_wait_cycles":768}
I20260617 07:53:15.722028 455 master_service.cc:960] ReplaceTablet: received request to replace tablet ed9a99cdcbb74a3fb74654a26716a1c9 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:15.767236 760 tablet_service.cc:1511] Processing CreateTablet for tablet 56e089af99464471b4d5482c3364d20f (DEFAULT_TABLE table=default.Table_92b0d73b0ca04fd4bfb2980b6975bded [id=2bbb1b1be1b343e38b929eba3a4dc143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.767683 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56e089af99464471b4d5482c3364d20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.722584 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 8c76bfcbd22e4bfb97346a1b56f68dab from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:15.739763 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_bd0db0a6290342548196f468ee98943f" } new_table_name: "default.Table_0e7fa8cb8a9b49cb8ec27a4eef4a7d39" modify_external_catalogs: true
W20260617 07:53:15.765936 445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 76279.1us
I20260617 07:53:15.770191 743 tablet_service.cc:1511] Processing CreateTablet for tablet a84c7a425c4e4bc0acd412f16cf2fa01 (DEFAULT_TABLE table=default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.770521 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c7a425c4e4bc0acd412f16cf2fa01. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.770493 448 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 69778.7us
W20260617 07:53:15.771454 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0c21efcad98348ebabcee4821dc4682e because the tablet was not found. No further retry: Not found: Tablet not found: 0c21efcad98348ebabcee4821dc4682e
W20260617 07:53:15.771692 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
W20260617 07:53:15.771900 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e757e6f4ce4c6eb8223c4b6955245e already in progress: creating tablet
W20260617 07:53:15.772073 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 89783bab2e584fe9a8eda963f78bf3ec because the tablet was not found. No further retry: Not found: Tablet not found: 89783bab2e584fe9a8eda963f78bf3ec
W20260617 07:53:15.772279 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a02dbb70eec84932917ef282fdae0bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a02dbb70eec84932917ef282fdae0bd7 already in progress: creating tablet
W20260617 07:53:15.772490 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d03d6dc473fc4be1a436fd71a06f403e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d03d6dc473fc4be1a436fd71a06f403e already in progress: creating tablet
W20260617 07:53:15.772670 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae9261c0ac94defaecfc7d14ba1ae61 already in progress: creating tablet
I20260617 07:53:15.773182 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_de275810487f4911a911f2d6e00a8963" } modify_external_catalogs: true
I20260617 07:53:15.773368 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_de275810487f4911a911f2d6e00a8963" } modify_external_catalogs: true
I20260617 07:53:15.774008 755 tablet_service.cc:1511] Processing CreateTablet for tablet 2ffa87a4304b43a89be0faa3c5ce0b2c (DEFAULT_TABLE table=default.Table_5df0947db0104ef6bb9e41fdb647e50c [id=23529b3c51f04f7093273ea0c6802bd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.740152 456 catalog_manager.cc:5696] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:15.774343 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ffa87a4304b43a89be0faa3c5ce0b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.774340 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:15.774643 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:15.774827 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:15.774803 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 56e089af99464471b4d5482c3364d20f (DEFAULT_TABLE table=default.Table_92b0d73b0ca04fd4bfb2980b6975bded [id=2bbb1b1be1b343e38b929eba3a4dc143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.775169 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56e089af99464471b4d5482c3364d20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.775136 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:15.775417 456 catalog_manager.cc:5696] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:15.775781 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:15.775981 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:15.777957 744 tablet_service.cc:1511] Processing CreateTablet for tablet cdb1b67f4cb7463b98a63ec75d38890f (DEFAULT_TABLE table=default.Table_254698a40b82484f8ed8c47e68fb0b68 [id=a7b56d13c4944469995d657261551a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.778013 1022 tablet_service.cc:1511] Processing CreateTablet for tablet a84c7a425c4e4bc0acd412f16cf2fa01 (DEFAULT_TABLE table=default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.778290 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb1b67f4cb7463b98a63ec75d38890f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.778388 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c7a425c4e4bc0acd412f16cf2fa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.781989 1028 tablet_service.cc:1511] Processing CreateTablet for tablet cdb1b67f4cb7463b98a63ec75d38890f (DEFAULT_TABLE table=default.Table_254698a40b82484f8ed8c47e68fb0b68 [id=a7b56d13c4944469995d657261551a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.782024 745 tablet_service.cc:1511] Processing CreateTablet for tablet fdb6343fd18b430885981140139078f7 (DEFAULT_TABLE table=default.Table_d8060f340cdb46ecb14589d645903439 [id=c98aa1c0c29248d1ae8c120be8dc051c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.782367 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb6343fd18b430885981140139078f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.784788 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ad19666d956d43a7979b4226f9645fef" } new_table_name: "default.Table_5238d7f8a8b649df9298e622257465f5" modify_external_catalogs: true
I20260617 07:53:15.785395 2011 raft_consensus.cc:493] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:15.785513 2011 raft_consensus.cc:515] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.786103 2260 raft_consensus.cc:493] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.786217 2260 raft_consensus.cc:515] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.786280 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2ffa87a4304b43a89be0faa3c5ce0b2c (DEFAULT_TABLE table=default.Table_5df0947db0104ef6bb9e41fdb647e50c [id=23529b3c51f04f7093273ea0c6802bd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.786375 2011 leader_election.cc:290] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.786535 2306 tablet.cc:1724] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:15.786810 2260 leader_election.cc:290] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:15.787375 716 leader_election.cc:343] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 0c21efcad98348ebabcee4821dc4682e
I20260617 07:53:15.787534 894 tablet_service.cc:1511] Processing CreateTablet for tablet 2ffa87a4304b43a89be0faa3c5ce0b2c (DEFAULT_TABLE table=default.Table_5df0947db0104ef6bb9e41fdb647e50c [id=23529b3c51f04f7093273ea0c6802bd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.787696 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c8ddac0c747f6b44926f982233ea9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:15.787900 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ffa87a4304b43a89be0faa3c5ce0b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.788014 827 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:15.788120 886 tablet_service.cc:1511] Processing CreateTablet for tablet cdb1b67f4cb7463b98a63ec75d38890f (DEFAULT_TABLE table=default.Table_254698a40b82484f8ed8c47e68fb0b68 [id=a7b56d13c4944469995d657261551a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.788414 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb1b67f4cb7463b98a63ec75d38890f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.790434 986 leader_election.cc:343] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.791749 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c8ddac0c747f6b44926f982233ea9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:15.792053 2087 raft_consensus.cc:493] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.792210 2087 raft_consensus.cc:515] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.792850 2087 leader_election.cc:290] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.793323 895 tablet_service.cc:1511] Processing CreateTablet for tablet 56e089af99464471b4d5482c3364d20f (DEFAULT_TABLE table=default.Table_92b0d73b0ca04fd4bfb2980b6975bded [id=2bbb1b1be1b343e38b929eba3a4dc143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.793556 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcfb101cf51487692ef9a6a17f40804" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:15.793644 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56e089af99464471b4d5482c3364d20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.794380 898 tablet_service.cc:1511] Processing CreateTablet for tablet a84c7a425c4e4bc0acd412f16cf2fa01 (DEFAULT_TABLE table=default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.794700 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c7a425c4e4bc0acd412f16cf2fa01. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.796851 988 leader_election.cc:343] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.796962 988 leader_election.cc:304] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:15.797528 852 leader_election.cc:343] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.797667 1172 ts_tablet_manager.cc:1434] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20260617 07:53:15.797770 2260 raft_consensus.cc:2749] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:15.797989 851 leader_election.cc:343] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 5dcfb101cf51487692ef9a6a17f40804
I20260617 07:53:15.798080 851 leader_election.cc:304] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:15.798473 1987 raft_consensus.cc:2749] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.805606 1172 tablet_bootstrap.cc:492] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:15.772276 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet be14a95f458d440e86133ef65c484571 because the tablet was not found. No further retry: Not found: Tablet not found: be14a95f458d440e86133ef65c484571
I20260617 07:53:15.805925 827 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:15.806071 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 84f498f551ff4767bd16628b03f55ae2 (table default.Table_187d6ce1f72947bead15cb026aa308cb [id=288a2e361ab149dca98dd515225f0ad7]) successfully deleted
I20260617 07:53:15.807574 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb1b67f4cb7463b98a63ec75d38890f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.807757 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ffa87a4304b43a89be0faa3c5ce0b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.807875 1172 tablet_bootstrap.cc:654] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.824415 2305 tablet.cc:1724] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:15.829931 2229 tablet.cc:1724] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:15.833245 1178 tablet_bootstrap.cc:492] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:15.833544 1178 ts_tablet_manager.cc:1403] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.243s user 0.000s sys 0.018s
I20260617 07:53:15.834843 1178 raft_consensus.cc:359] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.835090 1178 raft_consensus.cc:385] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.835173 1178 raft_consensus.cc:740] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.835409 1178 consensus_queue.cc:260] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.836017 1178 ts_tablet_manager.cc:1434] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:15.836290 1178 tablet_bootstrap.cc:492] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:15.840072 1172 tablet_bootstrap.cc:492] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:15.840273 1172 ts_tablet_manager.cc:1403] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.003s
I20260617 07:53:15.841216 1172 raft_consensus.cc:359] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.841570 1172 raft_consensus.cc:385] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.841683 1172 raft_consensus.cc:740] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.842159 1172 consensus_queue.cc:260] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.844239 1172 ts_tablet_manager.cc:1434] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 07:53:15.844928 1178 tablet_bootstrap.cc:654] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.845690 2201 consensus_queue.cc:1048] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:15.846207 1171 tablet_bootstrap.cc:492] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:15.846350 1171 ts_tablet_manager.cc:1403] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.120s user 0.003s sys 0.001s
I20260617 07:53:15.847064 1171 raft_consensus.cc:359] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.847276 1171 raft_consensus.cc:385] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.847365 1171 raft_consensus.cc:740] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.847637 1171 consensus_queue.cc:260] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.848127 1171 ts_tablet_manager.cc:1434] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:15.848593 1171 tablet_bootstrap.cc:492] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:15.850646 852 consensus_peers.cc:597] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:15.851310 713 leader_election.cc:343] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 0c21efcad98348ebabcee4821dc4682e
I20260617 07:53:15.851445 713 leader_election.cc:304] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:15.851662 2125 raft_consensus.cc:2749] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:15.857540 2305 tablet.cc:1724] T 9b2af44d9ab34e4bbea24d6c7d95748b P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:15.860206 1170 ts_tablet_manager.cc:1929] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.860337 1170 log.cc:1199] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/7f7611958cf143438497c93f5f2bc098
I20260617 07:53:15.860636 1170 ts_tablet_manager.cc:1950] T 7f7611958cf143438497c93f5f2bc098 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:15.860942 1862 ts_tablet_manager.cc:1950] T ab8388648475499db50cc16a7c36775a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:15.861372 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 91) took 4039 ms. Trace:
I20260617 07:53:15.861521 1862 rpcz_store.cc:276] 0617 07:53:11.822150 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.822191 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:15.712456 (+3890265us) ts_tablet_manager.cc:1151] Deleting tablet ab8388648475499db50cc16a7c36775a
0617 07:53:15.712467 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.732794 (+ 20327us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.756102 (+ 23308us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.861355 (+105253us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3890051}
I20260617 07:53:15.862253 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 92) took 4039 ms. Trace:
I20260617 07:53:15.862396 1862 rpcz_store.cc:276] 0617 07:53:11.822529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.822570 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:15.862131 (+4039561us) ts_tablet_manager.cc:1151] Deleting tablet 98f7c3f6260c4db690de1a5081bb2493
0617 07:53:15.862141 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.862237 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4039397}
I20260617 07:53:15.862962 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 93) took 4040 ms. Trace:
I20260617 07:53:15.863999 2306 tablet.cc:1724] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:15.864569 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet ab8388648475499db50cc16a7c36775a (table default.Table_49b1276fd8f846b19cac293aa9f64723 [id=cd79fc14ef8c46309788c945c6267661]) successfully deleted
W20260617 07:53:15.864879 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
I20260617 07:53:15.860046 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2e6883490743451e895cee827dd61401" } modify_external_catalogs: true
I20260617 07:53:15.867959 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2e6883490743451e895cee827dd61401" } modify_external_catalogs: true
I20260617 07:53:15.870025 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d80c2ffcf1b84df0bc6a468ea0929e80 (table default.Table_5b5a4062a59c4b3f811cc1d4441fd030 [id=f40e523aa8e943dbb46cd015d28c4c6b]) successfully deleted
I20260617 07:53:15.870102 1846 tablet_replica.cc:333] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:15.870302 1846 raft_consensus.cc:2243] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:15.870376 2260 raft_consensus.cc:493] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.870493 2260 raft_consensus.cc:515] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.870615 1846 pending_rounds.cc:70] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: Trying to abort 1 pending ops.
I20260617 07:53:15.870656 1846 pending_rounds.cc:77] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772718257180672 op_type: NO_OP noop_request { }
I20260617 07:53:15.870743 1846 raft_consensus.cc:2889] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:15.870814 1846 raft_consensus.cc:2272] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.871039 2260 leader_election.cc:290] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:15.871363 1846 ts_tablet_manager.cc:1916] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.872008 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e4068fdcbb41de966bcc72a4d1d426" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:15.866885 1171 tablet_bootstrap.cc:654] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.872208 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e4068fdcbb41de966bcc72a4d1d426" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:15.872642 1862 rpcz_store.cc:276] 0617 07:53:11.822850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.822890 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:15.862848 (+4039958us) ts_tablet_manager.cc:1151] Deleting tablet 3fcf87953dc14bf190ac74101547e52f
0617 07:53:15.862857 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.862944 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4039758}
W20260617 07:53:15.872900 986 leader_election.cc:343] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:15.873275 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3fcf87953dc14bf190ac74101547e52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcf87953dc14bf190ac74101547e52f already in progress: creating tablet
I20260617 07:53:15.873868 2201 raft_consensus.cc:493] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.874039 2201 raft_consensus.cc:515] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.874706 2201 leader_election.cc:290] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.875077 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464cf1effff241608f4a7255f2646b04" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:15.875665 988 leader_election.cc:343] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:15.875782 852 leader_election.cc:343] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.875811 988 leader_election.cc:304] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:15.876118 2260 raft_consensus.cc:2749] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.876142 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 94) took 4052 ms. Trace:
I20260617 07:53:15.876222 1862 rpcz_store.cc:276] 0617 07:53:11.828029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.828097 (+ 68us) service_pool.cc:224] Handling call
0617 07:53:15.874519 (+4046422us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:15.874530 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.876122 (+ 1592us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4046151}
W20260617 07:53:15.876602 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet bbc3d13d519843a9bc38e97dc85b67c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbc3d13d519843a9bc38e97dc85b67c8 already in progress: creating tablet
I20260617 07:53:15.877328 1862 tablet_replica.cc:333] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:15.877553 1862 raft_consensus.cc:2243] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:15.877985 1862 raft_consensus.cc:2272] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.878587 1171 tablet_bootstrap.cc:492] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:15.878836 1171 ts_tablet_manager.cc:1403] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260617 07:53:15.879655 1171 raft_consensus.cc:359] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.879904 1171 raft_consensus.cc:385] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:15.880012 1171 raft_consensus.cc:740] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:15.878605 1862 ts_tablet_manager.cc:1916] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.880523 2306 tablet.cc:1724] T 9b2af44d9ab34e4bbea24d6c7d95748b P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 07:53:15.882921 851 consensus_peers.cc:597] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de030009192748118b388eec555d90da. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:15.883371 1171 consensus_queue.cc:260] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.884286 1171 ts_tablet_manager.cc:1434] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 07:53:15.884446 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464cf1effff241608f4a7255f2646b04" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:15.884721 1171 tablet_bootstrap.cc:492] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:15.884738 1046 raft_consensus.cc:2468] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:15.885214 851 leader_election.cc:304] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:15.885649 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 156) took 2446 ms. Trace:
I20260617 07:53:15.885694 2086 raft_consensus.cc:2804] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:15.885890 2086 raft_consensus.cc:493] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:15.885797 1170 rpcz_store.cc:276] 0617 07:53:13.439338 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.439970 (+ 632us) service_pool.cc:224] Handling call
0617 07:53:15.727243 (+2287273us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:15.727256 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.747556 (+ 20300us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.860149 (+112593us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.885629 (+ 25480us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2287081}
I20260617 07:53:15.886324 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 7f7611958cf143438497c93f5f2bc098 (table default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]) successfully deleted
I20260617 07:53:15.886133 2086 raft_consensus.cc:3060] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:15.886402 965 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:15.887964 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 157) took 2447 ms. Trace:
I20260617 07:53:15.890316 2086 raft_consensus.cc:515] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.890355 1028 tablet_service.cc:1511] Processing CreateTablet for tablet fdb6343fd18b430885981140139078f7 (DEFAULT_TABLE table=default.Table_d8060f340cdb46ecb14589d645903439 [id=c98aa1c0c29248d1ae8c120be8dc051c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.891036 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb6343fd18b430885981140139078f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.891100 2260 raft_consensus.cc:493] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.891234 2260 raft_consensus.cc:515] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.891817 2260 leader_election.cc:290] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:15.892930 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956eefc9ac3147bb857a448563c6fb6f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:15.893500 986 leader_election.cc:343] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.894938 887 tablet_service.cc:1511] Processing CreateTablet for tablet fdb6343fd18b430885981140139078f7 (DEFAULT_TABLE table=default.Table_d8060f340cdb46ecb14589d645903439 [id=c98aa1c0c29248d1ae8c120be8dc051c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.894996 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956eefc9ac3147bb857a448563c6fb6f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:15.895448 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb6343fd18b430885981140139078f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:15.895591 988 leader_election.cc:343] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.895715 988 leader_election.cc:304] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:15.895931 2260 raft_consensus.cc:2749] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:15.897464 1170 rpcz_store.cc:276] 0617 07:53:13.440349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.441352 (+ 1003us) service_pool.cc:224] Handling call
0617 07:53:15.887797 (+2446445us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:15.887807 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.887944 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2446251}
W20260617 07:53:15.898025 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65bf5384ec244d36ba3d4e781c5eb8a3 already in progress: creating tablet
I20260617 07:53:15.898779 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 159) took 2456 ms. Trace:
I20260617 07:53:15.899204 1170 rpcz_store.cc:276] 0617 07:53:13.442269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.442529 (+ 260us) service_pool.cc:224] Handling call
0617 07:53:15.898684 (+2456155us) ts_tablet_manager.cc:1151] Deleting tablet 5a547dabaeb742ba941690f4895955bd
0617 07:53:15.898694 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.898762 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2455994}
W20260617 07:53:15.901546 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5a547dabaeb742ba941690f4895955bd because the tablet was not found. No further retry: Not found: Tablet not found: 5a547dabaeb742ba941690f4895955bd
I20260617 07:53:15.902046 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 160) took 2459 ms. Trace:
I20260617 07:53:15.904238 1987 raft_consensus.cc:493] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:15.904357 1987 raft_consensus.cc:515] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.904902 1987 leader_election.cc:290] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.905895 1170 rpcz_store.cc:276] 0617 07:53:13.442853 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.443142 (+ 289us) service_pool.cc:224] Handling call
0617 07:53:15.901954 (+2458812us) ts_tablet_manager.cc:1151] Deleting tablet 9cddb9e82c354f26b3abe56ebdefd008
0617 07:53:15.901964 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.902029 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2458642}
I20260617 07:53:15.909446 1862 ts_tablet_manager.cc:1929] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 07:53:15.910130 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 9cddb9e82c354f26b3abe56ebdefd008 because the tablet was not found. No further retry: Not found: Tablet not found: 9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:15.910302 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ba8963530d49a89fe4eb626225377d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:15.910537 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 161) took 2467 ms. Trace:
I20260617 07:53:15.910574 1046 raft_consensus.cc:2468] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:15.913765 1862 log.cc:1199] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/f2ce51c155c04897a4cf8f7b4ac9a5c6
I20260617 07:53:15.914201 1862 ts_tablet_manager.cc:1950] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:15.914549 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 95) took 4086 ms. Trace:
I20260617 07:53:15.914674 1862 rpcz_store.cc:276] 0617 07:53:11.828545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.828595 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:15.877276 (+4048681us) ts_tablet_manager.cc:1151] Deleting tablet f2ce51c155c04897a4cf8f7b4ac9a5c6
0617 07:53:15.877285 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.886005 (+ 8720us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.909388 (+ 23383us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.914534 (+ 5146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4048427}
I20260617 07:53:15.915184 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3d88113729482494d131ad4988ddca (DEFAULT_TABLE table=default.Table_94fefeabbc244e55a4ebb57d7e80f0ed [id=6c4de97e57d146bf9c00d8a8a400b093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.915325 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 96) took 4086 ms. Trace:
I20260617 07:53:15.915448 1862 rpcz_store.cc:276] 0617 07:53:11.829056 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.829104 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:15.915201 (+4086097us) ts_tablet_manager.cc:1151] Deleting tablet 0fd8cedb539748dc917128511325bbcc
0617 07:53:15.915214 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.915307 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4085700}
I20260617 07:53:15.915730 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3d88113729482494d131ad4988ddca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.915833 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 97) took 4086 ms. Trace:
I20260617 07:53:15.915934 1862 rpcz_store.cc:276] 0617 07:53:11.829508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.829554 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:15.915726 (+4086172us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:15.915735 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.915817 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4085941}
I20260617 07:53:15.916241 1862 tablet_replica.cc:333] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:15.916481 1862 raft_consensus.cc:2243] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.916659 1862 raft_consensus.cc:2272] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:15.917193 1862 ts_tablet_manager.cc:1916] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:15.918853 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 (table default.Table_bbc95ce139d8435387c7952fa8812d3b [id=7a019b84bca74a3cbd26a8fe985488ff]) successfully deleted
W20260617 07:53:15.919165 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0fd8cedb539748dc917128511325bbcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd8cedb539748dc917128511325bbcc already in progress: creating tablet
W20260617 07:53:15.919402 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e9488e8a501e404f85540fb045d8916f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9488e8a501e404f85540fb045d8916f already in progress: creating tablet
I20260617 07:53:15.920102 898 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3d88113729482494d131ad4988ddca (DEFAULT_TABLE table=default.Table_94fefeabbc244e55a4ebb57d7e80f0ed [id=6c4de97e57d146bf9c00d8a8a400b093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.921896 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d657fbccb4af40558033a971aab7f3e4
I20260617 07:53:15.922041 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 4681e8e3f1174b299d89ec541ca8e6b3
I20260617 07:53:15.922448 461 catalog_manager.cc:6784] ReplaceTablet: tablet 4681e8e3f1174b299d89ec541ca8e6b3 deleted and replaced by tablet 531ccdf479814053b468a7d5802f5dde
I20260617 07:53:15.922571 461 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:33390 (request call id 192) took 1079 ms. Trace:
I20260617 07:53:15.922673 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb" } modify_external_catalogs: true
I20260617 07:53:15.923156 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb" } modify_external_catalogs: true
W20260617 07:53:15.923431 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24066965db7141a6a970ec08f835a820 consensus state has no leader
I20260617 07:53:15.923627 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 531ccdf479814053b468a7d5802f5dde) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.923780 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_7ef78d5066e74ed18eb032a94d98e708" } new_table_name: "default.Table_359c79d8b2804b5cb22c337bbf01b0e3" modify_external_catalogs: true
I20260617 07:53:15.924285 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet d657fbccb4af40558033a971aab7f3e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.924815 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3d88113729482494d131ad4988ddca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.924969 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 8c76bfcbd22e4bfb97346a1b56f68dab
I20260617 07:53:15.925453 457 catalog_manager.cc:6784] ReplaceTablet: tablet 8c76bfcbd22e4bfb97346a1b56f68dab deleted and replaced by tablet 7d5bd47736774ba9a05426b46a057e80
I20260617 07:53:15.925741 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2d9822f4cc9f41dbbbe65fe0b30fc2a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:15.926055 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c76bfcbd22e4bfb97346a1b56f68dab with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5bd47736774ba9a05426b46a057e80) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:15.926205 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d9822f4cc9f41dbbbe65fe0b30fc2a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:15.927279 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 979087485af94e159d3d0f2cb873899e consensus state has no leader
I20260617 07:53:15.927587 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9403db56c480454c99bfdbae7da6e03b" } new_table_name: "default.Table_02ab5db216a449ff8e508fcc459791ae" modify_external_catalogs: true
I20260617 07:53:15.927804 886 tablet_service.cc:1511] Processing CreateTablet for tablet 75149090e9ab4eed93bd635cde173000 (DEFAULT_TABLE table=default.Table_dc7b3a260be0403aa988a9e09d73be9b [id=627b75c139f6473999455df6e7a55686]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.928119 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75149090e9ab4eed93bd635cde173000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.923170 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ed9a99cdcbb74a3fb74654a26716a1c9
I20260617 07:53:15.929360 455 catalog_manager.cc:6784] ReplaceTablet: tablet ed9a99cdcbb74a3fb74654a26716a1c9 deleted and replaced by tablet 57c83de284064dd4a14fcea5ce6b08ad
I20260617 07:53:15.929643 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_f8e68ee7c0bf43b08f9c84454484121d" } modify_external_catalogs: true
I20260617 07:53:15.929828 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_f8e68ee7c0bf43b08f9c84454484121d" } modify_external_catalogs: true
I20260617 07:53:15.929919 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet ed9a99cdcbb74a3fb74654a26716a1c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 57c83de284064dd4a14fcea5ce6b08ad) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.933008 1862 ts_tablet_manager.cc:1929] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:15.933175 1862 log.cc:1199] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/cb95639e16ed423fbe60b15a1bcdf5a6
I20260617 07:53:15.922675 461 rpcz_store.cc:276] 0617 07:53:14.843032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.622975 (+779943us) service_pool.cc:224] Handling call
0617 07:53:15.646804 (+ 23829us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449c0654b 00007f1440662107 00007f1440661e35 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:15.922519 (+275715us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:15.653333 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:15.653438 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:15.653442 (+ 4us) write_op.cc:435] Acquired schema lock
0617 07:53:15.653444 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:15.653538 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:15.653546 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:15.653550 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:15.653611 (+ 61us) tablet.cc:701] Row locks acquired
0617 07:53:15.653614 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:15.653639 (+ 25us) write_op.cc:270] Start()
0617 07:53:15.653664 (+ 25us) write_op.cc:276] Timestamp: P: 1781682795653460 usec, L: 0
0617 07:53:15.653667 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:15.718764 (+ 65097us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x6160000442b8. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f1441c14775 00007f1441cf951b 00007f1441cd4518 00007f1441cd3dc5 00007f14430b5305 00007f14430b3e29 00007f14430bc250 00007f14430bc05d 0000000000aa681c 00007f1435d0ff6f
0617 07:53:15.719008 (+ 244us) log.cc:844] Serialized 628 byte log entry
0617 07:53:15.920206 (+201198us) op_driver.cc:464] REPLICATION: finished
0617 07:53:15.920348 (+ 142us) write_op.cc:301] APPLY: starting
0617 07:53:15.920363 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:15.920407 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:15.920409 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:15.920519 (+ 110us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:15.920574 (+ 55us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:15.920580 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:15.920644 (+ 64us) log.cc:844] Serialized 29 byte log entry
0617 07:53:15.920698 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.920714 (+ 16us) write_op.cc:454] Released schema lock
0617 07:53:15.920719 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:15.920785 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.920789 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":53987456,"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":429,"apply.run_wall_time_us":430,"num_ops":2,"prepare.queue_time_us":5494,"prepare.run_cpu_time_us":1075,"prepare.run_wall_time_us":115658,"replication_time_us":266511,"spinlock_wait_cycles":148929920}]]}
I20260617 07:53:15.933566 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2a9cd90a401b43569e0065aca5940892" } modify_external_catalogs: true
I20260617 07:53:15.933739 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2a9cd90a401b43569e0065aca5940892" } modify_external_catalogs: true
I20260617 07:53:15.934106 1862 ts_tablet_manager.cc:1950] T cb95639e16ed423fbe60b15a1bcdf5a6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:15.934473 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 98) took 4104 ms. Trace:
I20260617 07:53:15.934595 1862 rpcz_store.cc:276] 0617 07:53:11.830517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.830562 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:15.916197 (+4085635us) ts_tablet_manager.cc:1151] Deleting tablet cb95639e16ed423fbe60b15a1bcdf5a6
0617 07:53:15.916206 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.930251 (+ 14045us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.932965 (+ 2714us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:15.934458 (+ 1493us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4085429}
I20260617 07:53:15.935096 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 99) took 4104 ms. Trace:
I20260617 07:53:15.935215 1862 rpcz_store.cc:276] 0617 07:53:11.830936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.830982 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:15.934947 (+4103965us) ts_tablet_manager.cc:1151] Deleting tablet 18f9bace06e34602acc7fcd7501b3671
0617 07:53:15.934957 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.935078 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4103754}
I20260617 07:53:15.937079 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet cb95639e16ed423fbe60b15a1bcdf5a6 (table default.Table_1e6b5c822e34499dac5e7bda83d587b2 [id=f2f2591e0ed7444d87b0149a964ba958]) successfully deleted
W20260617 07:53:15.937783 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 18f9bace06e34602acc7fcd7501b3671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18f9bace06e34602acc7fcd7501b3671 already in progress: creating tablet
I20260617 07:53:15.938457 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 531ccdf479814053b468a7d5802f5dde) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.938656 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c76bfcbd22e4bfb97346a1b56f68dab with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5bd47736774ba9a05426b46a057e80) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.938465 894 tablet_service.cc:1558] Processing DeleteTablet for tablet d657fbccb4af40558033a971aab7f3e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.938992 894 tablet_service.cc:1558] Processing DeleteTablet for tablet ed9a99cdcbb74a3fb74654a26716a1c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 57c83de284064dd4a14fcea5ce6b08ad) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.939807 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 116) took 2979 ms. Trace:
I20260617 07:53:15.940279 744 tablet_service.cc:1511] Processing CreateTablet for tablet 75149090e9ab4eed93bd635cde173000 (DEFAULT_TABLE table=default.Table_dc7b3a260be0403aa988a9e09d73be9b [id=627b75c139f6473999455df6e7a55686]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.940754 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75149090e9ab4eed93bd635cde173000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.911921 2086 leader_election.cc:290] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.948035 760 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3d88113729482494d131ad4988ddca (DEFAULT_TABLE table=default.Table_94fefeabbc244e55a4ebb57d7e80f0ed [id=6c4de97e57d146bf9c00d8a8a400b093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.948490 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3d88113729482494d131ad4988ddca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.951565 755 tablet_service.cc:1558] Processing DeleteTablet for tablet d657fbccb4af40558033a971aab7f3e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.913475 1171 tablet_bootstrap.cc:654] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.911109 851 leader_election.cc:304] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:15.954689 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:15.955618 1172 tablet_bootstrap.cc:492] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:15.962607 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 531ccdf479814053b468a7d5802f5dde) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.962967 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464cf1effff241608f4a7255f2646b04" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:15.963395 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c76bfcbd22e4bfb97346a1b56f68dab with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5bd47736774ba9a05426b46a057e80) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:15.963508 852 leader_election.cc:343] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.964187 2201 raft_consensus.cc:2804] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:15.964293 2201 raft_consensus.cc:493] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:15.964391 2201 raft_consensus.cc:3060] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:15.964908 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464cf1effff241608f4a7255f2646b04" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:15.965359 1046 raft_consensus.cc:3060] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:15.966517 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet dac3dc9d7da447cb8fdca84fdac0dc39
I20260617 07:53:15.967075 2201 raft_consensus.cc:515] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.967760 2201 leader_election.cc:290] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:15.968153 743 tablet_service.cc:1558] Processing DeleteTablet for tablet ed9a99cdcbb74a3fb74654a26716a1c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 57c83de284064dd4a14fcea5ce6b08ad) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.968107 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_bbc71414b3d843b0a47892230967fb61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:15.968722 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ba8963530d49a89fe4eb626225377d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:15.968869 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbc71414b3d843b0a47892230967fb61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:15.969566 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet dac3dc9d7da447cb8fdca84fdac0dc39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.969703 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ba8963530d49a89fe4eb626225377d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:15.969910 1048 raft_consensus.cc:3060] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:15.971360 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ba8963530d49a89fe4eb626225377d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:15.972456 1048 raft_consensus.cc:2468] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:15.973107 852 leader_election.cc:343] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:15.973415 852 leader_election.cc:343] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:15.973847 744 tablet_service.cc:1558] Processing DeleteTablet for tablet dac3dc9d7da447cb8fdca84fdac0dc39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.977175 851 leader_election.cc:304] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:15.977890 886 tablet_service.cc:1558] Processing DeleteTablet for tablet dac3dc9d7da447cb8fdca84fdac0dc39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.978936 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5db1eb601069498e990dbb8635e0aa1d" } new_table_name: "default.Table_8cb4ea8e1a39478fa0b788e049009950" modify_external_catalogs: true
I20260617 07:53:15.979310 2201 raft_consensus.cc:2804] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:15.979460 2201 raft_consensus.cc:697] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:15.910614 1170 rpcz_store.cc:276] 0617 07:53:13.443501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.443805 (+ 304us) service_pool.cc:224] Handling call
0617 07:53:15.910442 (+2466637us) ts_tablet_manager.cc:1151] Deleting tablet 301bd4d6faec429ba71ce354c23d0f75
0617 07:53:15.910452 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.910521 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2466457}
W20260617 07:53:15.981029 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 301bd4d6faec429ba71ce354c23d0f75 because the tablet was not found. No further retry: Not found: Tablet not found: 301bd4d6faec429ba71ce354c23d0f75
I20260617 07:53:15.981290 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_aab2b789b2dc48719838e0704687a406 [id=e42c6141367a4922ace753fd8ccf8463] alter complete (version 1)
I20260617 07:53:15.979878 2201 consensus_queue.cc:237] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:15.981688 886 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8388648475499db50cc16a7c36775a with delete_type TABLET_DATA_DELETED (replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.981818 898 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.986140 965 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:15.980204 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 75149090e9ab4eed93bd635cde173000 (DEFAULT_TABLE table=default.Table_dc7b3a260be0403aa988a9e09d73be9b [id=627b75c139f6473999455df6e7a55686]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:15.987169 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75149090e9ab4eed93bd635cde173000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:15.987732 1172 tablet_bootstrap.cc:654] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:15.990196 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet eba5976fcadd4add9c671300b431617b
I20260617 07:53:15.991025 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_380e0756ecdc418ab063466b537673ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:15.991573 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_380e0756ecdc418ab063466b537673ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:15.993136 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet eba5976fcadd4add9c671300b431617b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:15.995533 744 tablet_service.cc:1558] Processing DeleteTablet for tablet eba5976fcadd4add9c671300b431617b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:15.998436 2305 tablet.cc:1724] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:15.999215 898 tablet_service.cc:1558] Processing DeleteTablet for tablet eba5976fcadd4add9c671300b431617b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:15.999467 1170 tablet_replica.cc:333] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:15.999648 1170 raft_consensus.cc:2243] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:15.999776 1170 raft_consensus.cc:2272] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.000234 1170 ts_tablet_manager.cc:1916] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.000838 2260 raft_consensus.cc:493] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.000974 2260 raft_consensus.cc:515] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.001601 2314 tablet.cc:1724] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:16.001833 2260 leader_election.cc:290] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:16.004343 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f7a4ea634f429794b402439d19bbfe" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:16.004848 988 leader_election.cc:343] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.006466 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f7a4ea634f429794b402439d19bbfe" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.008706 1178 tablet_bootstrap.cc:492] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:16.008749 898 tablet_service.cc:1511] Processing CreateTablet for tablet e77241217a0a4d65b6adac5428f269b1 (DEFAULT_TABLE table=default.Table_35df243dcbf147028c18e6e47085e771 [id=9faa8dde2b60422c9bfee3ba617747ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.008850 1178 ts_tablet_manager.cc:1403] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.173s user 0.005s sys 0.015s
I20260617 07:53:16.009105 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77241217a0a4d65b6adac5428f269b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.009451 744 tablet_service.cc:1511] Processing CreateTablet for tablet fe1d18ae17af40478a47d136f8e02549 (DEFAULT_TABLE table=default.Table_c4e47d1c1dd44cd0b8444ac78849276a [id=9cd2c5003f784c5884613eab88860677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.010126 1987 consensus_queue.cc:1048] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:16.010681 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe1d18ae17af40478a47d136f8e02549. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:16.011029 852 consensus_peers.cc:597] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:16.011376 852 consensus_peers.cc:597] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:16.011708 886 tablet_service.cc:1511] Processing CreateTablet for tablet fe1d18ae17af40478a47d136f8e02549 (DEFAULT_TABLE table=default.Table_c4e47d1c1dd44cd0b8444ac78849276a [id=9cd2c5003f784c5884613eab88860677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.012032 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe1d18ae17af40478a47d136f8e02549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.012813 1178 raft_consensus.cc:359] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.012912 2087 raft_consensus.cc:493] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.013002 1178 raft_consensus.cc:385] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.013068 1178 raft_consensus.cc:740] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.013031 2087 raft_consensus.cc:515] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.013270 1178 consensus_queue.cc:260] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.013641 2087 leader_election.cc:290] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.013815 1178 ts_tablet_manager.cc:1434] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
W20260617 07:53:16.014536 986 leader_election.cc:343] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.014729 986 leader_election.cc:304] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:16.015179 2260 raft_consensus.cc:2749] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.015807 1846 ts_tablet_manager.cc:1929] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.015915 1846 log.cc:1199] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d21f61a35ca544568bcfca1a6230deca
I20260617 07:53:16.016281 1846 ts_tablet_manager.cc:1950] T d21f61a35ca544568bcfca1a6230deca P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.017153 760 tablet_service.cc:1511] Processing CreateTablet for tablet e77241217a0a4d65b6adac5428f269b1 (DEFAULT_TABLE table=default.Table_35df243dcbf147028c18e6e47085e771 [id=9faa8dde2b60422c9bfee3ba617747ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.018106 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 65) took 4291 ms. Trace:
I20260617 07:53:16.018253 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e77241217a0a4d65b6adac5428f269b1 (DEFAULT_TABLE table=default.Table_35df243dcbf147028c18e6e47085e771 [id=9faa8dde2b60422c9bfee3ba617747ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.018193 1846 rpcz_store.cc:276] 0617 07:53:11.726529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.726807 (+ 278us) service_pool.cc:224] Handling call
0617 07:53:15.870045 (+4143238us) ts_tablet_manager.cc:1151] Deleting tablet d21f61a35ca544568bcfca1a6230deca
0617 07:53:15.870055 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.996798 (+126743us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.015755 (+ 18957us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.018092 (+ 2337us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4132686}
I20260617 07:53:16.018707 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77241217a0a4d65b6adac5428f269b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.018865 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77241217a0a4d65b6adac5428f269b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.019402 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d21f61a35ca544568bcfca1a6230deca (table default.Table_97c26e097b994c36a82d2b9c95b8be1d [id=d270e804a9a84991bcf8bef8fd5c3fe3]) successfully deleted
I20260617 07:53:16.017923 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d657fbccb4af40558033a971aab7f3e4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.021420 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d657fbccb4af40558033a971aab7f3e4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:16.021611 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 216614d066e9446f91e53d2a382b5f6e consensus state has no leader
I20260617 07:53:16.021601 1047 raft_consensus.cc:2468] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:16.023120 2011 raft_consensus.cc:493] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.023236 2011 raft_consensus.cc:515] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.023550 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 61) took 4297 ms. Trace:
I20260617 07:53:16.024154 2011 leader_election.cc:290] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.024703 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934f5fa0287427cb45fe568f0de8758" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:16.032158 852 leader_election.cc:343] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.032824 851 leader_election.cc:304] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:16.033175 2087 raft_consensus.cc:2804] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:16.033246 2087 raft_consensus.cc:493] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:16.033301 2087 raft_consensus.cc:3060] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.023636 1846 rpcz_store.cc:276] 0617 07:53:11.726093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.726850 (+ 757us) service_pool.cc:224] Handling call
0617 07:53:16.018639 (+4291789us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:16.018648 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.023533 (+ 4885us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4281173}
I20260617 07:53:16.035864 2087 raft_consensus.cc:515] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.036409 2087 leader_election.cc:290] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.037117 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934f5fa0287427cb45fe568f0de8758" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:16.039312 1171 tablet_bootstrap.cc:492] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.039450 1171 ts_tablet_manager.cc:1403] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.155s user 0.003s sys 0.010s
I20260617 07:53:16.040236 1171 raft_consensus.cc:359] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.040398 1171 raft_consensus.cc:385] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.040445 1171 raft_consensus.cc:740] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.011008 1046 raft_consensus.cc:2468] T 464cf1effff241608f4a7255f2646b04 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:16.043715 1171 consensus_queue.cc:260] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.044250 1171 ts_tablet_manager.cc:1434] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:16.044543 1171 tablet_bootstrap.cc:492] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.045607 713 leader_election.cc:304] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:16.045946 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d9e473fd444efa6ab63cc51dbb2bd already in progress: creating tablet
I20260617 07:53:16.046666 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d657fbccb4af40558033a971aab7f3e4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:16.047442 1022 tablet_service.cc:1511] Processing CreateTablet for tablet fe1d18ae17af40478a47d136f8e02549 (DEFAULT_TABLE table=default.Table_c4e47d1c1dd44cd0b8444ac78849276a [id=9cd2c5003f784c5884613eab88860677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.047802 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe1d18ae17af40478a47d136f8e02549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.047765 2011 raft_consensus.cc:2749] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.054373 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.054603 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.054693 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.054787 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.054893 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.054603 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:16.055379 852 leader_election.cc:343] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.055943 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.055840 1178 tablet_bootstrap.cc:492] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:16.057932 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 60) took 4332 ms. Trace:
I20260617 07:53:16.058028 1846 rpcz_store.cc:276] 0617 07:53:11.725945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.727036 (+ 1091us) service_pool.cc:224] Handling call
0617 07:53:16.035257 (+4308221us) ts_tablet_manager.cc:1151] Deleting tablet 5dcfb101cf51487692ef9a6a17f40804
0617 07:53:16.035269 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.057912 (+ 22643us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4291151}
W20260617 07:53:16.058509 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5dcfb101cf51487692ef9a6a17f40804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dcfb101cf51487692ef9a6a17f40804 already in progress: creating tablet
I20260617 07:53:16.058537 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 57) took 4351 ms. Trace:
I20260617 07:53:16.058626 1846 rpcz_store.cc:276] 0617 07:53:11.707112 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.707613 (+ 501us) service_pool.cc:224] Handling call
0617 07:53:16.058308 (+4350695us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:16.058322 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.058520 (+ 198us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4306155}
I20260617 07:53:16.059147 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 87) took 4313 ms. Trace:
I20260617 07:53:16.059176 851 leader_election.cc:304] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:16.059515 2201 raft_consensus.cc:2804] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
W20260617 07:53:16.059628 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7f7611958cf143438497c93f5f2bc098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7611958cf143438497c93f5f2bc098 already in progress: creating tablet
I20260617 07:53:16.059659 2201 raft_consensus.cc:697] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:16.059896 2201 consensus_queue.cc:237] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.060293 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d657fbccb4af40558033a971aab7f3e4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:16.060526 1046 raft_consensus.cc:3060] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.059245 1846 rpcz_store.cc:276] 0617 07:53:11.746274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.752175 (+ 5901us) service_pool.cc:224] Handling call
0617 07:53:16.059026 (+4306851us) ts_tablet_manager.cc:1151] Deleting tablet df37ed81b17d4178adeb6057491b4cc9
0617 07:53:16.059041 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.059132 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4306703}
I20260617 07:53:16.061568 1846 tablet_replica.cc:333] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:16.061933 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df37ed81b17d4178adeb6057491b4cc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df37ed81b17d4178adeb6057491b4cc9 already in progress: creating tablet
I20260617 07:53:16.062004 1846 raft_consensus.cc:2243] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.062279 1846 raft_consensus.cc:2272] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.062896 1846 ts_tablet_manager.cc:1916] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.063433 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:16.064060 459 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:57237 (request call id 193) took 967 ms (client timeout 1000 ms). Trace:
W20260617 07:53:16.064321 459 rpcz_store.cc:269] 0617 07:53:15.096332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.218908 (+122576us) service_pool.cc:224] Handling call
0617 07:53:16.064002 (+845094us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:15.917611 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:15.917750 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:15.917755 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:15.917757 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:15.917898 (+ 141us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:15.917906 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:15.917910 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:15.918080 (+ 170us) tablet.cc:701] Row locks acquired
0617 07:53:15.918083 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:15.918144 (+ 61us) write_op.cc:270] Start()
0617 07:53:15.918200 (+ 56us) write_op.cc:276] Timestamp: P: 1781682795918115 usec, L: 0
0617 07:53:15.918203 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:15.918458 (+ 255us) log.cc:844] Serialized 356 byte log entry
0617 07:53:15.964263 (+ 45805us) op_driver.cc:464] REPLICATION: finished
0617 07:53:15.964984 (+ 721us) write_op.cc:301] APPLY: starting
0617 07:53:15.964994 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:15.965023 (+ 29us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:15.965043 (+ 20us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:15.965077 (+ 34us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:15.965101 (+ 24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:15.965107 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:15.965165 (+ 58us) log.cc:844] Serialized 23 byte log entry
0617 07:53:15.965217 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.965232 (+ 15us) write_op.cc:454] Released schema lock
0617 07:53:15.965236 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:15.965305 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:15.965309 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":197,"child_traces":[["op",{"apply.queue_time_us":677,"apply.run_cpu_time_us":300,"apply.run_wall_time_us":300,"num_ops":1,"prepare.queue_time_us":32091,"prepare.run_cpu_time_us":728,"prepare.run_wall_time_us":961,"replication_time_us":46033}]]}
I20260617 07:53:16.075043 1046 raft_consensus.cc:2468] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:16.075505 851 leader_election.cc:304] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:16.076052 2086 raft_consensus.cc:2804] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:16.076248 2086 raft_consensus.cc:697] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:16.076642 2086 consensus_queue.cc:237] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.083966 1862 rpcz_store.cc:276] 0617 07:53:12.960647 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.960699 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:15.935602 (+2974903us) ts_tablet_manager.cc:1151] Deleting tablet 737e9344fc824714a2c2596170637158
0617 07:53:15.935612 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:15.939788 (+ 4176us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2974652}
I20260617 07:53:16.088873 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 117) took 3127 ms. Trace:
I20260617 07:53:16.089053 1862 rpcz_store.cc:276] 0617 07:53:12.961119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.961164 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:16.088732 (+3127568us) ts_tablet_manager.cc:1151] Deleting tablet 121339ab4842432e9fb7bc357750f8ad
0617 07:53:16.088745 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.088855 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3127401}
I20260617 07:53:16.089475 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 118) took 3128 ms. Trace:
I20260617 07:53:16.089620 1862 rpcz_store.cc:276] 0617 07:53:12.961465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.961507 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:16.089376 (+3127869us) ts_tablet_manager.cc:1151] Deleting tablet 596ef68705c84791b54f07e03b219b4c
0617 07:53:16.089385 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.089460 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3127721}
I20260617 07:53:16.090921 1171 tablet_bootstrap.cc:654] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.091908 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 119) took 3130 ms. Trace:
I20260617 07:53:16.096493 1898 raft_consensus.cc:493] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.098253 1898 raft_consensus.cc:515] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.098913 1898 leader_election.cc:290] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:16.088917 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 737e9344fc824714a2c2596170637158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 737e9344fc824714a2c2596170637158 already in progress: creating tablet
I20260617 07:53:16.099617 1098 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
W20260617 07:53:16.099646 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 121339ab4842432e9fb7bc357750f8ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 121339ab4842432e9fb7bc357750f8ad already in progress: creating tablet
W20260617 07:53:16.099913 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 596ef68705c84791b54f07e03b219b4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596ef68705c84791b54f07e03b219b4c already in progress: creating tablet
I20260617 07:53:16.098171 1862 rpcz_store.cc:276] 0617 07:53:12.961795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.961840 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:16.089997 (+3128157us) ts_tablet_manager.cc:1151] Deleting tablet 0be19ece3a0a4a51abad7b8e2f3b2420
0617 07:53:16.091800 (+ 1803us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.091890 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3127994}
W20260617 07:53:16.100209 851 leader_election.cc:343] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 3bee4c9cd9f2415ca54b8e85dbd326a7
I20260617 07:53:16.100430 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 120) took 3138 ms. Trace:
I20260617 07:53:16.100610 1862 rpcz_store.cc:276] 0617 07:53:12.962047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.962092 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:16.100203 (+3138111us) ts_tablet_manager.cc:1151] Deleting tablet e897b111e65c497591c7daaa81d783c7
0617 07:53:16.100218 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.100412 (+ 194us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3137943}
I20260617 07:53:16.101343 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 123) took 3079 ms. Trace:
I20260617 07:53:16.101511 1862 rpcz_store.cc:276] 0617 07:53:13.021931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.021985 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:16.101148 (+3079163us) ts_tablet_manager.cc:1151] Deleting tablet 4de8df5e15cb43c0b95ec5af3110db66
0617 07:53:16.101186 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.101325 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3078940}
I20260617 07:53:16.102255 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 124) took 3079 ms. Trace:
I20260617 07:53:16.102432 1862 rpcz_store.cc:276] 0617 07:53:13.022663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.022714 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:16.102045 (+3079331us) ts_tablet_manager.cc:1151] Deleting tablet 99ec78c123d448329b8442a0de0140d3
0617 07:53:16.102055 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.102236 (+ 181us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3079152}
I20260617 07:53:16.103081 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 125) took 3080 ms. Trace:
I20260617 07:53:16.103217 1862 rpcz_store.cc:276] 0617 07:53:13.023006 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.023046 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:16.102853 (+3079807us) ts_tablet_manager.cc:1151] Deleting tablet 1f6264adc3994c22864ea73106ba2320
0617 07:53:16.102864 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.103031 (+ 167us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3079624}
I20260617 07:53:16.103835 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 126) took 3080 ms. Trace:
I20260617 07:53:16.104019 1862 rpcz_store.cc:276] 0617 07:53:13.023749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.023796 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:16.103636 (+3079840us) ts_tablet_manager.cc:1151] Deleting tablet 71e8f7118aaf4c6a9b9caab5abc030fa
0617 07:53:16.103679 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.103818 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3079680}
I20260617 07:53:16.104590 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 129) took 3064 ms. Trace:
I20260617 07:53:16.104738 1862 rpcz_store.cc:276] 0617 07:53:13.040504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.040556 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:16.104427 (+3063871us) ts_tablet_manager.cc:1151] Deleting tablet 11794aa70824476e9751a41ab305cc80
0617 07:53:16.104438 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.104573 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3063632}
I20260617 07:53:16.105288 1862 tablet_replica.cc:333] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:16.105988 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0be19ece3a0a4a51abad7b8e2f3b2420 already in progress: creating tablet
W20260617 07:53:16.106259 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e897b111e65c497591c7daaa81d783c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e897b111e65c497591c7daaa81d783c7 already in progress: creating tablet
W20260617 07:53:16.106503 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4de8df5e15cb43c0b95ec5af3110db66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4de8df5e15cb43c0b95ec5af3110db66 already in progress: creating tablet
W20260617 07:53:16.106690 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 99ec78c123d448329b8442a0de0140d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99ec78c123d448329b8442a0de0140d3 already in progress: creating tablet
W20260617 07:53:16.106899 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 1f6264adc3994c22864ea73106ba2320 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6264adc3994c22864ea73106ba2320 already in progress: creating tablet
W20260617 07:53:16.107208 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 11794aa70824476e9751a41ab305cc80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11794aa70824476e9751a41ab305cc80 already in progress: creating tablet
I20260617 07:53:16.111402 1172 tablet_bootstrap.cc:492] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:16.113253 1172 ts_tablet_manager.cc:1403] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.159s user 0.003s sys 0.001s
I20260617 07:53:16.114652 1862 raft_consensus.cc:2243] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.114990 1862 raft_consensus.cc:2272] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.116453 1862 ts_tablet_manager.cc:1916] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.124197 1171 tablet_bootstrap.cc:492] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.124421 1171 ts_tablet_manager.cc:1403] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.080s user 0.001s sys 0.002s
I20260617 07:53:16.125011 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bee4c9cd9f2415ca54b8e85dbd326a7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:16.126660 852 leader_election.cc:343] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.126909 852 leader_election.cc:304] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.127723 1178 tablet_bootstrap.cc:654] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.127758 2201 raft_consensus.cc:2749] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.125353 1172 raft_consensus.cc:359] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.129264 1172 raft_consensus.cc:385] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.129665 1172 raft_consensus.cc:740] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:16.130537 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ed59705e05148f991844d47882dc151 has no consensus state
I20260617 07:53:16.130964 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_cf8a1de2a6034fababf6dd4a1667f37b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:16.133313 2086 raft_consensus.cc:493] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.133446 2086 raft_consensus.cc:515] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.135214 1171 raft_consensus.cc:359] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:16.137537 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf8a1de2a6034fababf6dd4a1667f37b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.139012 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.139107 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:16.139277 1046 raft_consensus.cc:2468] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:16.140964 1846 ts_tablet_manager.cc:1929] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.141073 1170 ts_tablet_manager.cc:1929] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.141187 1170 log.cc:1199] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/63bf519b83c445798bddda3120b542ce
I20260617 07:53:16.141516 1170 ts_tablet_manager.cc:1950] T 63bf519b83c445798bddda3120b542ce P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:16.141788 1171 raft_consensus.cc:385] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.141979 1171 raft_consensus.cc:740] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.142311 1171 consensus_queue.cc:260] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.142584 1846 log.cc:1199] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/0f9db8a986b344548e435b77edc14cb6
I20260617 07:53:16.143138 1846 ts_tablet_manager.cc:1950] T 0f9db8a986b344548e435b77edc14cb6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.144351 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 88) took 4397 ms. Trace:
I20260617 07:53:16.145197 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_34966dbc9ee4429b877502acdc5ebe3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:16.146347 1171 ts_tablet_manager.cc:1434] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
W20260617 07:53:16.146375 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34966dbc9ee4429b877502acdc5ebe3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.147974 2011 raft_consensus.cc:493] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.148569 2011 raft_consensus.cc:515] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.149271 2011 leader_election.cc:290] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:16.150362 716 leader_election.cc:343] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 89783bab2e584fe9a8eda963f78bf3ec
W20260617 07:53:16.151055 713 leader_election.cc:343] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 89783bab2e584fe9a8eda963f78bf3ec
I20260617 07:53:16.151155 713 leader_election.cc:304] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.151628 2011 raft_consensus.cc:2749] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.151889 1846 rpcz_store.cc:276] 0617 07:53:11.746410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.752332 (+ 5922us) service_pool.cc:224] Handling call
0617 07:53:16.061524 (+4309192us) ts_tablet_manager.cc:1151] Deleting tablet 0f9db8a986b344548e435b77edc14cb6
0617 07:53:16.061534 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.067652 (+ 6118us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.140905 (+ 73253us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.144331 (+ 3426us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4309034}
I20260617 07:53:16.143181 1172 consensus_queue.cc:260] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.152733 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 0f9db8a986b344548e435b77edc14cb6 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]) successfully deleted
I20260617 07:53:16.152896 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 89) took 4406 ms. Trace:
I20260617 07:53:16.153359 1846 rpcz_store.cc:276] 0617 07:53:11.746494 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.752502 (+ 6008us) service_pool.cc:224] Handling call
0617 07:53:16.152736 (+4400234us) ts_tablet_manager.cc:1151] Deleting tablet 2684f3200e604bb6bf37a2f97a193eff
0617 07:53:16.152750 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.152878 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4400096}
W20260617 07:53:16.154033 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2684f3200e604bb6bf37a2f97a193eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2684f3200e604bb6bf37a2f97a193eff already in progress: creating tablet
I20260617 07:53:16.154193 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 90) took 4407 ms. Trace:
I20260617 07:53:16.154623 1846 rpcz_store.cc:276] 0617 07:53:11.746597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.752649 (+ 6052us) service_pool.cc:224] Handling call
0617 07:53:16.154033 (+4401384us) ts_tablet_manager.cc:1151] Deleting tablet 59acdc64fe9247d28c4c277161b42f4f
0617 07:53:16.154044 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.154177 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4401227}
W20260617 07:53:16.155265 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 59acdc64fe9247d28c4c277161b42f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59acdc64fe9247d28c4c277161b42f4f already in progress: creating tablet
I20260617 07:53:16.156535 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 91) took 4409 ms. Trace:
I20260617 07:53:16.156759 1846 rpcz_store.cc:276] 0617 07:53:11.746705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.752819 (+ 6114us) service_pool.cc:224] Handling call
0617 07:53:16.155309 (+4402490us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:16.155319 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.156516 (+ 1197us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4402339}
W20260617 07:53:16.157357 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 95865af94c04410386d23cb369180611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95865af94c04410386d23cb369180611 already in progress: creating tablet
I20260617 07:53:16.157501 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 92) took 4410 ms. Trace:
I20260617 07:53:16.157887 1846 rpcz_store.cc:276] 0617 07:53:11.746809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.752980 (+ 6171us) service_pool.cc:224] Handling call
0617 07:53:16.157380 (+4404400us) ts_tablet_manager.cc:1151] Deleting tablet 74ab8e93e3fe475ba9c7b5fce390a8ab
0617 07:53:16.157390 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.157485 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4404246}
W20260617 07:53:16.159302 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74ab8e93e3fe475ba9c7b5fce390a8ab already in progress: creating tablet
I20260617 07:53:16.159458 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 93) took 4412 ms. Trace:
I20260617 07:53:16.159811 1846 rpcz_store.cc:276] 0617 07:53:11.746916 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.753148 (+ 6232us) service_pool.cc:224] Handling call
0617 07:53:16.159358 (+4406210us) ts_tablet_manager.cc:1151] Deleting tablet 0ebafc920ed34216be5fb115f9bc6f7f
0617 07:53:16.159368 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.159443 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4406070}
W20260617 07:53:16.160415 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0ebafc920ed34216be5fb115f9bc6f7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ebafc920ed34216be5fb115f9bc6f7f already in progress: creating tablet
I20260617 07:53:16.160542 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 94) took 4413 ms. Trace:
I20260617 07:53:16.160590 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c94947b1e4614158b9ab608219830eec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:16.161042 1846 rpcz_store.cc:276] 0617 07:53:11.746986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.753297 (+ 6311us) service_pool.cc:224] Handling call
0617 07:53:16.160421 (+4407124us) ts_tablet_manager.cc:1151] Deleting tablet 570ae1e189a64da6bad10156b401ec46
0617 07:53:16.160432 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.160528 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4406962}
W20260617 07:53:16.161154 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c94947b1e4614158b9ab608219830eec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:16.161386 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 570ae1e189a64da6bad10156b401ec46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 570ae1e189a64da6bad10156b401ec46 already in progress: creating tablet
I20260617 07:53:16.162775 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 59) took 4442 ms. Trace:
I20260617 07:53:16.163163 1846 rpcz_store.cc:276] 0617 07:53:11.720210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.720283 (+ 73us) service_pool.cc:224] Handling call
0617 07:53:16.162681 (+4442398us) ts_tablet_manager.cc:1151] Deleting tablet 7392ca4ba6a140e19c57e962a26162af
0617 07:53:16.162691 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.162757 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4407547}
W20260617 07:53:16.163774 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7392ca4ba6a140e19c57e962a26162af because the tablet was not found. No further retry: Not found: Tablet not found: 7392ca4ba6a140e19c57e962a26162af
I20260617 07:53:16.163900 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 64) took 4437 ms. Trace:
I20260617 07:53:16.164258 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 162) took 2720 ms. Trace:
I20260617 07:53:16.164369 1170 rpcz_store.cc:276] 0617 07:53:13.444154 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.444425 (+ 271us) service_pool.cc:224] Handling call
0617 07:53:15.999398 (+2554973us) ts_tablet_manager.cc:1151] Deleting tablet 63bf519b83c445798bddda3120b542ce
0617 07:53:15.999409 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.068247 (+ 68838us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.141018 (+ 72771us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.164236 (+ 23218us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2537973}
I20260617 07:53:16.164801 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 63bf519b83c445798bddda3120b542ce (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]) successfully deleted
I20260617 07:53:16.141538 2086 leader_election.cc:290] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.166385 1172 ts_tablet_manager.cc:1434] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.052s user 0.003s sys 0.000s
I20260617 07:53:16.168503 1172 tablet_bootstrap.cc:492] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:16.164312 1846 rpcz_store.cc:276] 0617 07:53:11.726449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.726741 (+ 292us) service_pool.cc:224] Handling call
0617 07:53:16.163774 (+4437033us) ts_tablet_manager.cc:1151] Deleting tablet 11794aa70824476e9751a41ab305cc80
0617 07:53:16.163784 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.163884 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4408587}
W20260617 07:53:16.170456 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 11794aa70824476e9751a41ab305cc80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11794aa70824476e9751a41ab305cc80 already in progress: creating tablet
I20260617 07:53:16.170763 1170 tablet_replica.cc:333] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:16.170792 1846 tablet_replica.cc:333] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:16.139693 852 leader_election.cc:343] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.171262 1846 raft_consensus.cc:2243] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.171384 851 leader_election.cc:304] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:16.171751 1846 raft_consensus.cc:2272] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.172065 2201 raft_consensus.cc:2804] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:16.172171 2201 raft_consensus.cc:493] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:16.172233 2201 raft_consensus.cc:3060] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.174521 1846 ts_tablet_manager.cc:1916] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.174625 2201 raft_consensus.cc:515] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.175194 2201 leader_election.cc:290] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.176021 1170 raft_consensus.cc:2243] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.176236 1170 raft_consensus.cc:2272] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.176559 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:16.177572 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:16.177764 1046 raft_consensus.cc:3060] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.179188 459 catalog_manager.cc:5696] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:16.179559 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:16.180179 1046 raft_consensus.cc:2468] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:16.180691 851 leader_election.cc:304] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:16.180966 1898 raft_consensus.cc:2804] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:16.181085 1898 raft_consensus.cc:697] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:16.181295 1898 consensus_queue.cc:237] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.182672 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:16.183730 852 leader_election.cc:343] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.187953 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c8da9b218da342e49e258e24e72ea087"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:16.188897 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8da9b218da342e49e258e24e72ea087 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.190183 1862 ts_tablet_manager.cc:1929] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.190297 1862 log.cc:1199] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/63bf519b83c445798bddda3120b542ce
I20260617 07:53:16.190470 1171 tablet_bootstrap.cc:492] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.190601 1862 ts_tablet_manager.cc:1950] T 63bf519b83c445798bddda3120b542ce P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.190899 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 131) took 3150 ms. Trace:
I20260617 07:53:16.190991 1862 rpcz_store.cc:276] 0617 07:53:13.040708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.040890 (+ 182us) service_pool.cc:224] Handling call
0617 07:53:16.105209 (+3064319us) ts_tablet_manager.cc:1151] Deleting tablet 63bf519b83c445798bddda3120b542ce
0617 07:53:16.105218 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.170891 (+ 65673us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.190126 (+ 19235us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.190884 (+ 758us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3064110}
I20260617 07:53:16.191298 1862 tablet_replica.cc:333] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.191470 1862 raft_consensus.cc:2243] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.191617 1862 raft_consensus.cc:2272] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.192071 1862 ts_tablet_manager.cc:1916] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.192306 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 63bf519b83c445798bddda3120b542ce (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]) successfully deleted
I20260617 07:53:16.194063 1171 tablet_bootstrap.cc:654] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.192994 1170 ts_tablet_manager.cc:1916] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:16.197882 851 consensus_peers.cc:597] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36ce60b466f7420992ef194d72b5718d. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:16.212024 1178 tablet_bootstrap.cc:492] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:16.212213 1178 ts_tablet_manager.cc:1403] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.185s user 0.011s sys 0.009s
I20260617 07:53:16.213096 1178 raft_consensus.cc:359] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.213374 1178 raft_consensus.cc:385] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.213481 1178 raft_consensus.cc:740] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.213950 1178 consensus_queue.cc:260] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.228018 1171 tablet_bootstrap.cc:492] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.228251 1171 ts_tablet_manager.cc:1403] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260617 07:53:16.228650 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_734685dc77ad4399a96c6bf50408058d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:16.228938 1178 ts_tablet_manager.cc:1434] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.017s user 0.001s sys 0.002s
I20260617 07:53:16.229136 1171 raft_consensus.cc:359] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:16.229259 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_734685dc77ad4399a96c6bf50408058d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.229300 1171 raft_consensus.cc:385] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.229367 1171 raft_consensus.cc:740] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.229578 1171 consensus_queue.cc:260] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.234334 1862 ts_tablet_manager.cc:1929] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.234452 1862 log.cc:1199] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a38bb8a140ef4bcab65aaa03bdb79040
I20260617 07:53:16.234755 1862 ts_tablet_manager.cc:1950] T a38bb8a140ef4bcab65aaa03bdb79040 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.237885 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 134) took 3196 ms. Trace:
I20260617 07:53:16.237987 1862 rpcz_store.cc:276] 0617 07:53:13.040979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.041027 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:16.191259 (+3150232us) ts_tablet_manager.cc:1151] Deleting tablet a38bb8a140ef4bcab65aaa03bdb79040
0617 07:53:16.191268 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.213927 (+ 22659us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.234279 (+ 20352us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.237870 (+ 3591us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3150082}
I20260617 07:53:16.238396 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a38bb8a140ef4bcab65aaa03bdb79040 (table default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]) successfully deleted
I20260617 07:53:16.238076 1172 tablet_bootstrap.cc:654] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.239336 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 130) took 3198 ms. Trace:
I20260617 07:53:16.239413 1862 rpcz_store.cc:276] 0617 07:53:13.040608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.041234 (+ 626us) service_pool.cc:224] Handling call
0617 07:53:16.239223 (+3197989us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:16.239233 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.239319 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3197836}
W20260617 07:53:16.240078 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65bf5384ec244d36ba3d4e781c5eb8a3 already in progress: creating tablet
I20260617 07:53:16.242146 1171 ts_tablet_manager.cc:1434] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260617 07:53:16.242923 1171 tablet_bootstrap.cc:492] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.248445 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_63f137a9bd9d4e5d8dcc35f9bbba57b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:16.249049 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63f137a9bd9d4e5d8dcc35f9bbba57b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.250028 1846 ts_tablet_manager.cc:1929] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.250821 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 135) took 3209 ms. Trace:
I20260617 07:53:16.250908 1862 rpcz_store.cc:276] 0617 07:53:13.041316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.041361 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:16.248700 (+3207339us) ts_tablet_manager.cc:1151] Deleting tablet 0dc0676db18c42259efb1ad7dbd140c8
0617 07:53:16.250717 (+ 2017us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.250801 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768,"tablet-delete.queue_time_us":3207190}
W20260617 07:53:16.251961 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0dc0676db18c42259efb1ad7dbd140c8 because the tablet was not found. No further retry: Not found: Tablet not found: 0dc0676db18c42259efb1ad7dbd140c8
I20260617 07:53:16.252146 1171 tablet_bootstrap.cc:654] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.253813 1846 log.cc:1199] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/4996cde4d1514aa081257c802339abe6
I20260617 07:53:16.254335 1846 ts_tablet_manager.cc:1950] T 4996cde4d1514aa081257c802339abe6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.257881 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 133) took 3217 ms. Trace:
I20260617 07:53:16.258147 1862 rpcz_store.cc:276] 0617 07:53:13.040888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.041475 (+ 587us) service_pool.cc:224] Handling call
0617 07:53:16.252109 (+3210634us) ts_tablet_manager.cc:1151] Deleting tablet 950c1c44020a4586b3197f5f68a38963
0617 07:53:16.257746 (+ 5637us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.257860 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3210440}
W20260617 07:53:16.258591 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 950c1c44020a4586b3197f5f68a38963 because the tablet was not found. No further retry: Not found: Tablet not found: 950c1c44020a4586b3197f5f68a38963
I20260617 07:53:16.258626 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 136) took 3217 ms. Trace:
I20260617 07:53:16.258703 1862 rpcz_store.cc:276] 0617 07:53:13.041628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.041674 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:16.258540 (+3216866us) ts_tablet_manager.cc:1151] Deleting tablet c7343400555f447b8a1721ba36d7766d
0617 07:53:16.258551 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.258610 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3216711}
W20260617 07:53:16.259045 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c7343400555f447b8a1721ba36d7766d because the tablet was not found. No further retry: Not found: Tablet not found: c7343400555f447b8a1721ba36d7766d
I20260617 07:53:16.259212 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 132) took 3218 ms. Trace:
I20260617 07:53:16.259289 1862 rpcz_store.cc:276] 0617 07:53:13.040806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.041778 (+ 972us) service_pool.cc:224] Handling call
0617 07:53:16.259110 (+3217332us) ts_tablet_manager.cc:1151] Deleting tablet 6d8f144d04af4ea18f99aee3b82f4a28
0617 07:53:16.259120 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.259196 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3217200}
W20260617 07:53:16.259651 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
I20260617 07:53:16.259720 1862 tablet_replica.cc:333] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.259888 1862 raft_consensus.cc:2243] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.260048 1862 raft_consensus.cc:2272] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.260536 1862 ts_tablet_manager.cc:1916] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.266407 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 97) took 4519 ms. Trace:
I20260617 07:53:16.274070 1846 rpcz_store.cc:276] 0617 07:53:11.747226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.755251 (+ 8025us) service_pool.cc:224] Handling call
0617 07:53:16.170499 (+4415248us) ts_tablet_manager.cc:1151] Deleting tablet 4996cde4d1514aa081257c802339abe6
0617 07:53:16.170509 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.199356 (+ 28847us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.249968 (+ 50612us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.266383 (+ 16415us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4415055}
I20260617 07:53:16.274572 1171 tablet_bootstrap.cc:492] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.274775 1171 ts_tablet_manager.cc:1403] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260617 07:53:16.274919 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 98) took 4527 ms. Trace:
I20260617 07:53:16.275055 1846 rpcz_store.cc:276] 0617 07:53:11.747296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.755470 (+ 8174us) service_pool.cc:224] Handling call
0617 07:53:16.274753 (+4519283us) ts_tablet_manager.cc:1151] Deleting tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
0617 07:53:16.274766 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.274900 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4519117}
I20260617 07:53:16.275609 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 99) took 4528 ms. Trace:
I20260617 07:53:16.275665 1171 raft_consensus.cc:359] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.275761 1846 rpcz_store.cc:276] 0617 07:53:11.747364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.755642 (+ 8278us) service_pool.cc:224] Handling call
0617 07:53:16.275503 (+4519861us) ts_tablet_manager.cc:1151] Deleting tablet a2f21861cb6f481eae968edc733e6e6f
0617 07:53:16.275513 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.275594 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4519727}
I20260617 07:53:16.275898 1171 raft_consensus.cc:385] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.275988 1171 raft_consensus.cc:740] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.276315 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 100) took 4528 ms. Trace:
I20260617 07:53:16.276284 1171 consensus_queue.cc:260] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.276433 1846 rpcz_store.cc:276] 0617 07:53:11.747428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.755788 (+ 8360us) service_pool.cc:224] Handling call
0617 07:53:16.276216 (+4520428us) ts_tablet_manager.cc:1151] Deleting tablet df4f9101deaa4e6ebddacbce14f32810
0617 07:53:16.276226 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.276299 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4520238}
I20260617 07:53:16.276899 1846 tablet_replica.cc:333] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:16.277032 1171 ts_tablet_manager.cc:1434] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:16.277151 1846 raft_consensus.cc:2243] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.277351 1846 raft_consensus.cc:2272] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.277379 1171 tablet_bootstrap.cc:492] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.277846 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 4996cde4d1514aa081257c802339abe6 (table default.Table_b6f5a943489f4a44a8a7d448f9da6c3f [id=b2504cb6ec154dd7880b1870c16431da]) successfully deleted
W20260617 07:53:16.278119 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e05a97a4ab4ed7bff523d1fb1c59ae already in progress: creating tablet
W20260617 07:53:16.278329 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a2f21861cb6f481eae968edc733e6e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2f21861cb6f481eae968edc733e6e6f already in progress: creating tablet
W20260617 07:53:16.278513 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df4f9101deaa4e6ebddacbce14f32810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df4f9101deaa4e6ebddacbce14f32810 already in progress: creating tablet
I20260617 07:53:16.284459 1846 ts_tablet_manager.cc:1916] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.284653 1862 ts_tablet_manager.cc:1929] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.284767 1862 log.cc:1199] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/3bee4c9cd9f2415ca54b8e85dbd326a7
W20260617 07:53:16.286826 446 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 770a5216299842b890d483ca37b0ee86 consensus state has no leader
I20260617 07:53:16.290602 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8ef09b6d20804caab974dc8388100817"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:16.290772 1171 tablet_bootstrap.cc:654] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.291100 1862 ts_tablet_manager.cc:1950] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:16.291239 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ef09b6d20804caab974dc8388100817 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.291630 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 137) took 3249 ms. Trace:
I20260617 07:53:16.293623 1862 rpcz_store.cc:276] 0617 07:53:13.041974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.042023 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:16.259669 (+3217646us) ts_tablet_manager.cc:1151] Deleting tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
0617 07:53:16.259684 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.263427 (+ 3743us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.284595 (+ 21168us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.291616 (+ 7021us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3217469}
I20260617 07:53:16.294162 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 (table default.Table_47a904a2ae6045519235b5988330eeff [id=a2296f2b299d464f8e70d9dce376b4a6]) successfully deleted
I20260617 07:53:16.294267 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 138) took 3018 ms. Trace:
I20260617 07:53:16.294329 1862 rpcz_store.cc:276] 0617 07:53:13.276051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.281037 (+ 4986us) service_pool.cc:224] Handling call
0617 07:53:16.294150 (+3013113us) ts_tablet_manager.cc:1151] Deleting tablet 9436fb7fca094eaab925748e254b1a62
0617 07:53:16.294161 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.294252 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3012838}
W20260617 07:53:16.295284 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
I20260617 07:53:16.299223 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 139) took 3017 ms. Trace:
I20260617 07:53:16.299304 1862 rpcz_store.cc:276] 0617 07:53:13.281481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.281528 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:16.299137 (+3017609us) ts_tablet_manager.cc:1151] Deleting tablet 4e3b5cb887da4d86bdc3d69f350fdb40
0617 07:53:16.299147 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.299207 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3017428}
I20260617 07:53:16.299396 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 53108a2d6c8b4398a568c14df8e0a23e from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:16.299744 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 140) took 3017 ms. Trace:
I20260617 07:53:16.299815 1862 rpcz_store.cc:276] 0617 07:53:13.281848 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.281890 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:16.299642 (+3017752us) ts_tablet_manager.cc:1151] Deleting tablet e55d63a25a2845dbbcce20e560361007
0617 07:53:16.299650 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.299729 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3017562}
W20260617 07:53:16.302001 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 because the tablet was not found. No further retry: Not found: Tablet not found: 4e3b5cb887da4d86bdc3d69f350fdb40
I20260617 07:53:16.303442 1862 tablet_replica.cc:333] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.303639 1862 raft_consensus.cc:2243] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:16.303941 1862 raft_consensus.cc:2272] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.304497 1862 ts_tablet_manager.cc:1916] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.306627 1172 tablet_bootstrap.cc:492] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:16.306807 1172 ts_tablet_manager.cc:1403] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.139s user 0.002s sys 0.002s
W20260617 07:53:16.309271 852 consensus_peers.cc:597] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:16.314414 1898 raft_consensus.cc:493] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.314522 1172 raft_consensus.cc:359] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.314574 1898 raft_consensus.cc:515] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.314702 1172 raft_consensus.cc:385] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.314757 1172 raft_consensus.cc:740] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.315019 1172 consensus_queue.cc:260] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.315150 1898 leader_election.cc:290] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.315544 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e55be5f28740fba65c1199a571d97a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:16.316074 851 leader_election.cc:343] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 92e55be5f28740fba65c1199a571d97a
W20260617 07:53:16.316190 852 leader_election.cc:343] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.316299 852 leader_election.cc:304] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.316515 1898 raft_consensus.cc:2749] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.321283 1171 tablet_bootstrap.cc:492] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.321506 1171 ts_tablet_manager.cc:1403] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.002s
I20260617 07:53:16.321852 1172 ts_tablet_manager.cc:1434] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260617 07:53:16.323035 1171 raft_consensus.cc:359] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.323246 1171 raft_consensus.cc:385] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.323345 1171 raft_consensus.cc:740] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.323596 1171 consensus_queue.cc:260] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.324142 1171 ts_tablet_manager.cc:1434] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:16.325551 1172 tablet_bootstrap.cc:492] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:16.328258 1846 ts_tablet_manager.cc:1929] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.328356 1171 tablet_bootstrap.cc:492] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.328454 1846 log.cc:1199] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/28e1fd7f91f94221884be2166f0cc793
I20260617 07:53:16.328824 1846 ts_tablet_manager.cc:1950] T 28e1fd7f91f94221884be2166f0cc793 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.329641 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 63) took 4603 ms. Trace:
I20260617 07:53:16.330057 1171 tablet_bootstrap.cc:654] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.330003 2125 raft_consensus.cc:493] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.333160 2125 raft_consensus.cc:515] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.333775 2125 leader_election.cc:290] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:16.334507 713 leader_election.cc:343] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: cb95639e16ed423fbe60b15a1bcdf5a6
W20260617 07:53:16.334688 716 leader_election.cc:343] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: cb95639e16ed423fbe60b15a1bcdf5a6
I20260617 07:53:16.334793 716 leader_election.cc:304] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.335193 2125 raft_consensus.cc:2749] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.335358 1846 rpcz_store.cc:276] 0617 07:53:11.726345 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.726869 (+ 524us) service_pool.cc:224] Handling call
0617 07:53:16.276851 (+4549982us) ts_tablet_manager.cc:1151] Deleting tablet 28e1fd7f91f94221884be2166f0cc793
0617 07:53:16.276863 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.311375 (+ 34512us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.328196 (+ 16821us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.329621 (+ 1425us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4520526}
I20260617 07:53:16.336143 1862 ts_tablet_manager.cc:1929] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.336263 1862 log.cc:1199] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/de030009192748118b388eec555d90da
I20260617 07:53:16.336613 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 28e1fd7f91f94221884be2166f0cc793 (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]) successfully deleted
I20260617 07:53:16.336670 1846 tablet_replica.cc:333] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:16.336725 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3b87923865964ae78caae0e8d9231e27" } modify_external_catalogs: true
I20260617 07:53:16.336855 1846 raft_consensus.cc:2243] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.336910 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3b87923865964ae78caae0e8d9231e27" } modify_external_catalogs: true
I20260617 07:53:16.337005 1846 raft_consensus.cc:2272] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.338217 1846 ts_tablet_manager.cc:1916] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.340026 1862 ts_tablet_manager.cc:1950] T de030009192748118b388eec555d90da P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.340323 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 141) took 3058 ms. Trace:
I20260617 07:53:16.340409 1862 rpcz_store.cc:276] 0617 07:53:13.282194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.285769 (+ 3575us) service_pool.cc:224] Handling call
0617 07:53:16.303396 (+3017627us) ts_tablet_manager.cc:1151] Deleting tablet de030009192748118b388eec555d90da
0617 07:53:16.303405 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.307421 (+ 4016us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.336066 (+ 28645us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.340307 (+ 4241us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3017462}
I20260617 07:53:16.340788 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet de030009192748118b388eec555d90da (table default.Table_a562036b19dd4c99a8981180a617b865 [id=22c75406c0674d11b3f9fd39af55cca8]) successfully deleted
I20260617 07:53:16.346319 1862 tablet_replica.cc:333] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.346549 1862 raft_consensus.cc:2243] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.346706 1862 raft_consensus.cc:2272] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.347194 1862 ts_tablet_manager.cc:1916] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.350630 1170 ts_tablet_manager.cc:1929] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.351258 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:16.351668 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:16.352814 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_871f52a414934a248bcacbe3399ccee8 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 2 got 0
I20260617 07:53:16.353101 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:16.353324 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_f86c4a5d30d546a890795712293d1a2f [id=b20987ff1f1c43098b1408b126b32913]). Expected version 2 got 0
I20260617 07:53:16.353400 1178 tablet_bootstrap.cc:492] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:16.353751 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:16.354023 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:16.354568 1846 ts_tablet_manager.cc:1929] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260617 07:53:16.354630 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:16.355070 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:16.355172 1171 tablet_bootstrap.cc:492] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.355347 1171 ts_tablet_manager.cc:1403] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260617 07:53:16.355566 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:16.356082 1171 raft_consensus.cc:359] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.356307 1171 raft_consensus.cc:385] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.356406 1171 raft_consensus.cc:740] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.356662 1171 consensus_queue.cc:260] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.357242 1171 ts_tablet_manager.cc:1434] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:16.357514 1171 tablet_bootstrap.cc:492] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.357607 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:16.357940 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:16.358397 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:16.357620 1170 log.cc:1199] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/53108a2d6c8b4398a568c14df8e0a23e
I20260617 07:53:16.360122 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]). Expected version 3 got 0
I20260617 07:53:16.360441 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_a18dfbacf2d34929b9fd021add13fd7e [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 2 got 0
I20260617 07:53:16.361227 1846 log.cc:1199] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/df705c2300064db680bec1fefab08d2f
I20260617 07:53:16.361670 1171 tablet_bootstrap.cc:654] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.361778 1846 ts_tablet_manager.cc:1950] T df705c2300064db680bec1fefab08d2f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.362636 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 102) took 4615 ms. Trace:
I20260617 07:53:16.362869 1846 rpcz_store.cc:276] 0617 07:53:11.747585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.756319 (+ 8734us) service_pool.cc:224] Handling call
0617 07:53:16.336614 (+4580295us) ts_tablet_manager.cc:1151] Deleting tablet df705c2300064db680bec1fefab08d2f
0617 07:53:16.336627 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.343585 (+ 6958us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.354509 (+ 10924us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.362616 (+ 8107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4580121}
I20260617 07:53:16.363433 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 103) took 4615 ms. Trace:
I20260617 07:53:16.363564 1846 rpcz_store.cc:276] 0617 07:53:11.747720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.756532 (+ 8812us) service_pool.cc:224] Handling call
0617 07:53:16.363325 (+4606793us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:16.363334 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.363420 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4606634}
I20260617 07:53:16.363518 1170 ts_tablet_manager.cc:1950] T 53108a2d6c8b4398a568c14df8e0a23e P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:16.364049 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 96) took 4616 ms. Trace:
I20260617 07:53:16.364161 1846 rpcz_store.cc:276] 0617 07:53:11.747146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.755249 (+ 8103us) service_pool.cc:224] Handling call
0617 07:53:16.363965 (+4608716us) ts_tablet_manager.cc:1151] Deleting tablet a82e4d6c09bb4414ad7f3b760f7ae681
0617 07:53:16.363972 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.364038 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4607174}
I20260617 07:53:16.364538 1846 tablet_replica.cc:333] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:16.364746 1846 raft_consensus.cc:2243] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:16.364881 1862 ts_tablet_manager.cc:1929] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.364987 1862 log.cc:1199] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/92e55be5f28740fba65c1199a571d97a
I20260617 07:53:16.365128 1846 pending_rounds.cc:70] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: Trying to abort 1 pending ops.
I20260617 07:53:16.365204 1846 pending_rounds.cc:77] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772709365907456 op_type: NO_OP noop_request { }
I20260617 07:53:16.365265 1862 ts_tablet_manager.cc:1950] T 92e55be5f28740fba65c1199a571d97a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.365376 1846 raft_consensus.cc:2889] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:16.365551 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 143) took 3078 ms. Trace:
I20260617 07:53:16.365635 1862 rpcz_store.cc:276] 0617 07:53:13.286641 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.286741 (+ 100us) service_pool.cc:224] Handling call
0617 07:53:16.346268 (+3059527us) ts_tablet_manager.cc:1151] Deleting tablet 92e55be5f28740fba65c1199a571d97a
0617 07:53:16.346278 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.349971 (+ 3693us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.364832 (+ 14861us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.365535 (+ 703us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3059367}
I20260617 07:53:16.365767 1846 raft_consensus.cc:2272] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.363343 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet df705c2300064db680bec1fefab08d2f (table default.Table_5d59656f1cf74e4dbea879fb08583021 [id=e6636bb52b0b42028b8a92ebeee0a41d]) successfully deleted
I20260617 07:53:16.366030 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 92e55be5f28740fba65c1199a571d97a (table default.Table_93a6fb533319471aa6c304e5fe867477 [id=061cdaef8556415dad01eccb24949518]) successfully deleted
W20260617 07:53:16.366173 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a02dbb70eec84932917ef282fdae0bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a02dbb70eec84932917ef282fdae0bd7 already in progress: creating tablet
W20260617 07:53:16.366430 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a82e4d6c09bb4414ad7f3b760f7ae681 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a82e4d6c09bb4414ad7f3b760f7ae681 already in progress: creating tablet
I20260617 07:53:16.366829 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_8dd1d9e74c1245e1afe42a16f20e57f6 [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 3 got 0
I20260617 07:53:16.367164 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ca400838f5214d1a8f57e72c5068f0f9 (table default.Table_1a37fbbe9740440a8c245559a94b7f5f [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]). Expected version 1 got 0
I20260617 07:53:16.367617 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:16.368101 1178 tablet_bootstrap.cc:654] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.369179 1846 ts_tablet_manager.cc:1916] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.369593 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 2 got 0
I20260617 07:53:16.369978 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:16.370455 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:16.370730 1862 tablet_replica.cc:333] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.371279 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:16.374434 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 163) took 2929 ms. Trace:
I20260617 07:53:16.374537 1170 rpcz_store.cc:276] 0617 07:53:13.444801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.458608 (+ 13807us) service_pool.cc:224] Handling call
0617 07:53:16.170719 (+2712111us) ts_tablet_manager.cc:1151] Deleting tablet 53108a2d6c8b4398a568c14df8e0a23e
0617 07:53:16.170728 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.253787 (+ 83059us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.350336 (+ 96549us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.374397 (+ 24061us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2711749}
I20260617 07:53:16.374823 1862 raft_consensus.cc:2243] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:16.375319 1862 raft_consensus.cc:2272] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.371737 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9937bd83b783442697ef53db3d660fb4" } new_table_name: "default.Table_cab8bc4d921c47a2a986f4c3187d34c9" modify_external_catalogs: true
I20260617 07:53:16.374994 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 53108a2d6c8b4398a568c14df8e0a23e (table default.Table_c3ea195c67814080b1221735affcde43 [id=b5b61c6c229d40ac9e489d535a5b38f8]) successfully deleted
I20260617 07:53:16.377976 1172 tablet_bootstrap.cc:654] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.378626 1862 ts_tablet_manager.cc:1916] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.378821 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
I20260617 07:53:16.379159 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_0e7fa8cb8a9b49cb8ec27a4eef4a7d39 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 1 got 0
I20260617 07:53:16.379349 1171 tablet_bootstrap.cc:492] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.379526 1171 ts_tablet_manager.cc:1403] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20260617 07:53:16.379825 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (table default.Table_78c4ad680e8849b18da7d278b7ecaf51 [id=494c90461b61486ab6dad26bbd3acab5]). Expected version 1 got 0
I20260617 07:53:16.380224 1171 raft_consensus.cc:359] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.380450 1171 raft_consensus.cc:385] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.380537 1171 raft_consensus.cc:740] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.380542 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]). Expected version 1 got 0
I20260617 07:53:16.380764 1171 consensus_queue.cc:260] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.381183 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a4a35e3b7bb74667aa498c58a856cacc (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 2 got 0
I20260617 07:53:16.381217 1171 ts_tablet_manager.cc:1434] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:16.382110 1178 tablet_bootstrap.cc:492] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:16.382242 1178 ts_tablet_manager.cc:1403] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.005s
I20260617 07:53:16.382535 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
I20260617 07:53:16.382899 1178 raft_consensus.cc:359] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.383060 1178 raft_consensus.cc:385] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.383124 1178 raft_consensus.cc:740] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.383365 1178 consensus_queue.cc:260] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.383772 1171 tablet_bootstrap.cc:492] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.385308 1171 tablet_bootstrap.cc:654] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.387290 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet b62ae096bfd347029ef8d7f0462dd111 (table default.Table_832c0052f588434faa10b821b4d09514 [id=4336b6e42a2b4c2d86fc98c56990bc8e]). Expected version 1 got 0
I20260617 07:53:16.389467 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]). Expected version 1 got 0
I20260617 07:53:16.391739 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]). Expected version 3 got 0
I20260617 07:53:16.392328 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:16.392786 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:16.393383 1178 ts_tablet_manager.cc:1434] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260617 07:53:16.393230 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:16.394717 1178 tablet_bootstrap.cc:492] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:16.395119 827 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:16.396394 1178 tablet_bootstrap.cc:654] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.399299 1846 ts_tablet_manager.cc:1929] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.399395 1846 log.cc:1199] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/5203534569bd4da18bc06751f094735f
I20260617 07:53:16.399715 1846 ts_tablet_manager.cc:1950] T 5203534569bd4da18bc06751f094735f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.401788 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 164) took 2942 ms. Trace:
I20260617 07:53:16.401881 1170 rpcz_store.cc:276] 0617 07:53:13.459207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.459258 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:16.401614 (+2942356us) ts_tablet_manager.cc:1151] Deleting tablet 4d9ace137c4e496fafac4e729718577f
0617 07:53:16.401627 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.401765 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2926961}
I20260617 07:53:16.402393 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 165) took 2942 ms. Trace:
W20260617 07:53:16.402434 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4d9ace137c4e496fafac4e729718577f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9ace137c4e496fafac4e729718577f already in progress: creating tablet
I20260617 07:53:16.402477 1170 rpcz_store.cc:276] 0617 07:53:13.460295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.460334 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:16.402298 (+2941964us) ts_tablet_manager.cc:1151] Deleting tablet cb95639e16ed423fbe60b15a1bcdf5a6
0617 07:53:16.402307 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.402376 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2941748}
W20260617 07:53:16.402851 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet cb95639e16ed423fbe60b15a1bcdf5a6 because the tablet was not found. No further retry: Not found: Tablet not found: cb95639e16ed423fbe60b15a1bcdf5a6
I20260617 07:53:16.402927 1170 tablet_replica.cc:333] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:16.403554 1170 raft_consensus.cc:2243] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.403820 1170 raft_consensus.cc:2272] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.404572 2260 raft_consensus.cc:493] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.404681 2260 raft_consensus.cc:515] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.405236 2260 leader_election.cc:290] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:16.405906 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233cae2480ed457bbab22ead8c0bde2c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:16.406459 988 leader_election.cc:343] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.407148 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233cae2480ed457bbab22ead8c0bde2c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:16.407860 986 leader_election.cc:343] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.407974 986 leader_election.cc:304] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:16.408627 2260 raft_consensus.cc:2749] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.414989 1170 ts_tablet_manager.cc:1916] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.415408 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 104) took 4667 ms. Trace:
I20260617 07:53:16.415588 1846 rpcz_store.cc:276] 0617 07:53:11.747820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.756709 (+ 8889us) service_pool.cc:224] Handling call
0617 07:53:16.364488 (+4607779us) ts_tablet_manager.cc:1151] Deleting tablet 5203534569bd4da18bc06751f094735f
0617 07:53:16.364496 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.372048 (+ 7552us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.399247 (+ 27199us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.415387 (+ 16140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4607626}
I20260617 07:53:16.416070 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 5203534569bd4da18bc06751f094735f (table default.Table_9e10117b19d649668289e1ad8374ff7d [id=77f9a3f7e2e441b888caf756936d7ee5]) successfully deleted
I20260617 07:53:16.416173 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 105) took 4668 ms. Trace:
I20260617 07:53:16.416244 1846 rpcz_store.cc:276] 0617 07:53:11.747958 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.756811 (+ 8853us) service_pool.cc:224] Handling call
0617 07:53:16.416057 (+4659246us) ts_tablet_manager.cc:1151] Deleting tablet d03d6dc473fc4be1a436fd71a06f403e
0617 07:53:16.416068 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.416159 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4659081}
W20260617 07:53:16.416600 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d03d6dc473fc4be1a436fd71a06f403e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d03d6dc473fc4be1a436fd71a06f403e already in progress: creating tablet
I20260617 07:53:16.416661 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 106) took 4668 ms. Trace:
I20260617 07:53:16.416723 1846 rpcz_store.cc:276] 0617 07:53:11.748043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.756880 (+ 8837us) service_pool.cc:224] Handling call
0617 07:53:16.416570 (+4659690us) ts_tablet_manager.cc:1151] Deleting tablet 3fcf87953dc14bf190ac74101547e52f
0617 07:53:16.416581 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.416648 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4659527}
I20260617 07:53:16.417140 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 107) took 4669 ms. Trace:
I20260617 07:53:16.417201 1846 rpcz_store.cc:276] 0617 07:53:11.748116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.756984 (+ 8868us) service_pool.cc:224] Handling call
0617 07:53:16.417051 (+4660067us) ts_tablet_manager.cc:1151] Deleting tablet 98f7c3f6260c4db690de1a5081bb2493
0617 07:53:16.417060 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.417124 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4659932}
I20260617 07:53:16.417654 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 73) took 4689 ms. Trace:
I20260617 07:53:16.417744 1846 rpcz_store.cc:276] 0617 07:53:11.728127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.728792 (+ 665us) service_pool.cc:224] Handling call
0617 07:53:16.417568 (+4688776us) ts_tablet_manager.cc:1151] Deleting tablet 8a4f81daf583464e988521e189ca39b6
0617 07:53:16.417577 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.417640 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4660354}
W20260617 07:53:16.417936 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3fcf87953dc14bf190ac74101547e52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcf87953dc14bf190ac74101547e52f already in progress: creating tablet
W20260617 07:53:16.418197 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
W20260617 07:53:16.418612 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
I20260617 07:53:16.419553 1172 tablet_bootstrap.cc:492] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:16.419916 1172 ts_tablet_manager.cc:1403] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.095s user 0.001s sys 0.004s
I20260617 07:53:16.419934 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 71) took 4692 ms. Trace:
I20260617 07:53:16.420277 1846 rpcz_store.cc:276] 0617 07:53:11.727881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.728753 (+ 872us) service_pool.cc:224] Handling call
0617 07:53:16.419799 (+4691046us) ts_tablet_manager.cc:1151] Deleting tablet be14a95f458d440e86133ef65c484571
0617 07:53:16.419814 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.419913 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4661234}
I20260617 07:53:16.420691 1172 raft_consensus.cc:359] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.420867 1172 raft_consensus.cc:385] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.420935 1172 raft_consensus.cc:740] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:16.421203 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet be14a95f458d440e86133ef65c484571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be14a95f458d440e86133ef65c484571 already in progress: creating tablet
I20260617 07:53:16.421360 1172 consensus_queue.cc:260] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.421612 1846 tablet_replica.cc:333] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:16.422029 1846 raft_consensus.cc:2243] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.422490 1846 raft_consensus.cc:2272] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.423870 1846 ts_tablet_manager.cc:1916] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.425098 1172 ts_tablet_manager.cc:1434] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:16.425859 1898 raft_consensus.cc:493] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc3bec007846459a9da0c7b8211e477b)
I20260617 07:53:16.426048 1898 raft_consensus.cc:515] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.426533 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:16.426640 1898 leader_election.cc:290] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.427096 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:16.427292 1046 raft_consensus.cc:2468] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 2.
I20260617 07:53:16.427783 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.428030 773 raft_consensus.cc:2393] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b7080d37ca245fe914d3dc90f17e3ba in current term 2: Already voted for candidate 6438857e0a7741ceaadf84cb9dc979e7 in this term.
I20260617 07:53:16.428718 2260 raft_consensus.cc:493] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.428854 2260 raft_consensus.cc:515] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.429616 2260 leader_election.cc:290] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:16.429878 851 leader_election.cc:304] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:16.430100 2086 raft_consensus.cc:2804] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 07:53:16.430159 2086 raft_consensus.cc:493] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc3bec007846459a9da0c7b8211e477b)
I20260617 07:53:16.430218 2086 raft_consensus.cc:3060] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:16.432650 2086 raft_consensus.cc:515] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.433182 2086 leader_election.cc:290] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.433840 1172 tablet_bootstrap.cc:492] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:16.435115 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2777cf575a914f59b3459f3ce96f5d9a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:16.435582 986 leader_election.cc:343] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.436677 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:16.439332 1862 ts_tablet_manager.cc:1929] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.439432 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2777cf575a914f59b3459f3ce96f5d9a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:16.440209 988 leader_election.cc:343] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.440191 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5f6a0bf3624c8eaefee902a46b9d9f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:16.440328 988 leader_election.cc:304] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:16.440405 773 raft_consensus.cc:2393] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b7080d37ca245fe914d3dc90f17e3ba in current term 2: Already voted for candidate 6438857e0a7741ceaadf84cb9dc979e7 in this term.
I20260617 07:53:16.443691 1171 tablet_bootstrap.cc:492] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.443810 1171 ts_tablet_manager.cc:1403] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.060s user 0.007s sys 0.000s
I20260617 07:53:16.444481 1171 raft_consensus.cc:359] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.444630 1171 raft_consensus.cc:385] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.444674 1171 raft_consensus.cc:740] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.444882 1171 consensus_queue.cc:260] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.445576 1171 ts_tablet_manager.cc:1434] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:16.445648 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 979087485af94e159d3d0f2cb873899e (table default.Table_5238d7f8a8b649df9298e622257465f5 [id=7a23152402da4e608156935807a7b61b]). Expected version 1 got 0
I20260617 07:53:16.445876 1171 tablet_bootstrap.cc:492] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.445888 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:16.446048 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:16.446487 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e5544753b3144c1989f2ed99bffc2246 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:16.446839 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:16.447125 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]). Expected version 2 got 0
I20260617 07:53:16.447228 1046 raft_consensus.cc:2468] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 2.
I20260617 07:53:16.447388 1171 tablet_bootstrap.cc:654] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.452476 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_89bce7ee0b534345bafee7f0af6358e6" } new_table_name: "default.Table_c1a736945bdc4725b14eb4db56fa777d" modify_external_catalogs: true
I20260617 07:53:16.457861 1862 log.cc:1199] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/53108a2d6c8b4398a568c14df8e0a23e
I20260617 07:53:16.458297 1862 ts_tablet_manager.cc:1950] T 53108a2d6c8b4398a568c14df8e0a23e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.459237 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 144) took 3172 ms. Trace:
I20260617 07:53:16.459342 1862 rpcz_store.cc:276] 0617 07:53:13.286709 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.286925 (+ 216us) service_pool.cc:224] Handling call
0617 07:53:16.370680 (+3083755us) ts_tablet_manager.cc:1151] Deleting tablet 53108a2d6c8b4398a568c14df8e0a23e
0617 07:53:16.370690 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.411529 (+ 40839us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.439278 (+ 27749us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.459211 (+ 19933us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3083579}
I20260617 07:53:16.459774 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 53108a2d6c8b4398a568c14df8e0a23e (table default.Table_c3ea195c67814080b1221735affcde43 [id=b5b61c6c229d40ac9e489d535a5b38f8]) successfully deleted
I20260617 07:53:16.461124 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 145) took 3173 ms. Trace:
I20260617 07:53:16.461202 1862 rpcz_store.cc:276] 0617 07:53:13.287200 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.287234 (+ 34us) service_pool.cc:224] Handling call
0617 07:53:16.461006 (+3173772us) ts_tablet_manager.cc:1151] Deleting tablet 4d9ace137c4e496fafac4e729718577f
0617 07:53:16.461016 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.461106 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3173613}
I20260617 07:53:16.461587 1862 tablet_replica.cc:333] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.461781 1862 raft_consensus.cc:2243] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:16.462067 1862 raft_consensus.cc:2272] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:16.463158 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4d9ace137c4e496fafac4e729718577f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9ace137c4e496fafac4e729718577f already in progress: creating tablet
I20260617 07:53:16.467991 1178 tablet_bootstrap.cc:492] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:16.468122 1178 ts_tablet_manager.cc:1403] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.074s user 0.006s sys 0.000s
I20260617 07:53:16.468183 1862 ts_tablet_manager.cc:1916] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.468806 1178 raft_consensus.cc:359] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.468979 1178 raft_consensus.cc:385] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.469022 1178 raft_consensus.cc:740] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.469193 1178 consensus_queue.cc:260] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.469591 1178 ts_tablet_manager.cc:1434] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 07:53:16.470084 1178 tablet_bootstrap.cc:492] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:16.471796 1178 tablet_bootstrap.cc:654] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.476976 1846 ts_tablet_manager.cc:1929] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.477175 1846 log.cc:1199] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/0c21efcad98348ebabcee4821dc4682e
I20260617 07:53:16.479588 1846 ts_tablet_manager.cc:1950] T 0c21efcad98348ebabcee4821dc4682e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.483899 1171 tablet_bootstrap.cc:492] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.483906 2260 raft_consensus.cc:2749] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:16.484185 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 43985.1us
I20260617 07:53:16.484774 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 76) took 4756 ms. Trace:
I20260617 07:53:16.484887 1846 rpcz_store.cc:276] 0617 07:53:11.728404 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.729670 (+ 1266us) service_pool.cc:224] Handling call
0617 07:53:16.421551 (+4691881us) ts_tablet_manager.cc:1151] Deleting tablet 0c21efcad98348ebabcee4821dc4682e
0617 07:53:16.421565 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.466036 (+ 44471us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.476918 (+ 10882us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.484755 (+ 7837us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4663688}
I20260617 07:53:16.485368 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 0c21efcad98348ebabcee4821dc4682e (table default.Table_754536afb14d459c82f275ef52707a7f [id=878537b828364bd29c9b6c93591acea6]) successfully deleted
I20260617 07:53:16.485538 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 101) took 4737 ms. Trace:
I20260617 07:53:16.485672 1846 rpcz_store.cc:276] 0617 07:53:11.747512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.755995 (+ 8483us) service_pool.cc:224] Handling call
0617 07:53:16.485361 (+4729366us) ts_tablet_manager.cc:1151] Deleting tablet 0cfb98aecc4546c88371436fcfbf8e86
0617 07:53:16.485370 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.485462 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4727666}
I20260617 07:53:16.486176 1846 tablet_replica.cc:333] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:16.486184 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0cfb98aecc4546c88371436fcfbf8e86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cfb98aecc4546c88371436fcfbf8e86 already in progress: creating tablet
I20260617 07:53:16.486454 1846 raft_consensus.cc:2243] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.486644 1846 raft_consensus.cc:2272] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.487183 1846 ts_tablet_manager.cc:1916] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.487370 1171 ts_tablet_manager.cc:1403] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.000s
I20260617 07:53:16.488093 1171 raft_consensus.cc:359] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.488235 1171 raft_consensus.cc:385] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.488276 1171 raft_consensus.cc:740] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.488567 1171 consensus_queue.cc:260] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.489084 1171 ts_tablet_manager.cc:1434] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:16.489106 851 leader_election.cc:304] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:16.489552 1171 tablet_bootstrap.cc:492] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.489647 2086 raft_consensus.cc:2804] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 2 FOLLOWER]: Leader election won for term 2
I20260617 07:53:16.489763 2086 raft_consensus.cc:697] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [term 2 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:16.490090 2086 consensus_queue.cc:237] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.491200 1172 tablet_bootstrap.cc:654] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.491268 1171 tablet_bootstrap.cc:654] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.491401 965 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:16.495064 1862 ts_tablet_manager.cc:1929] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.495167 1862 log.cc:1199] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/706373f1f5d44edf81ed04183a8bdf89
I20260617 07:53:16.495525 1862 ts_tablet_manager.cc:1950] T 706373f1f5d44edf81ed04183a8bdf89 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.495832 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 153) took 3032 ms. Trace:
I20260617 07:53:16.495914 1862 rpcz_store.cc:276] 0617 07:53:13.463454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.465421 (+ 1967us) service_pool.cc:224] Handling call
0617 07:53:16.461545 (+2996124us) ts_tablet_manager.cc:1151] Deleting tablet 706373f1f5d44edf81ed04183a8bdf89
0617 07:53:16.461553 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.490979 (+ 29426us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.495017 (+ 4038us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.495818 (+ 801us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2995887}
I20260617 07:53:16.496340 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]) successfully deleted
I20260617 07:53:16.497471 1172 tablet_bootstrap.cc:492] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:16.499084 1862 tablet_replica.cc:333] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.499260 1862 raft_consensus.cc:2243] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.499415 1862 raft_consensus.cc:2272] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.499915 1862 ts_tablet_manager.cc:1916] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.500008 1178 tablet_bootstrap.cc:492] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:16.500128 1178 ts_tablet_manager.cc:1403] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.003s
I20260617 07:53:16.501760 1178 raft_consensus.cc:359] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.501940 1178 raft_consensus.cc:385] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.502004 1178 raft_consensus.cc:740] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.502199 1178 consensus_queue.cc:260] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.502689 1178 ts_tablet_manager.cc:1434] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:16.502970 1178 tablet_bootstrap.cc:492] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:16.498588 1172 ts_tablet_manager.cc:1403] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.000s
I20260617 07:53:16.510306 1862 ts_tablet_manager.cc:1929] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.510419 1862 log.cc:1199] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/7934f5fa0287427cb45fe568f0de8758
I20260617 07:53:16.510784 1862 ts_tablet_manager.cc:1950] T 7934f5fa0287427cb45fe568f0de8758 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.511108 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 154) took 3036 ms. Trace:
I20260617 07:53:16.511193 1862 rpcz_store.cc:276] 0617 07:53:13.475027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.476508 (+ 1481us) service_pool.cc:224] Handling call
0617 07:53:16.499036 (+3022528us) ts_tablet_manager.cc:1151] Deleting tablet 7934f5fa0287427cb45fe568f0de8758
0617 07:53:16.499046 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.507425 (+ 8379us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.510253 (+ 2828us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.511090 (+ 837us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3022312}
I20260617 07:53:16.511641 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]) successfully deleted
I20260617 07:53:16.512141 1171 tablet_bootstrap.cc:492] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.512306 1171 ts_tablet_manager.cc:1403] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.001s
I20260617 07:53:16.513022 1171 raft_consensus.cc:359] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.513288 1171 raft_consensus.cc:385] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.513396 1171 raft_consensus.cc:740] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.513679 1171 consensus_queue.cc:260] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.514477 1171 ts_tablet_manager.cc:1434] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:16.514882 1171 tablet_bootstrap.cc:492] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.514604 1178 tablet_bootstrap.cc:654] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.514719 1172 raft_consensus.cc:359] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.516585 1171 tablet_bootstrap.cc:654] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.516047 1172 raft_consensus.cc:385] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.516697 1172 raft_consensus.cc:740] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.520393 1846 ts_tablet_manager.cc:1929] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.520691 1846 log.cc:1199] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/89783bab2e584fe9a8eda963f78bf3ec
I20260617 07:53:16.522275 1170 ts_tablet_manager.cc:1929] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.522372 1170 log.cc:1199] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/706373f1f5d44edf81ed04183a8bdf89
I20260617 07:53:16.522689 1170 ts_tablet_manager.cc:1950] T 706373f1f5d44edf81ed04183a8bdf89 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:16.522900 1846 ts_tablet_manager.cc:1950] T 89783bab2e584fe9a8eda963f78bf3ec P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.523453 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 166) took 3055 ms. Trace:
I20260617 07:53:16.523540 1170 rpcz_store.cc:276] 0617 07:53:13.467577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.467938 (+ 361us) service_pool.cc:224] Handling call
0617 07:53:16.402852 (+2934914us) ts_tablet_manager.cc:1151] Deleting tablet 706373f1f5d44edf81ed04183a8bdf89
0617 07:53:16.402859 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.479766 (+ 76907us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.522219 (+ 42453us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.523433 (+ 1214us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2934670}
I20260617 07:53:16.524013 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]) successfully deleted
I20260617 07:53:16.524519 1172 consensus_queue.cc:260] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.525867 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 70) took 4798 ms. Trace:
I20260617 07:53:16.525997 1846 rpcz_store.cc:276] 0617 07:53:11.727784 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.728734 (+ 950us) service_pool.cc:224] Handling call
0617 07:53:16.486134 (+4757400us) ts_tablet_manager.cc:1151] Deleting tablet 89783bab2e584fe9a8eda963f78bf3ec
0617 07:53:16.486144 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.501621 (+ 15477us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.520338 (+ 18717us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.525849 (+ 5511us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4728156}
I20260617 07:53:16.526510 1846 tablet_replica.cc:333] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:16.526749 1846 raft_consensus.cc:2243] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.526942 1846 raft_consensus.cc:2272] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.527405 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 89783bab2e584fe9a8eda963f78bf3ec (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]) successfully deleted
I20260617 07:53:16.527645 1846 ts_tablet_manager.cc:1916] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.528566 2280 log.cc:826] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Log is configured to *not* fsync() on all Append() calls
I20260617 07:53:16.520828 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 155) took 2964 ms. Trace:
I20260617 07:53:16.532021 1862 rpcz_store.cc:276] 0617 07:53:13.556682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.556761 (+ 79us) service_pool.cc:224] Handling call
0617 07:53:16.520699 (+2963938us) ts_tablet_manager.cc:1151] Deleting tablet df5224716de249e9be9d7239407579a9
0617 07:53:16.520708 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.520809 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2823527}
I20260617 07:53:16.532594 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 156) took 2968 ms. Trace:
W20260617 07:53:16.532683 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet df5224716de249e9be9d7239407579a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df5224716de249e9be9d7239407579a9 already in progress: creating tablet
I20260617 07:53:16.532738 1862 rpcz_store.cc:276] 0617 07:53:13.563817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.563888 (+ 71us) service_pool.cc:224] Handling call
0617 07:53:16.532466 (+2968578us) ts_tablet_manager.cc:1151] Deleting tablet 9618a5c0c9dd4c368f5763c434f70da5
0617 07:53:16.532478 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.532576 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2835187}
W20260617 07:53:16.533293 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 9618a5c0c9dd4c368f5763c434f70da5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9618a5c0c9dd4c368f5763c434f70da5 already in progress: creating tablet
I20260617 07:53:16.533514 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 161) took 2826 ms. Trace:
I20260617 07:53:16.533581 1862 rpcz_store.cc:276] 0617 07:53:13.707091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.707833 (+ 742us) service_pool.cc:224] Handling call
0617 07:53:16.533362 (+2825529us) ts_tablet_manager.cc:1151] Deleting tablet d965aa4e8dc244cdb93dd15cdee9070c
0617 07:53:16.533371 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.533496 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2825329}
I20260617 07:53:16.534090 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 162) took 2800 ms. Trace:
I20260617 07:53:16.534162 1862 rpcz_store.cc:276] 0617 07:53:13.734057 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.734111 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:16.533958 (+2799847us) ts_tablet_manager.cc:1151] Deleting tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1
0617 07:53:16.534009 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.534076 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2799685}
I20260617 07:53:16.534602 1862 tablet_replica.cc:333] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.534770 1862 raft_consensus.cc:2243] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:16.535050 1862 raft_consensus.cc:2272] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.535625 1862 ts_tablet_manager.cc:1916] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:16.536489 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d965aa4e8dc244cdb93dd15cdee9070c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d965aa4e8dc244cdb93dd15cdee9070c already in progress: creating tablet
W20260617 07:53:16.536746 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 already in progress: creating tablet
I20260617 07:53:16.539603 1172 ts_tablet_manager.cc:1434] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20260617 07:53:16.541654 1862 ts_tablet_manager.cc:1929] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.542850 1862 log.cc:1199] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/b7c5ff28367b42d3a3922d2b789bc7ec
I20260617 07:53:16.543578 1846 ts_tablet_manager.cc:1929] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.543741 1846 log.cc:1199] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/69996eb4ab6e40f9b2d97e00d766822a
I20260617 07:53:16.544121 1846 ts_tablet_manager.cc:1950] T 69996eb4ab6e40f9b2d97e00d766822a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.544827 1862 ts_tablet_manager.cc:1950] T b7c5ff28367b42d3a3922d2b789bc7ec P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.546924 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 163) took 2803 ms. Trace:
I20260617 07:53:16.547015 1862 rpcz_store.cc:276] 0617 07:53:13.743210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.743265 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:16.534562 (+2791297us) ts_tablet_manager.cc:1151] Deleting tablet b7c5ff28367b42d3a3922d2b789bc7ec
0617 07:53:16.534570 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.538782 (+ 4212us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.541607 (+ 2825us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.546905 (+ 5298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2791121}
I20260617 07:53:16.547492 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet b7c5ff28367b42d3a3922d2b789bc7ec (table default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3 [id=d079dbab725b43c0807868020b551ccb]) successfully deleted
I20260617 07:53:16.548400 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 68) took 4820 ms. Trace:
I20260617 07:53:16.549487 1171 tablet_bootstrap.cc:492] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.549834 1171 ts_tablet_manager.cc:1403] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.002s
I20260617 07:53:16.549759 1846 rpcz_store.cc:276] 0617 07:53:11.727566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.728693 (+ 1127us) service_pool.cc:224] Handling call
0617 07:53:16.526463 (+4797770us) ts_tablet_manager.cc:1151] Deleting tablet 69996eb4ab6e40f9b2d97e00d766822a
0617 07:53:16.526472 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.536706 (+ 10234us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.543514 (+ 6808us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.548378 (+ 4864us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4768339}
I20260617 07:53:16.550277 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 69996eb4ab6e40f9b2d97e00d766822a (table default.Table_0e8fe92eb0e14e9ea3e8b68b977f1690 [id=f7bea6866b9845f1a116293b182de7bc]) successfully deleted
I20260617 07:53:16.550455 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 67) took 4823 ms. Trace:
I20260617 07:53:16.550576 1846 rpcz_store.cc:276] 0617 07:53:11.727412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.728667 (+ 1255us) service_pool.cc:224] Handling call
0617 07:53:16.550270 (+4821603us) ts_tablet_manager.cc:1151] Deleting tablet 2f8cd6ff8fa44536acdd84a107ab1525
0617 07:53:16.550281 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.550436 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4785489}
I20260617 07:53:16.550685 1171 raft_consensus.cc:359] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.550899 1171 raft_consensus.cc:385] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.551000 1171 raft_consensus.cc:740] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.551070 1846 tablet_replica.cc:333] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:16.551287 1846 raft_consensus.cc:2243] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.551316 1171 consensus_queue.cc:260] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:16.551477 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
I20260617 07:53:16.551802 1846 raft_consensus.cc:2272] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.552584 1846 ts_tablet_manager.cc:1916] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.552822 1172 tablet_bootstrap.cc:492] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:16.553412 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 165) took 2754 ms. Trace:
I20260617 07:53:16.553496 1862 rpcz_store.cc:276] 0617 07:53:13.798559 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.798605 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:16.553315 (+2754710us) ts_tablet_manager.cc:1151] Deleting tablet d7309d2b22c849ce980fd263a29ac77f
0617 07:53:16.553325 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.553392 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2754538}
W20260617 07:53:16.553932 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d7309d2b22c849ce980fd263a29ac77f because the tablet was not found. No further retry: Not found: Tablet not found: d7309d2b22c849ce980fd263a29ac77f
I20260617 07:53:16.554018 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 166) took 2755 ms. Trace:
I20260617 07:53:16.554314 2086 raft_consensus.cc:493] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.554440 2086 raft_consensus.cc:515] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.555034 2086 leader_election.cc:290] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.555701 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a632b42300d64471b516008ebca3312f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:16.555879 1046 raft_consensus.cc:2468] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:16.556459 1170 tablet_replica.cc:333] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:16.556877 851 leader_election.cc:304] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:16.557199 2086 raft_consensus.cc:2804] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:16.557274 2086 raft_consensus.cc:493] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:16.557332 2086 raft_consensus.cc:3060] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.557752 1170 raft_consensus.cc:2243] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:16.559902 2086 raft_consensus.cc:515] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.561245 1171 ts_tablet_manager.cc:1434] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260617 07:53:16.561371 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a632b42300d64471b516008ebca3312f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:16.561517 1046 raft_consensus.cc:3060] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.560256 1170 raft_consensus.cc:2272] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.563534 1172 tablet_bootstrap.cc:654] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.564014 1046 raft_consensus.cc:2468] T a632b42300d64471b516008ebca3312f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:16.564450 851 leader_election.cc:304] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:16.564781 1898 raft_consensus.cc:2804] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:16.564889 1898 raft_consensus.cc:697] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:16.554076 1862 rpcz_store.cc:276] 0617 07:53:13.798985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.799030 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:16.553909 (+2754879us) ts_tablet_manager.cc:1151] Deleting tablet 630e540a77374c11895ab5a0e394b3bb
0617 07:53:16.553920 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.554001 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2754678}
I20260617 07:53:16.565116 1898 consensus_queue.cc:237] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:16.565282 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
I20260617 07:53:16.565327 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 167) took 2765 ms. Trace:
I20260617 07:53:16.565392 1862 rpcz_store.cc:276] 0617 07:53:13.799383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.799453 (+ 70us) service_pool.cc:224] Handling call
0617 07:53:16.565235 (+2765782us) ts_tablet_manager.cc:1151] Deleting tablet 82cf9c672f3b4567b63e878a6ab11334
0617 07:53:16.565245 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.565312 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2765617}
W20260617 07:53:16.565757 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 82cf9c672f3b4567b63e878a6ab11334 because the tablet was not found. No further retry: Not found: Tablet not found: 82cf9c672f3b4567b63e878a6ab11334
I20260617 07:53:16.565814 1862 tablet_replica.cc:333] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.565981 1862 raft_consensus.cc:2243] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.566093 1171 tablet_bootstrap.cc:492] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.566145 1170 ts_tablet_manager.cc:1916] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.566541 2086 leader_election.cc:290] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.568274 1171 tablet_bootstrap.cc:654] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.566103 1862 raft_consensus.cc:2272] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.571467 1862 ts_tablet_manager.cc:1916] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.572824 2201 consensus_queue.cc:1048] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:16.582324 1862 ts_tablet_manager.cc:1929] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.582468 1862 log.cc:1199] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/7e90ad3b80f24bc7aeb2e92ba5c84b63
I20260617 07:53:16.582765 1862 ts_tablet_manager.cc:1950] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.556548 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a632b42300d64471b516008ebca3312f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.560889 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a632b42300d64471b516008ebca3312f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:16.561506 1178 tablet_bootstrap.cc:492] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:16.594139 1178 ts_tablet_manager.cc:1403] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.091s user 0.004s sys 0.000s
W20260617 07:53:16.594300 852 leader_election.cc:343] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:16.594700 852 leader_election.cc:343] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.595007 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 168) took 2795 ms. Trace:
I20260617 07:53:16.594991 1178 raft_consensus.cc:359] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.595175 1178 raft_consensus.cc:385] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.595105 1862 rpcz_store.cc:276] 0617 07:53:13.799740 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.799785 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:16.565770 (+2765985us) ts_tablet_manager.cc:1151] Deleting tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
0617 07:53:16.565781 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.577603 (+ 11822us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.582263 (+ 4660us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.594987 (+ 12724us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2765835}
I20260617 07:53:16.595510 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 169) took 2795 ms. Trace:
I20260617 07:53:16.595595 1862 rpcz_store.cc:276] 0617 07:53:13.800052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.800096 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:16.595409 (+2795313us) ts_tablet_manager.cc:1151] Deleting tablet b01721f68e3c41f4a2ffaf05bb180761
0617 07:53:16.595418 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.595492 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2795163}
I20260617 07:53:16.595793 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 (table default.Table_3e98977b52da4e3d825559a506774b17 [id=b7cea59369de444397139db78c303ea5]) successfully deleted
I20260617 07:53:16.595887 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 170) took 2795 ms. Trace:
I20260617 07:53:16.595943 1862 rpcz_store.cc:276] 0617 07:53:13.800358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.800414 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:16.595823 (+2795409us) ts_tablet_manager.cc:1151] Deleting tablet 6ddfb822b5af4bb6b664936c769d9625
0617 07:53:16.595830 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.595875 (+ 45us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2795229}
I20260617 07:53:16.596175 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 171) took 2795 ms. Trace:
W20260617 07:53:16.596139 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet b01721f68e3c41f4a2ffaf05bb180761 because the tablet was not found. No further retry: Not found: Tablet not found: b01721f68e3c41f4a2ffaf05bb180761
I20260617 07:53:16.596226 1862 rpcz_store.cc:276] 0617 07:53:13.800579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.800630 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:16.596122 (+2795492us) ts_tablet_manager.cc:1151] Deleting tablet 5a547dabaeb742ba941690f4895955bd
0617 07:53:16.596129 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.596166 (+ 37us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2795341}
W20260617 07:53:16.596436 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6ddfb822b5af4bb6b664936c769d9625 because the tablet was not found. No further retry: Not found: Tablet not found: 6ddfb822b5af4bb6b664936c769d9625
I20260617 07:53:16.596472 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 172) took 2749 ms. Trace:
I20260617 07:53:16.596522 1862 rpcz_store.cc:276] 0617 07:53:13.846797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.846849 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:16.596386 (+2749537us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:16.596393 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.596452 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2749365}
W20260617 07:53:16.596688 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5a547dabaeb742ba941690f4895955bd because the tablet was not found. No further retry: Not found: Tablet not found: 5a547dabaeb742ba941690f4895955bd
I20260617 07:53:16.596771 1862 tablet_replica.cc:333] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.596957 1862 raft_consensus.cc:2243] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
W20260617 07:53:16.596943 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7f7611958cf143438497c93f5f2bc098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7611958cf143438497c93f5f2bc098 already in progress: creating tablet
I20260617 07:53:16.597195 1862 pending_rounds.cc:70] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:16.595237 1178 raft_consensus.cc:740] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.597244 1862 pending_rounds.cc:77] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772728693153792 op_type: NO_OP noop_request { }
I20260617 07:53:16.597333 1862 raft_consensus.cc:2889] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:16.597410 1862 raft_consensus.cc:2272] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.598336 1178 consensus_queue.cc:260] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.599201 1178 ts_tablet_manager.cc:1434] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:16.601490 1862 ts_tablet_manager.cc:1916] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.606235 1178 tablet_bootstrap.cc:492] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:16.608256 1178 tablet_bootstrap.cc:654] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.616096 2125 raft_consensus.cc:493] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.616228 2125 raft_consensus.cc:515] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.616770 2125 leader_election.cc:290] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:16.617854 716 leader_election.cc:343] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 301bd4d6faec429ba71ce354c23d0f75
W20260617 07:53:16.618777 713 leader_election.cc:343] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 301bd4d6faec429ba71ce354c23d0f75
I20260617 07:53:16.618870 713 leader_election.cc:304] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.619979 2125 raft_consensus.cc:2749] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.620206 1862 ts_tablet_manager.cc:1929] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.620301 1862 log.cc:1199] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/36ce60b466f7420992ef194d72b5718d
I20260617 07:53:16.620661 1862 ts_tablet_manager.cc:1950] T 36ce60b466f7420992ef194d72b5718d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.620977 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 173) took 2774 ms. Trace:
I20260617 07:53:16.621055 1862 rpcz_store.cc:276] 0617 07:53:13.846887 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.846932 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:16.596722 (+2749790us) ts_tablet_manager.cc:1151] Deleting tablet 36ce60b466f7420992ef194d72b5718d
0617 07:53:16.596730 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.606962 (+ 10232us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.620147 (+ 13185us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.620960 (+ 813us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2749641}
I20260617 07:53:16.621515 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 36ce60b466f7420992ef194d72b5718d (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
I20260617 07:53:16.622668 760 tablet_service.cc:1511] Processing CreateTablet for tablet 2abe4bf5c15f4faca21d2ed61f62ef38 (DEFAULT_TABLE table=default.Table_8a49b4155d9145c1bf5511215596a162 [id=9fb1900b7a3f4640b2b5a62f77fe16e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.623107 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abe4bf5c15f4faca21d2ed61f62ef38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.623343 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 174) took 2776 ms. Trace:
I20260617 07:53:16.623433 1862 rpcz_store.cc:276] 0617 07:53:13.847179 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.847215 (+ 36us) service_pool.cc:224] Handling call
0617 07:53:16.623244 (+2776029us) ts_tablet_manager.cc:1151] Deleting tablet 82d682ae37d74b4b967da0f8e2de6301
0617 07:53:16.623253 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.623324 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2775919}
W20260617 07:53:16.623919 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 82d682ae37d74b4b967da0f8e2de6301 because the tablet was not found. No further retry: Not found: Tablet not found: 82d682ae37d74b4b967da0f8e2de6301
I20260617 07:53:16.624486 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 175) took 2777 ms. Trace:
I20260617 07:53:16.624567 1862 rpcz_store.cc:276] 0617 07:53:13.847417 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.847456 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:16.624387 (+2776931us) ts_tablet_manager.cc:1151] Deleting tablet 3f51c76d93674a91b5ada7821393020a
0617 07:53:16.624395 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.624471 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2776808}
W20260617 07:53:16.624941 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3f51c76d93674a91b5ada7821393020a because the tablet was not found. No further retry: Not found: Tablet not found: 3f51c76d93674a91b5ada7821393020a
I20260617 07:53:16.626543 898 tablet_service.cc:1511] Processing CreateTablet for tablet 2abe4bf5c15f4faca21d2ed61f62ef38 (DEFAULT_TABLE table=default.Table_8a49b4155d9145c1bf5511215596a162 [id=9fb1900b7a3f4640b2b5a62f77fe16e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.626621 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 176) took 2778 ms. Trace:
I20260617 07:53:16.626693 1862 rpcz_store.cc:276] 0617 07:53:13.847683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.847720 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:16.626545 (+2778825us) ts_tablet_manager.cc:1151] Deleting tablet 28e1fd7f91f94221884be2166f0cc793
0617 07:53:16.626553 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.626606 (+ 53us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2778717}
I20260617 07:53:16.626959 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abe4bf5c15f4faca21d2ed61f62ef38. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:16.627055 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 28e1fd7f91f94221884be2166f0cc793 because the tablet was not found. No further retry: Not found: Tablet not found: 28e1fd7f91f94221884be2166f0cc793
I20260617 07:53:16.627486 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 177) took 2779 ms. Trace:
I20260617 07:53:16.627550 1862 rpcz_store.cc:276] 0617 07:53:13.847914 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.847948 (+ 34us) service_pool.cc:224] Handling call
0617 07:53:16.627364 (+2779416us) ts_tablet_manager.cc:1151] Deleting tablet 2f8cd6ff8fa44536acdd84a107ab1525
0617 07:53:16.627375 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.627454 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2779288}
I20260617 07:53:16.628149 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 2abe4bf5c15f4faca21d2ed61f62ef38 (DEFAULT_TABLE table=default.Table_8a49b4155d9145c1bf5511215596a162 [id=9fb1900b7a3f4640b2b5a62f77fe16e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.628500 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abe4bf5c15f4faca21d2ed61f62ef38. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:16.635629 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
I20260617 07:53:16.636587 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 178) took 2788 ms. Trace:
I20260617 07:53:16.636677 1862 rpcz_store.cc:276] 0617 07:53:13.848160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.848193 (+ 33us) service_pool.cc:224] Handling call
0617 07:53:16.628245 (+2780052us) ts_tablet_manager.cc:1151] Deleting tablet d80c2ffcf1b84df0bc6a468ea0929e80
0617 07:53:16.628253 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.636569 (+ 8316us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2779935}
W20260617 07:53:16.637107 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d80c2ffcf1b84df0bc6a468ea0929e80 because the tablet was not found. No further retry: Not found: Tablet not found: d80c2ffcf1b84df0bc6a468ea0929e80
I20260617 07:53:16.637317 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 179) took 2788 ms. Trace:
I20260617 07:53:16.637413 1862 rpcz_store.cc:276] 0617 07:53:13.848447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.848492 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:16.637184 (+2788692us) ts_tablet_manager.cc:1151] Deleting tablet 51e757e6f4ce4c6eb8223c4b6955245e
0617 07:53:16.637197 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.637297 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2788566}
I20260617 07:53:16.637849 1862 tablet_replica.cc:333] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.638058 1862 raft_consensus.cc:2243] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.638222 1862 raft_consensus.cc:2272] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:16.638522 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e757e6f4ce4c6eb8223c4b6955245e already in progress: creating tablet
I20260617 07:53:16.639213 1862 ts_tablet_manager.cc:1916] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.642045 1172 tablet_bootstrap.cc:492] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:16.642223 1172 ts_tablet_manager.cc:1403] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.014s
I20260617 07:53:16.642993 1172 raft_consensus.cc:359] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.643229 1172 raft_consensus.cc:385] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.643333 1172 raft_consensus.cc:740] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.643466 780 raft_consensus.cc:3060] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.643623 1172 consensus_queue.cc:260] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.644304 1172 ts_tablet_manager.cc:1434] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:16.644788 1172 tablet_bootstrap.cc:492] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:16.650882 1172 tablet_bootstrap.cc:654] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.654182 760 tablet_service.cc:1511] Processing CreateTablet for tablet a0dcd837e1c54af696394e7a6c4d26f0 (DEFAULT_TABLE table=default.Table_a50277d75b6b4544961f33c42a936cd2 [id=ce10cc3eb2df44aeb3ee7b59f77bcbe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.654654 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dcd837e1c54af696394e7a6c4d26f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.655866 1862 ts_tablet_manager.cc:1929] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.655978 1862 log.cc:1199] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/84f498f551ff4767bd16628b03f55ae2
I20260617 07:53:16.656340 1862 ts_tablet_manager.cc:1950] T 84f498f551ff4767bd16628b03f55ae2 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.658022 898 tablet_service.cc:1511] Processing CreateTablet for tablet a0dcd837e1c54af696394e7a6c4d26f0 (DEFAULT_TABLE table=default.Table_a50277d75b6b4544961f33c42a936cd2 [id=ce10cc3eb2df44aeb3ee7b59f77bcbe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.658399 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dcd837e1c54af696394e7a6c4d26f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.658697 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 181) took 2809 ms. Trace:
I20260617 07:53:16.659365 1028 tablet_service.cc:1511] Processing CreateTablet for tablet a0dcd837e1c54af696394e7a6c4d26f0 (DEFAULT_TABLE table=default.Table_a50277d75b6b4544961f33c42a936cd2 [id=ce10cc3eb2df44aeb3ee7b59f77bcbe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.659713 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dcd837e1c54af696394e7a6c4d26f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.658802 1862 rpcz_store.cc:276] 0617 07:53:13.849115 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.849154 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:16.637800 (+2788646us) ts_tablet_manager.cc:1151] Deleting tablet 84f498f551ff4767bd16628b03f55ae2
0617 07:53:16.637811 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.644280 (+ 6469us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.655815 (+ 11535us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.658676 (+ 2861us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2788517}
I20260617 07:53:16.660233 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 182) took 2810 ms. Trace:
I20260617 07:53:16.660308 1862 rpcz_store.cc:276] 0617 07:53:13.849378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.849415 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:16.660146 (+2810731us) ts_tablet_manager.cc:1151] Deleting tablet 301bd4d6faec429ba71ce354c23d0f75
0617 07:53:16.660155 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.660220 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2810617}
I20260617 07:53:16.662122 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 84f498f551ff4767bd16628b03f55ae2 (table default.Table_187d6ce1f72947bead15cb026aa308cb [id=288a2e361ab149dca98dd515225f0ad7]) successfully deleted
W20260617 07:53:16.662489 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 301bd4d6faec429ba71ce354c23d0f75 because the tablet was not found. No further retry: Not found: Tablet not found: 301bd4d6faec429ba71ce354c23d0f75
I20260617 07:53:16.672571 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:16.675052 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:16.675822 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet b62ae096bfd347029ef8d7f0462dd111 (table default.Table_832c0052f588434faa10b821b4d09514 [id=4336b6e42a2b4c2d86fc98c56990bc8e]). Expected version 1 got 0
I20260617 07:53:16.676641 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_871f52a414934a248bcacbe3399ccee8 [id=7543297cccfb4a3d90a50fe63ba0742f]). Expected version 2 got 0
I20260617 07:53:16.676952 1846 ts_tablet_manager.cc:1929] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.677325 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:16.677925 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_f86c4a5d30d546a890795712293d1a2f [id=b20987ff1f1c43098b1408b126b32913]). Expected version 2 got 0
I20260617 07:53:16.678412 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:16.678798 1171 tablet_bootstrap.cc:492] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.678949 1171 ts_tablet_manager.cc:1403] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.113s user 0.004s sys 0.021s
I20260617 07:53:16.679231 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:16.679768 1171 raft_consensus.cc:359] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.680222 1171 raft_consensus.cc:385] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.680294 1171 raft_consensus.cc:740] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.680524 1171 consensus_queue.cc:260] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.680986 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:16.681072 1846 log.cc:1199] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/c7343400555f447b8a1721ba36d7766d
I20260617 07:53:16.681085 1171 ts_tablet_manager.cc:1434] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:16.681488 1171 tablet_bootstrap.cc:492] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.682013 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:16.683071 1171 tablet_bootstrap.cc:654] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.683377 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:16.685040 1172 tablet_bootstrap.cc:492] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:16.685230 1172 ts_tablet_manager.cc:1403] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.002s
I20260617 07:53:16.686551 886 tablet_service.cc:1511] Processing CreateTablet for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 (DEFAULT_TABLE table=default.Table_f1ff983b5f414960bb16a56ef5f1c082 [id=b22b3bf3898449d6abca2a9b5a21aa21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.686926 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.690533 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 (DEFAULT_TABLE table=default.Table_f1ff983b5f414960bb16a56ef5f1c082 [id=b22b3bf3898449d6abca2a9b5a21aa21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.695657 1170 ts_tablet_manager.cc:1929] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.696333 1170 log.cc:1199] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/7934f5fa0287427cb45fe568f0de8758
I20260617 07:53:16.696640 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.696710 1172 raft_consensus.cc:359] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.697964 898 tablet_service.cc:1511] Processing CreateTablet for tablet f26cf4f6c9834dddbda9205c5c777546 (DEFAULT_TABLE table=default.Table_8c64bc25628540029359a55cc8dde053 [id=da7c90fd760846a8acca3d2cf1c8277a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.700714 1862 tablet_replica.cc:333] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.700974 1862 raft_consensus.cc:2243] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.701285 1172 raft_consensus.cc:385] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.701416 1172 raft_consensus.cc:740] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.701756 1172 consensus_queue.cc:260] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.702241 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:16.702566 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:16.697469 1022 tablet_service.cc:1511] Processing CreateTablet for tablet f26cf4f6c9834dddbda9205c5c777546 (DEFAULT_TABLE table=default.Table_8c64bc25628540029359a55cc8dde053 [id=da7c90fd760846a8acca3d2cf1c8277a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.703017 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26cf4f6c9834dddbda9205c5c777546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.701324 1862 raft_consensus.cc:2272] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.703668 1862 ts_tablet_manager.cc:1916] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.704027 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26cf4f6c9834dddbda9205c5c777546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.706028 745 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca7af3d86d741f482a1f5f97de9c767 (DEFAULT_TABLE table=default.Table_0cbd12d27d174b7d8addf48d4cf581b8 [id=c2bc0c2ec00b41ad8fac9cb72730af78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.706394 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca7af3d86d741f482a1f5f97de9c767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.700258 2260 raft_consensus.cc:493] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.706918 2260 raft_consensus.cc:515] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.707219 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:16.707556 2260 leader_election.cc:290] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:16.707888 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95865af94c04410386d23cb369180611" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:16.708400 988 leader_election.cc:343] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.709784 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 979087485af94e159d3d0f2cb873899e (table default.Table_5238d7f8a8b649df9298e622257465f5 [id=7a23152402da4e608156935807a7b61b]). Expected version 1 got 0
I20260617 07:53:16.710489 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:16.710844 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
I20260617 07:53:16.712224 2125 raft_consensus.cc:493] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.712364 2125 raft_consensus.cc:515] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.700356 1170 ts_tablet_manager.cc:1950] T 7934f5fa0287427cb45fe568f0de8758 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:16.721737 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 167) took 3149 ms. Trace:
I20260617 07:53:16.722404 1170 rpcz_store.cc:276] 0617 07:53:13.572102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.572159 (+ 57us) service_pool.cc:224] Handling call
0617 07:53:16.556186 (+2984027us) ts_tablet_manager.cc:1151] Deleting tablet 7934f5fa0287427cb45fe568f0de8758
0617 07:53:16.556197 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.640013 (+ 83816us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.695292 (+ 55279us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.721612 (+ 26320us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2958641}
I20260617 07:53:16.723008 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]) successfully deleted
I20260617 07:53:16.723424 1171 tablet_bootstrap.cc:492] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.723559 1171 ts_tablet_manager.cc:1403] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260617 07:53:16.723915 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 168) took 3151 ms. Trace:
I20260617 07:53:16.724274 1171 raft_consensus.cc:359] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.724438 1171 raft_consensus.cc:385] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.724488 1171 raft_consensus.cc:740] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.724184 1170 rpcz_store.cc:276] 0617 07:53:13.572979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.573052 (+ 73us) service_pool.cc:224] Handling call
0617 07:53:16.723387 (+3150335us) ts_tablet_manager.cc:1151] Deleting tablet df5224716de249e9be9d7239407579a9
0617 07:53:16.723399 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.723806 (+ 407us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3125894}
I20260617 07:53:16.724671 1171 consensus_queue.cc:260] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:16.725198 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet df5224716de249e9be9d7239407579a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df5224716de249e9be9d7239407579a9 already in progress: creating tablet
I20260617 07:53:16.725270 1171 ts_tablet_manager.cc:1434] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:16.725524 1171 tablet_bootstrap.cc:492] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.726172 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 169) took 3143 ms. Trace:
I20260617 07:53:16.726648 1170 rpcz_store.cc:276] 0617 07:53:13.582255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.582304 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:16.725739 (+3143435us) ts_tablet_manager.cc:1151] Deleting tablet 9618a5c0c9dd4c368f5763c434f70da5
0617 07:53:16.725751 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.726065 (+ 314us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3128175}
I20260617 07:53:16.727301 1171 tablet_bootstrap.cc:654] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:16.727586 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 9618a5c0c9dd4c368f5763c434f70da5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9618a5c0c9dd4c368f5763c434f70da5 already in progress: creating tablet
I20260617 07:53:16.728729 887 tablet_service.cc:1511] Processing CreateTablet for tablet 6cdcd3904a754939b9ae09cc3672bbc6 (DEFAULT_TABLE table=default.Table_8ab7027f53c74106b61571eba9efc384 [id=e7267204e3404b1da00d3606b6819479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.729046 2201 raft_consensus.cc:493] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.729104 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cdcd3904a754939b9ae09cc3672bbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.729157 2201 raft_consensus.cc:515] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.729729 2201 leader_election.cc:290] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:16.732611 851 leader_election.cc:343] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 66140c5d364f453a8089f143cc96ede8
I20260617 07:53:16.733150 1846 ts_tablet_manager.cc:1950] T c7343400555f447b8a1721ba36d7766d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.733175 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95865af94c04410386d23cb369180611" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.733494 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 78) took 5004 ms. Trace:
I20260617 07:53:16.733568 1846 rpcz_store.cc:276] 0617 07:53:11.728585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.731146 (+ 2561us) service_pool.cc:224] Handling call
0617 07:53:16.551024 (+4819878us) ts_tablet_manager.cc:1151] Deleting tablet c7343400555f447b8a1721ba36d7766d
0617 07:53:16.551034 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.662194 (+111160us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.676893 (+ 14699us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.733481 (+ 56588us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4786080}
W20260617 07:53:16.733696 986 leader_election.cc:343] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.733705 743 tablet_service.cc:1511] Processing CreateTablet for tablet f26cf4f6c9834dddbda9205c5c777546 (DEFAULT_TABLE table=default.Table_8c64bc25628540029359a55cc8dde053 [id=da7c90fd760846a8acca3d2cf1c8277a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.733830 986 leader_election.cc:304] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:16.733871 1846 tablet_replica.cc:333] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:16.734038 1846 raft_consensus.cc:2243] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.734196 1846 raft_consensus.cc:2272] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.734251 2125 leader_election.cc:290] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.734745 1846 ts_tablet_manager.cc:1916] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.734750 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4d21f9ad9543b0b90fc66f1a6e3b13" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:16.734886 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4d21f9ad9543b0b90fc66f1a6e3b13" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:16.735198 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca7af3d86d741f482a1f5f97de9c767 (DEFAULT_TABLE table=default.Table_0cbd12d27d174b7d8addf48d4cf581b8 [id=c2bc0c2ec00b41ad8fac9cb72730af78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.735368 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66140c5d364f453a8089f143cc96ede8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.735389 713 leader_election.cc:304] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.735549 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca7af3d86d741f482a1f5f97de9c767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.735756 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet c7343400555f447b8a1721ba36d7766d (table default.Table_b106b0223948469da9ef0246aceeed0d [id=4aac4497cee840e0a0d0c88abfdc229f]) successfully deleted
I20260617 07:53:16.735845 2125 raft_consensus.cc:2749] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:16.736078 852 leader_election.cc:343] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.736177 852 leader_election.cc:304] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.736418 2201 raft_consensus.cc:2749] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.738884 1171 tablet_bootstrap.cc:492] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.739226 1171 ts_tablet_manager.cc:1403] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260617 07:53:16.740291 1171 raft_consensus.cc:359] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.740950 744 tablet_service.cc:1511] Processing CreateTablet for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 (DEFAULT_TABLE table=default.Table_f1ff983b5f414960bb16a56ef5f1c082 [id=b22b3bf3898449d6abca2a9b5a21aa21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.741385 1846 ts_tablet_manager.cc:1929] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.741482 1846 log.cc:1199] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/8fa23bb0929440b1820afdce4b9e8d8c
I20260617 07:53:16.741601 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26cf4f6c9834dddbda9205c5c777546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.741822 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.745688 2359 raft_consensus.cc:2749] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.746654 1172 ts_tablet_manager.cc:1434] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.061s user 0.001s sys 0.001s
I20260617 07:53:16.749265 1172 tablet_bootstrap.cc:492] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:16.749976 760 tablet_service.cc:1511] Processing CreateTablet for tablet 6cdcd3904a754939b9ae09cc3672bbc6 (DEFAULT_TABLE table=default.Table_8ab7027f53c74106b61571eba9efc384 [id=e7267204e3404b1da00d3606b6819479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.750327 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cdcd3904a754939b9ae09cc3672bbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.752512 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 171) took 3057 ms. Trace:
I20260617 07:53:16.752633 1170 rpcz_store.cc:276] 0617 07:53:13.695236 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.695299 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:16.752307 (+3057008us) ts_tablet_manager.cc:1151] Deleting tablet d965aa4e8dc244cdb93dd15cdee9070c
0617 07:53:16.752317 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.752494 (+ 177us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3056751}
W20260617 07:53:16.753183 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d965aa4e8dc244cdb93dd15cdee9070c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d965aa4e8dc244cdb93dd15cdee9070c already in progress: creating tablet
I20260617 07:53:16.753343 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 172) took 3036 ms. Trace:
I20260617 07:53:16.753471 1170 rpcz_store.cc:276] 0617 07:53:13.717403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.717467 (+ 64us) service_pool.cc:224] Handling call
0617 07:53:16.753151 (+3035684us) ts_tablet_manager.cc:1151] Deleting tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1
0617 07:53:16.753184 (+ 33us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.753324 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3035454}
W20260617 07:53:16.754027 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 already in progress: creating tablet
I20260617 07:53:16.754078 1170 tablet_replica.cc:333] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:16.742494 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca7af3d86d741f482a1f5f97de9c767 (DEFAULT_TABLE table=default.Table_0cbd12d27d174b7d8addf48d4cf581b8 [id=c2bc0c2ec00b41ad8fac9cb72730af78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.754391 1170 raft_consensus.cc:2243] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.754432 1171 raft_consensus.cc:385] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.754513 1171 raft_consensus.cc:740] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.754699 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca7af3d86d741f482a1f5f97de9c767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.754666 1170 raft_consensus.cc:2272] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.754740 1171 consensus_queue.cc:260] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.755491 2086 raft_consensus.cc:493] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.755606 2086 raft_consensus.cc:515] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.755707 1171 ts_tablet_manager.cc:1434] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20260617 07:53:16.755944 1171 tablet_bootstrap.cc:492] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.755928 1170 ts_tablet_manager.cc:1916] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.756184 2086 leader_election.cc:290] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.756584 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15dcc10552d4747bad436538662bb66" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:16.756757 1046 raft_consensus.cc:2468] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:16.757107 851 leader_election.cc:304] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:16.757447 2086 raft_consensus.cc:2804] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:16.757539 2086 raft_consensus.cc:493] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:16.757602 2086 raft_consensus.cc:3060] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.743108 1862 ts_tablet_manager.cc:1929] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.757817 1862 log.cc:1199] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/be14a95f458d440e86133ef65c484571
I20260617 07:53:16.758116 1862 ts_tablet_manager.cc:1950] T be14a95f458d440e86133ef65c484571 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.758737 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 183) took 2909 ms. Trace:
I20260617 07:53:16.758809 1862 rpcz_store.cc:276] 0617 07:53:13.849623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.849659 (+ 36us) service_pool.cc:224] Handling call
0617 07:53:16.700189 (+2850530us) ts_tablet_manager.cc:1151] Deleting tablet be14a95f458d440e86133ef65c484571
0617 07:53:16.700663 (+ 474us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.720053 (+ 19390us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.743062 (+ 23009us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.758721 (+ 15659us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2850392}
I20260617 07:53:16.759128 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 184) took 2909 ms. Trace:
I20260617 07:53:16.759192 1862 rpcz_store.cc:276] 0617 07:53:13.849889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.849924 (+ 35us) service_pool.cc:224] Handling call
0617 07:53:16.759041 (+2909117us) ts_tablet_manager.cc:1151] Deleting tablet 89783bab2e584fe9a8eda963f78bf3ec
0617 07:53:16.759049 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.759111 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2909000}
I20260617 07:53:16.759446 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 186) took 2908 ms. Trace:
I20260617 07:53:16.759495 1862 rpcz_store.cc:276] 0617 07:53:13.850482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.850521 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:16.759366 (+2908845us) ts_tablet_manager.cc:1151] Deleting tablet 8a4f81daf583464e988521e189ca39b6
0617 07:53:16.759373 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.759436 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2908722}
I20260617 07:53:16.759693 1862 tablet_replica.cc:333] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.760008 2086 raft_consensus.cc:515] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.760160 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet be14a95f458d440e86133ef65c484571 (table default.Table_868af3e5fa6c43ab8593b4e6a0073a62 [id=16ff2f9be38e41fc81466c55286f0b42]) successfully deleted
W20260617 07:53:16.760396 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 89783bab2e584fe9a8eda963f78bf3ec because the tablet was not found. No further retry: Not found: Tablet not found: 89783bab2e584fe9a8eda963f78bf3ec
I20260617 07:53:16.760537 745 tablet_service.cc:1511] Processing CreateTablet for tablet 57c83de284064dd4a14fcea5ce6b08ad (DEFAULT_TABLE table=default.Table_0276ca256ddc491e93325794b1ff6d2f [id=df75990a4b94463f8e92ab98e77b8384]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:16.760649 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
I20260617 07:53:16.760919 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c83de284064dd4a14fcea5ce6b08ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.760551 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15dcc10552d4747bad436538662bb66" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.762424 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15dcc10552d4747bad436538662bb66" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:16.762574 1046 raft_consensus.cc:3060] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.746001 2201 raft_consensus.cc:493] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.762945 2201 raft_consensus.cc:515] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.763391 1178 tablet_bootstrap.cc:492] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:16.763450 2201 leader_election.cc:290] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.763556 1178 ts_tablet_manager.cc:1403] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.157s user 0.002s sys 0.007s
I20260617 07:53:16.763964 1862 raft_consensus.cc:2243] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.764109 1862 raft_consensus.cc:2272] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.765108 1046 raft_consensus.cc:2468] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:16.751035 2087 raft_consensus.cc:493] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.765336 2087 raft_consensus.cc:515] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.766098 2087 leader_election.cc:290] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.766186 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 57c83de284064dd4a14fcea5ce6b08ad (DEFAULT_TABLE table=default.Table_0276ca256ddc491e93325794b1ff6d2f [id=df75990a4b94463f8e92ab98e77b8384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.766561 851 leader_election.cc:304] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:16.766800 2087 raft_consensus.cc:2804] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:16.766896 2087 raft_consensus.cc:697] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:16.767096 2087 consensus_queue.cc:237] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:16.768898 851 leader_election.cc:343] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 3ae9261c0ac94defaecfc7d14ba1ae61
W20260617 07:53:16.769840 852 consensus_peers.cc:597] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:16.769969 852 leader_election.cc:343] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.770027 887 tablet_service.cc:1511] Processing CreateTablet for tablet ded53073ce884013b1b0ab3cd23849e1 (DEFAULT_TABLE table=default.Table_ad2a6d2f10ea483bab983124a363296c [id=1d7ef182595b4800bf86f00838eb9804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.770226 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_0e7fa8cb8a9b49cb8ec27a4eef4a7d39 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 1 got 0
I20260617 07:53:16.770876 1862 ts_tablet_manager.cc:1916] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.771086 743 tablet_service.cc:1511] Processing CreateTablet for tablet ded53073ce884013b1b0ab3cd23849e1 (DEFAULT_TABLE table=default.Table_ad2a6d2f10ea483bab983124a363296c [id=1d7ef182595b4800bf86f00838eb9804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.771425 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded53073ce884013b1b0ab3cd23849e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.771395 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
I20260617 07:53:16.771836 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a84c7a425c4e4bc0acd412f16cf2fa01 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:16.772146 1178 raft_consensus.cc:359] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.772287 1178 raft_consensus.cc:385] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.772253 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]). Expected version 1 got 0
I20260617 07:53:16.772329 1178 raft_consensus.cc:740] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.772521 1846 ts_tablet_manager.cc:1950] T 8fa23bb0929440b1820afdce4b9e8d8c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.772504 1178 consensus_queue.cc:260] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.772733 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded53073ce884013b1b0ab3cd23849e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.772823 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 82) took 5027 ms. Trace:
I20260617 07:53:16.772927 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15dcc10552d4747bad436538662bb66" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:16.773572 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae9261c0ac94defaecfc7d14ba1ae61" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.773909 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8cedb539748dc917128511325bbcc" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:16.774082 852 leader_election.cc:343] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:16.774724 852 leader_election.cc:343] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.774816 852 leader_election.cc:304] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.774900 1178 ts_tablet_manager.cc:1434] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
W20260617 07:53:16.775166 852 leader_election.cc:343] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.775406 2201 raft_consensus.cc:2749] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.775645 1172 tablet_bootstrap.cc:654] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:16.776031 851 leader_election.cc:343] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 0fd8cedb539748dc917128511325bbcc
I20260617 07:53:16.776130 851 leader_election.cc:304] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.776427 2201 raft_consensus.cc:2749] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.776609 2086 leader_election.cc:290] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.772887 1846 rpcz_store.cc:276] 0617 07:53:11.745273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.745316 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:16.733828 (+4988512us) ts_tablet_manager.cc:1151] Deleting tablet 8fa23bb0929440b1820afdce4b9e8d8c
0617 07:53:16.733837 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.738554 (+ 4717us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.741341 (+ 2787us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.772810 (+ 31469us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4968405}
I20260617 07:53:16.777985 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 8fa23bb0929440b1820afdce4b9e8d8c (table default.Table_456aace94223474f82d1801ec38d7b43 [id=cbd872cee78b4535b90941504bafc133]) successfully deleted
I20260617 07:53:16.778028 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ded53073ce884013b1b0ab3cd23849e1 (DEFAULT_TABLE table=default.Table_ad2a6d2f10ea483bab983124a363296c [id=1d7ef182595b4800bf86f00838eb9804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.778282 1846 tablet_replica.cc:333] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:16.778788 898 tablet_service.cc:1511] Processing CreateTablet for tablet 57c83de284064dd4a14fcea5ce6b08ad (DEFAULT_TABLE table=default.Table_0276ca256ddc491e93325794b1ff6d2f [id=df75990a4b94463f8e92ab98e77b8384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.779225 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c83de284064dd4a14fcea5ce6b08ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.779076 1178 tablet_bootstrap.cc:492] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:16.780083 1846 raft_consensus.cc:2243] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.780298 1846 raft_consensus.cc:2272] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.780966 1846 ts_tablet_manager.cc:1916] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.781740 745 tablet_service.cc:1511] Processing CreateTablet for tablet a8cf68b53a194619a445a38aba409041 (DEFAULT_TABLE table=default.Table_3b086f032069480d951fb2ca2822d444 [id=3982ac94731646e0bf4f7672108e2200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.782049 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cf68b53a194619a445a38aba409041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.783742 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a4a35e3b7bb74667aa498c58a856cacc (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 2 got 0
I20260617 07:53:16.783685 887 tablet_service.cc:1511] Processing CreateTablet for tablet a8cf68b53a194619a445a38aba409041 (DEFAULT_TABLE table=default.Table_3b086f032069480d951fb2ca2822d444 [id=3982ac94731646e0bf4f7672108e2200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.783840 1862 ts_tablet_manager.cc:1929] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.784473 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cf68b53a194619a445a38aba409041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.784304 1862 log.cc:1199] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/66140c5d364f453a8089f143cc96ede8
I20260617 07:53:16.785499 1862 ts_tablet_manager.cc:1950] T 66140c5d364f453a8089f143cc96ede8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:16.787731 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 187) took 2937 ms. Trace:
I20260617 07:53:16.788923 1019 tablet_service.cc:1511] Processing CreateTablet for tablet a8cf68b53a194619a445a38aba409041 (DEFAULT_TABLE table=default.Table_3b086f032069480d951fb2ca2822d444 [id=3982ac94731646e0bf4f7672108e2200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.789783 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cdb1b67f4cb7463b98a63ec75d38890f (table default.Table_254698a40b82484f8ed8c47e68fb0b68 [id=a7b56d13c4944469995d657261551a5a]). Expected version 1 got 0
I20260617 07:53:16.788543 1862 rpcz_store.cc:276] 0617 07:53:13.850741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.850777 (+ 36us) service_pool.cc:224] Handling call
0617 07:53:16.759663 (+2908886us) ts_tablet_manager.cc:1151] Deleting tablet 66140c5d364f453a8089f143cc96ede8
0617 07:53:16.759670 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.777568 (+ 17898us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.783796 (+ 6228us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.787713 (+ 3917us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4099,"tablet-delete.queue_time_us":2908768}
I20260617 07:53:16.790148 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (table default.Table_78c4ad680e8849b18da7d278b7ecaf51 [id=494c90461b61486ab6dad26bbd3acab5]). Expected version 1 got 0
I20260617 07:53:16.790786 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 66140c5d364f453a8089f143cc96ede8 (table default.Table_bda16d6b118048ceb24acecf1a6864ce [id=2adce07b80e24a6eaf19d88d3444701d]) successfully deleted
I20260617 07:53:16.792451 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 2 got 0
I20260617 07:53:16.792927 760 tablet_service.cc:1511] Processing CreateTablet for tablet 01abd7aed0fd4d2b90db9f40029b5b37 (DEFAULT_TABLE table=default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.792626 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 189) took 2941 ms. Trace:
I20260617 07:53:16.793270 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01abd7aed0fd4d2b90db9f40029b5b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.793154 1862 rpcz_store.cc:276] 0617 07:53:13.851339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.851380 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:16.791525 (+2940145us) ts_tablet_manager.cc:1151] Deleting tablet 0c21efcad98348ebabcee4821dc4682e
0617 07:53:16.791764 (+ 239us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.792385 (+ 621us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2939753}
I20260617 07:53:16.794633 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:16.794902 885 tablet_service.cc:1511] Processing CreateTablet for tablet 01abd7aed0fd4d2b90db9f40029b5b37 (DEFAULT_TABLE table=default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.795039 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:16.795207 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:16.795339 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01abd7aed0fd4d2b90db9f40029b5b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.795388 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:16.795766 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:16.795912 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:16.796370 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e5544753b3144c1989f2ed99bffc2246 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:16.796587 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]). Expected version 1 got 0
I20260617 07:53:16.796809 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:16.800210 1178 tablet_bootstrap.cc:654] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.803292 2087 raft_consensus.cc:493] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.803424 2087 raft_consensus.cc:515] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.805034 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63de833f7aa740b0b5bf2494b78aca5c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:16.805239 1046 raft_consensus.cc:2468] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:16.805389 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 01abd7aed0fd4d2b90db9f40029b5b37 (DEFAULT_TABLE table=default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.806161 851 leader_election.cc:304] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:16.806456 2086 raft_consensus.cc:2804] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:16.806535 2086 raft_consensus.cc:493] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:16.806587 2086 raft_consensus.cc:3060] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:16.806604 1172 tablet_bootstrap.cc:492] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:16.806722 1172 ts_tablet_manager.cc:1403] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20260617 07:53:16.807833 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63de833f7aa740b0b5bf2494b78aca5c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.807955 2201 raft_consensus.cc:493] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.808053 2201 raft_consensus.cc:515] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.808624 2201 leader_election.cc:290] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:16.809989 852 leader_election.cc:343] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.810199 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ec78c123d448329b8442a0de0140d3" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.810601 2086 raft_consensus.cc:515] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.811849 2086 leader_election.cc:290] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.812040 2087 leader_election.cc:290] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.812516 1846 ts_tablet_manager.cc:1929] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.812887 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 6cdcd3904a754939b9ae09cc3672bbc6 (DEFAULT_TABLE table=default.Table_8ab7027f53c74106b61571eba9efc384 [id=e7267204e3404b1da00d3606b6819479]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:16.810796 852 leader_election.cc:343] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:16.813093 851 leader_election.cc:343] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 99ec78c123d448329b8442a0de0140d3
I20260617 07:53:16.813287 851 leader_election.cc:304] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.813831 2087 raft_consensus.cc:2749] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.814010 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63de833f7aa740b0b5bf2494b78aca5c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:16.814153 1046 raft_consensus.cc:3060] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:16.802188 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0c21efcad98348ebabcee4821dc4682e because the tablet was not found. No further retry: Not found: Tablet not found: 0c21efcad98348ebabcee4821dc4682e
I20260617 07:53:16.815069 1172 raft_consensus.cc:359] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.815641 1172 raft_consensus.cc:385] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.815804 1172 raft_consensus.cc:740] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.817018 1046 raft_consensus.cc:2468] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:16.815403 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 190) took 2963 ms. Trace:
I20260617 07:53:16.816486 1172 consensus_queue.cc:260] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.817469 851 leader_election.cc:304] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:16.818105 2087 raft_consensus.cc:2804] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:16.818209 2087 raft_consensus.cc:697] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:16.818425 2087 consensus_queue.cc:237] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.828687 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ca400838f5214d1a8f57e72c5068f0f9 (table default.Table_1a37fbbe9740440a8c245559a94b7f5f [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]). Expected version 1 got 0
W20260617 07:53:16.829151 852 consensus_peers.cc:597] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:16.831794 1172 ts_tablet_manager.cc:1434] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.025s user 0.001s sys 0.002s
I20260617 07:53:16.833628 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet bc57a1e3bc8b434da43f484705476b9b
I20260617 07:53:16.834210 461 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 211) took 1008 ms. Trace:
I20260617 07:53:16.834326 461 rpcz_store.cc:276] 0617 07:53:15.825515 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.933403 (+107888us) service_pool.cc:224] Handling call
0617 07:53:15.933847 (+ 444us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:15.933980 (+ 133us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:15.934046 (+ 66us) catalog_manager.cc:2849] Locking tablets
0617 07:53:15.934189 (+ 143us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:16.138161 (+203972us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:16.138230 (+ 69us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:16.833544 (+695314us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:16.834173 (+ 629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:16.095210 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:16.095474 (+ 264us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:16.095479 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:16.095481 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:16.095720 (+ 239us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:16.095736 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:16.095743 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:16.095945 (+ 202us) tablet.cc:701] Row locks acquired
0617 07:53:16.095984 (+ 39us) write_op.cc:260] PREPARE: finished
0617 07:53:16.096021 (+ 37us) write_op.cc:270] Start()
0617 07:53:16.096081 (+ 60us) write_op.cc:276] Timestamp: P: 1781682796095975 usec, L: 0
0617 07:53:16.096086 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 07:53:16.121529 (+ 25443us) log.cc:844] Serialized 762 byte log entry
0617 07:53:16.134585 (+ 13056us) op_driver.cc:464] REPLICATION: finished
0617 07:53:16.134697 (+ 112us) write_op.cc:301] APPLY: starting
0617 07:53:16.134712 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:16.134762 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:16.137525 (+ 2763us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:16.137595 (+ 70us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:16.137628 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:16.137635 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:16.137704 (+ 69us) log.cc:844] Serialized 29 byte log entry
0617 07:53:16.137788 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.137810 (+ 22us) write_op.cc:454] Released schema lock
0617 07:53:16.137818 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:16.137887 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.137891 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":52,"apply.run_cpu_time_us":479,"apply.run_wall_time_us":3185,"num_ops":2,"prepare.queue_time_us":160313,"prepare.run_cpu_time_us":1085,"prepare.run_wall_time_us":27136,"raft.queue_time_us":40,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":9508,"replication_time_us":38441}]]}
I20260617 07:53:16.835160 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_bbc71414b3d843b0a47892230967fb61" } modify_external_catalogs: true
I20260617 07:53:16.835352 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_bbc71414b3d843b0a47892230967fb61" } modify_external_catalogs: true
I20260617 07:53:16.837199 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet bc57a1e3bc8b434da43f484705476b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.837584 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed59705e05148f991844d47882dc151 (DEFAULT_TABLE table=default.Table_02ab5db216a449ff8e508fcc459791ae [id=13962b79508f4053b5cb01cd5e6b8b27]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:16.839052 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7c7083dff434fddbad7f2dcf2a6b6e6 consensus state has no leader
I20260617 07:53:16.833632 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed59705e05148f991844d47882dc151 (DEFAULT_TABLE table=default.Table_02ab5db216a449ff8e508fcc459791ae [id=13962b79508f4053b5cb01cd5e6b8b27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.839474 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8d97f61ab92d44008502cff52c36b89d" } modify_external_catalogs: true
I20260617 07:53:16.832064 1862 rpcz_store.cc:276] 0617 07:53:13.851657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.851730 (+ 73us) service_pool.cc:224] Handling call
0617 07:53:16.802742 (+2951012us) ts_tablet_manager.cc:1151] Deleting tablet f030d59f4e124f64bb62d05f0bb0f560
0617 07:53:16.814741 (+ 11999us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.815290 (+ 549us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2950663}
I20260617 07:53:16.839661 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8d97f61ab92d44008502cff52c36b89d" } modify_external_catalogs: true
I20260617 07:53:16.839807 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed59705e05148f991844d47882dc151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.839928 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 191) took 2988 ms. Trace:
I20260617 07:53:16.839988 1862 rpcz_store.cc:276] 0617 07:53:13.851941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.851984 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:16.839688 (+2987704us) ts_tablet_manager.cc:1151] Deleting tablet 70610822c57e45c7add7e1f5ce96d889
0617 07:53:16.839697 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.839914 (+ 217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2987571}
I20260617 07:53:16.840225 1862 tablet_replica.cc:333] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:16.840384 1862 raft_consensus.cc:2243] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:16.840649 1862 raft_consensus.cc:2272] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.840833 1846 log.cc:1199] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/f030d59f4e124f64bb62d05f0bb0f560
I20260617 07:53:16.840860 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet beb8fbb44e6147be8c9605be886a8aea
I20260617 07:53:16.841302 1846 ts_tablet_manager.cc:1950] T f030d59f4e124f64bb62d05f0bb0f560 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.841529 455 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 210) took 1016 ms. Trace:
I20260617 07:53:16.842860 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet beb8fbb44e6147be8c9605be886a8aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.841645 455 rpcz_store.cc:276] 0617 07:53:15.825332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.929527 (+104195us) service_pool.cc:224] Handling call
0617 07:53:15.929918 (+ 391us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:15.930069 (+ 151us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:15.930116 (+ 47us) catalog_manager.cc:2849] Locking tablets
0617 07:53:15.930249 (+ 133us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:16.093810 (+163561us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:16.119940 (+ 26130us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:16.840807 (+720867us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:16.841462 (+ 655us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:16.073419 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:16.073520 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:16.073526 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:16.073528 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:16.073643 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:16.073652 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:16.073656 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:16.073798 (+ 142us) tablet.cc:701] Row locks acquired
0617 07:53:16.073800 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:16.073825 (+ 25us) write_op.cc:270] Start()
0617 07:53:16.073849 (+ 24us) write_op.cc:276] Timestamp: P: 1781682796073786 usec, L: 0
0617 07:53:16.073852 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:16.074021 (+ 169us) log.cc:844] Serialized 731 byte log entry
0617 07:53:16.092954 (+ 18933us) op_driver.cc:464] REPLICATION: finished
0617 07:53:16.093278 (+ 324us) write_op.cc:301] APPLY: starting
0617 07:53:16.093294 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:16.093342 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:16.093377 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:16.093446 (+ 69us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:16.093487 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:16.093493 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:16.093574 (+ 81us) log.cc:844] Serialized 29 byte log entry
0617 07:53:16.093635 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.093655 (+ 20us) write_op.cc:454] Released schema lock
0617 07:53:16.093662 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:16.095025 (+ 1363us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.095061 (+ 36us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":255,"apply.run_cpu_time_us":468,"apply.run_wall_time_us":467,"num_ops":2,"prepare.queue_time_us":142686,"prepare.run_cpu_time_us":755,"prepare.run_wall_time_us":21603,"raft.queue_time_us":64,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"replication_time_us":19061}]]}
I20260617 07:53:16.843283 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 739cadc7ad124e229441333de949f2c6 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:16.844108 461 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet fb8098e3802e4c6a923b1b83e6e5378a
I20260617 07:53:16.844538 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0eb131fcd7a14c77af2ebe88f3a2d8d3" } new_table_name: "default.Table_1557e8110d1340518c2f713297b804f6" modify_external_catalogs: true
I20260617 07:53:16.845050 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c83de284064dd4a14fcea5ce6b08ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.815272 2364 tablet.cc:1724] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:16.819577 743 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed59705e05148f991844d47882dc151 (DEFAULT_TABLE table=default.Table_02ab5db216a449ff8e508fcc459791ae [id=13962b79508f4053b5cb01cd5e6b8b27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.846364 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed59705e05148f991844d47882dc151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.846515 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 81) took 5101 ms. Trace:
I20260617 07:53:16.846581 1846 rpcz_store.cc:276] 0617 07:53:11.745193 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.745493 (+ 300us) service_pool.cc:224] Handling call
0617 07:53:16.778241 (+5032748us) ts_tablet_manager.cc:1151] Deleting tablet f030d59f4e124f64bb62d05f0bb0f560
0617 07:53:16.778249 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.795463 (+ 17214us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.812445 (+ 16982us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.846489 (+ 34044us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5012635}
I20260617 07:53:16.847112 1171 tablet_bootstrap.cc:654] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.848361 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 83) took 5102 ms. Trace:
I20260617 07:53:16.848431 1846 rpcz_store.cc:276] 0617 07:53:11.745451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.745550 (+ 99us) service_pool.cc:224] Handling call
0617 07:53:16.848235 (+5102685us) ts_tablet_manager.cc:1151] Deleting tablet de030009192748118b388eec555d90da
0617 07:53:16.848248 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.848343 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5082480}
I20260617 07:53:16.849628 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet f030d59f4e124f64bb62d05f0bb0f560 (table default.Table_6dd3b32c3f7c4ae58bf47ef40691387e [id=1e5fc863b63b40a384e18985aaba5ab9]) successfully deleted
W20260617 07:53:16.849974 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet de030009192748118b388eec555d90da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de030009192748118b388eec555d90da already in progress: creating tablet
I20260617 07:53:16.853222 898 tablet_service.cc:1558] Processing DeleteTablet for tablet bc57a1e3bc8b434da43f484705476b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:16.853487 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet f030d59f4e124f64bb62d05f0bb0f560 because the tablet was not found. No further retry: Not found: Tablet not found: f030d59f4e124f64bb62d05f0bb0f560
W20260617 07:53:16.853753 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70610822c57e45c7add7e1f5ce96d889 already in progress: creating tablet
I20260617 07:53:16.854213 885 tablet_service.cc:1558] Processing DeleteTablet for tablet beb8fbb44e6147be8c9605be886a8aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:16.833420 1178 tablet_bootstrap.cc:492] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:16.836803 745 tablet_service.cc:1558] Processing DeleteTablet for tablet bc57a1e3bc8b434da43f484705476b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.814891 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63de833f7aa740b0b5bf2494b78aca5c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:16.854547 1178 ts_tablet_manager.cc:1403] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.003s
I20260617 07:53:16.843088 760 tablet_service.cc:1558] Processing DeleteTablet for tablet beb8fbb44e6147be8c9605be886a8aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.855520 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 84) took 5109 ms. Trace:
I20260617 07:53:16.855602 1846 rpcz_store.cc:276] 0617 07:53:11.745660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.745698 (+ 38us) service_pool.cc:224] Handling call
0617 07:53:16.855434 (+5109736us) ts_tablet_manager.cc:1151] Deleting tablet 4e3b5cb887da4d86bdc3d69f350fdb40
0617 07:53:16.855443 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.855505 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5089559}
I20260617 07:53:16.856909 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 85) took 5111 ms. Trace:
I20260617 07:53:16.856987 1846 rpcz_store.cc:276] 0617 07:53:11.745833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.745872 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:16.856813 (+5110941us) ts_tablet_manager.cc:1151] Deleting tablet 92e55be5f28740fba65c1199a571d97a
0617 07:53:16.856822 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.856896 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5090798}
W20260617 07:53:16.857869 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4e3b5cb887da4d86bdc3d69f350fdb40 because the tablet was not found. No further retry: Not found: Tablet not found: 4e3b5cb887da4d86bdc3d69f350fdb40
W20260617 07:53:16.858199 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92e55be5f28740fba65c1199a571d97a already in progress: creating tablet
I20260617 07:53:16.858283 1846 tablet_replica.cc:333] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:16.858448 1846 raft_consensus.cc:2243] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.858592 1846 raft_consensus.cc:2272] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.859025 1846 ts_tablet_manager.cc:1916] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:16.859753 852 leader_election.cc:343] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.862478 1171 tablet_bootstrap.cc:492] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.863106 1171 ts_tablet_manager.cc:1403] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.107s user 0.004s sys 0.000s
I20260617 07:53:16.863896 1171 raft_consensus.cc:359] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.865180 760 tablet_service.cc:1511] Processing CreateTablet for tablet 531ccdf479814053b468a7d5802f5dde (DEFAULT_TABLE table=default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.865548 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 531ccdf479814053b468a7d5802f5dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.870136 1178 raft_consensus.cc:359] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.870304 1178 raft_consensus.cc:385] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.870357 1178 raft_consensus.cc:740] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.870604 1178 consensus_queue.cc:260] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.871312 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 531ccdf479814053b468a7d5802f5dde (DEFAULT_TABLE table=default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.871490 1178 ts_tablet_manager.cc:1434] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260617 07:53:16.871968 1178 tablet_bootstrap.cc:492] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:16.873008 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded53073ce884013b1b0ab3cd23849e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.873567 1178 tablet_bootstrap.cc:654] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.875398 827 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
W20260617 07:53:16.876544 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 35120ce002f24f2bb1ea0fdc59fbfc9d consensus state has no leader
I20260617 07:53:16.876746 456 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 213) took 1027 ms. Trace:
I20260617 07:53:16.876834 456 rpcz_store.cc:276] 0617 07:53:15.849658 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.978687 (+129029us) service_pool.cc:224] Handling call
0617 07:53:15.979135 (+ 448us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:15.979313 (+ 178us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:15.979472 (+ 159us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:15.979550 (+ 78us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:16.148741 (+169191us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:16.876697 (+727956us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:16.123524 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:16.137460 (+ 13936us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:16.137472 (+ 12us) write_op.cc:435] Acquired schema lock
0617 07:53:16.137477 (+ 5us) tablet.cc:662] Decoding operations
0617 07:53:16.144343 (+ 6866us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:16.144381 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:16.144386 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:16.144506 (+ 120us) tablet.cc:701] Row locks acquired
0617 07:53:16.144510 (+ 4us) write_op.cc:260] PREPARE: finished
0617 07:53:16.144575 (+ 65us) write_op.cc:270] Start()
0617 07:53:16.144606 (+ 31us) write_op.cc:276] Timestamp: P: 1781682796144500 usec, L: 0
0617 07:53:16.144610 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:16.144855 (+ 245us) log.cc:844] Serialized 405 byte log entry
0617 07:53:16.148002 (+ 3147us) op_driver.cc:464] REPLICATION: finished
0617 07:53:16.148245 (+ 243us) write_op.cc:301] APPLY: starting
0617 07:53:16.148264 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:16.148311 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:16.148350 (+ 39us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:16.148401 (+ 51us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:16.148441 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:16.148452 (+ 11us) write_op.cc:312] APPLY: finished
0617 07:53:16.148542 (+ 90us) log.cc:844] Serialized 23 byte log entry
0617 07:53:16.148602 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.148617 (+ 15us) write_op.cc:454] Released schema lock
0617 07:53:16.148622 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:16.150802 (+ 2180us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.150807 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":191,"apply.run_cpu_time_us":436,"apply.run_wall_time_us":436,"num_ops":1,"prepare.queue_time_us":143551,"prepare.run_cpu_time_us":901,"prepare.run_wall_time_us":27277,"raft.queue_time_us":56,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":240,"replication_time_us":3359}]]}
I20260617 07:53:16.877594 456 master_service.cc:960] ReplaceTablet: received request to replace tablet e03a26e301e747febc4d5bafdc1a49c6 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:16.877978 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cf68b53a194619a445a38aba409041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.881916 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01abd7aed0fd4d2b90db9f40029b5b37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:16.885011 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9687dbd2616749f4bef7d9444bd89ddf consensus state has no leader
I20260617 07:53:16.885322 454 master_service.cc:960] ReplaceTablet: received request to replace tablet 9436fb7fca094eaab925748e254b1a62 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:16.885491 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cdcd3904a754939b9ae09cc3672bbc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:16.886212 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 consensus state has no leader
I20260617 07:53:16.886981 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ac5369fc08d64d709036b33d6d55d2c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:16.887590 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac5369fc08d64d709036b33d6d55d2c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.894372 1171 raft_consensus.cc:385] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.894460 1171 raft_consensus.cc:740] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.894570 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_f86c4a5d30d546a890795712293d1a2f" } new_table_name: "default.Table_c4040af1ae434f4daa66c3e47f38cc64" modify_external_catalogs: true
I20260617 07:53:16.894737 1171 consensus_queue.cc:260] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.867790 885 tablet_service.cc:1511] Processing CreateTablet for tablet 531ccdf479814053b468a7d5802f5dde (DEFAULT_TABLE table=default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.895996 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 531ccdf479814053b468a7d5802f5dde. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:16.871088 852 consensus_peers.cc:597] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:16.899858 1171 ts_tablet_manager.cc:1434] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.037s user 0.001s sys 0.000s
I20260617 07:53:16.900879 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed59705e05148f991844d47882dc151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.902805 1172 tablet_bootstrap.cc:492] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:16.902978 2125 raft_consensus.cc:493] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.903120 2125 raft_consensus.cc:515] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.903774 2125 leader_election.cc:290] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:16.904398 1172 tablet_bootstrap.cc:654] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:16.904801 716 leader_election.cc:343] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: be14a95f458d440e86133ef65c484571
I20260617 07:53:16.905478 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 531ccdf479814053b468a7d5802f5dde. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:16.906101 713 leader_election.cc:343] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: be14a95f458d440e86133ef65c484571
I20260617 07:53:16.906206 713 leader_election.cc:304] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.906669 2125 raft_consensus.cc:2749] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.907001 1171 tablet_bootstrap.cc:492] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.908443 1171 tablet_bootstrap.cc:654] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.909803 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c] alter complete (version 1)
I20260617 07:53:16.912338 2359 raft_consensus.cc:493] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.912482 2359 raft_consensus.cc:515] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.913053 2359 leader_election.cc:290] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:16.913662 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d1b4975077493eb6919b23d6523d3d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:16.914203 1862 ts_tablet_manager.cc:1916] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:16.914332 988 leader_election.cc:343] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.914649 2086 consensus_queue.cc:1048] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:16.916033 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d1b4975077493eb6919b23d6523d3d" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:16.916607 986 leader_election.cc:343] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.916713 986 leader_election.cc:304] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:16.916947 2359 raft_consensus.cc:2749] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.917310 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.917557 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.917649 759 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.917691 744 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.917760 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.917958 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 5203534569bd4da18bc06751f094735f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.918114 745 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.918844 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.920121 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 0f55c9a85e6e4b5ea7f2014cd0b7921a (DEFAULT_TABLE table=default.Table_d97e42eee9e14d7ca1ec6f5caf5744e0 [id=702315feb8774f2385c4705b72491441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.920596 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f55c9a85e6e4b5ea7f2014cd0b7921a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.920734 755 tablet_service.cc:1558] Processing DeleteTablet for tablet b01721f68e3c41f4a2ffaf05bb180761 with delete_type TABLET_DATA_DELETED (replaced by tablet d6ab00c0be9545cc97a0f29d82de4877) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.920928 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ddfb822b5af4bb6b664936c769d9625 with delete_type TABLET_DATA_DELETED (replaced by tablet 58ba8963530d49a89fe4eb626225377d) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.921242 745 tablet_service.cc:1511] Processing CreateTablet for tablet 0f55c9a85e6e4b5ea7f2014cd0b7921a (DEFAULT_TABLE table=default.Table_d97e42eee9e14d7ca1ec6f5caf5744e0 [id=702315feb8774f2385c4705b72491441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.921586 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f55c9a85e6e4b5ea7f2014cd0b7921a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:16.922227 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a547dabaeb742ba941690f4895955bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.929147 1171 tablet_bootstrap.cc:492] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:16.929701 1846 ts_tablet_manager.cc:1929] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:16.930014 1171 ts_tablet_manager.cc:1403] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260617 07:53:16.930876 1171 raft_consensus.cc:359] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.931392 1846 log.cc:1199] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:16.931874 1846 ts_tablet_manager.cc:1950] T 9cddb9e82c354f26b3abe56ebdefd008 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:16.932960 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 86) took 5186 ms. Trace:
I20260617 07:53:16.933279 1171 raft_consensus.cc:385] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:16.934053 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6] alter complete (version 2)
I20260617 07:53:16.941448 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357] alter complete (version 3)
W20260617 07:53:16.942591 459 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:46601 (request call id 218) took 900 ms (client timeout 1000 ms). Trace:
W20260617 07:53:16.942732 459 rpcz_store.cc:269] 0617 07:53:16.042437 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.102570 (+ 60133us) service_pool.cc:224] Handling call
0617 07:53:16.141910 (+ 39340us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:16.942554 (+800644us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:16.251595 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:16.257744 (+ 6149us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:16.257751 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:16.257753 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:16.266169 (+ 8416us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:16.266206 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:16.266212 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:16.266328 (+ 116us) tablet.cc:701] Row locks acquired
0617 07:53:16.266331 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:16.266398 (+ 67us) write_op.cc:270] Start()
0617 07:53:16.266458 (+ 60us) write_op.cc:276] Timestamp: P: 1781682796266312 usec, L: 0
0617 07:53:16.266471 (+ 13us) op_driver.cc:348] REPLICATION: starting
0617 07:53:16.266789 (+ 318us) log.cc:844] Serialized 533 byte log entry
0617 07:53:16.270009 (+ 3220us) op_driver.cc:464] REPLICATION: finished
0617 07:53:16.270183 (+ 174us) write_op.cc:301] APPLY: starting
0617 07:53:16.270197 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:16.270245 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:16.270273 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:16.270322 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:16.270353 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:16.270361 (+ 8us) write_op.cc:312] APPLY: finished
0617 07:53:16.270427 (+ 66us) log.cc:844] Serialized 23 byte log entry
0617 07:53:16.270496 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.270515 (+ 19us) write_op.cc:454] Released schema lock
0617 07:53:16.270521 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:16.279473 (+ 8952us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.279481 (+ 8us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 07:53:16.340172 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:16.341827 (+ 1655us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:16.341833 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:16.341835 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:16.343420 (+ 1585us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:16.343440 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:16.343447 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:16.345818 (+ 2371us) tablet.cc:701] Row locks acquired
0617 07:53:16.345821 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:16.345862 (+ 41us) write_op.cc:270] Start()
0617 07:53:16.345906 (+ 44us) write_op.cc:276] Timestamp: P: 1781682796345829 usec, L: 0
0617 07:53:16.345912 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:16.350549 (+ 4637us) log.cc:844] Serialized 356 byte log entry
0617 07:53:16.355098 (+ 4549us) op_driver.cc:464] REPLICATION: finished
0617 07:53:16.355311 (+ 213us) write_op.cc:301] APPLY: starting
0617 07:53:16.355328 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:16.355373 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:16.355403 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:16.355459 (+ 56us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:16.355494 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:16.355501 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:16.355605 (+ 104us) log.cc:844] Serialized 23 byte log entry
0617 07:53:16.355672 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.355693 (+ 21us) write_op.cc:454] Released schema lock
0617 07:53:16.355699 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:16.358162 (+ 2463us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.358476 (+ 314us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 07:53:16.926316 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:16.926450 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:16.926457 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:16.926460 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:16.926566 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:16.926578 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:16.926582 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:16.926654 (+ 72us) tablet.cc:701] Row locks acquired
0617 07:53:16.926656 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:16.926695 (+ 39us) write_op.cc:270] Start()
0617 07:53:16.926734 (+ 39us) write_op.cc:276] Timestamp: P: 1781682796926668 usec, L: 0
0617 07:53:16.926740 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:16.926966 (+ 226us) log.cc:844] Serialized 356 byte log entry
0617 07:53:16.931764 (+ 4798us) op_driver.cc:464] REPLICATION: finished
0617 07:53:16.931869 (+ 105us) write_op.cc:301] APPLY: starting
0617 07:53:16.931884 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:16.931919 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:16.931944 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:16.931993 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:16.932025 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:16.932037 (+ 12us) write_op.cc:312] APPLY: finished
0617 07:53:16.932128 (+ 91us) log.cc:844] Serialized 23 byte log entry
0617 07:53:16.932197 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.932213 (+ 16us) write_op.cc:454] Released schema lock
0617 07:53:16.932218 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:16.932305 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.932309 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 07:53:16.935776 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:16.935948 (+ 172us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:16.935953 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:16.935955 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:16.936054 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:16.936066 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:16.936072 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:16.936138 (+ 66us) tablet.cc:701] Row locks acquired
0617 07:53:16.936143 (+ 5us) write_op.cc:260] PREPARE: finished
0617 07:53:16.936180 (+ 37us) write_op.cc:270] Start()
0617 07:53:16.936215 (+ 35us) write_op.cc:276] Timestamp: P: 1781682796936150 usec, L: 0
0617 07:53:16.936220 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 07:53:16.936399 (+ 179us) log.cc:844] Serialized 356 byte log entry
0617 07:53:16.940177 (+ 3778us) op_driver.cc:464] REPLICATION: finished
0617 07:53:16.940316 (+ 139us) write_op.cc:301] APPLY: starting
0617 07:53:16.940336 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:16.940390 (+ 54us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:16.940448 (+ 58us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:16.940514 (+ 66us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:16.940556 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:16.940567 (+ 11us) write_op.cc:312] APPLY: finished
0617 07:53:16.940653 (+ 86us) log.cc:844] Serialized 23 byte log entry
0617 07:53:16.940723 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.940745 (+ 22us) write_op.cc:454] Released schema lock
0617 07:53:16.940753 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:16.940836 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:16.940842 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"spinlock_wait_cycles":14513536,"child_traces":[["op",{"apply.queue_time_us":133,"apply.run_cpu_time_us":414,"apply.run_wall_time_us":414,"num_ops":1,"prepare.queue_time_us":71071,"prepare.run_cpu_time_us":1045,"prepare.run_wall_time_us":27836,"raft.queue_time_us":63,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":237,"replication_time_us":3511}],["op",{"apply.queue_time_us":157,"apply.run_cpu_time_us":451,"apply.run_wall_time_us":451,"num_ops":1,"prepare.queue_time_us":68135,"prepare.run_cpu_time_us":1220,"prepare.run_wall_time_us":17985,"raft.queue_time_us":628,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":296,"replication_time_us":9151,"spinlock_wait_cycles":714112}],["op",{"apply.queue_time_us":60,"apply.run_cpu_time_us":425,"apply.run_wall_time_us":424,"num_ops":1,"prepare.queue_time_us":15533,"prepare.run_cpu_time_us":749,"prepare.run_wall_time_us":748,"replication_time_us":4996}],["op",{"apply.queue_time_us":87,"apply.run_cpu_time_us":510,"apply.run_wall_time_us":510,"num_ops":1,"prepare.queue_time_us":538,"prepare.run_cpu_time_us":699,"prepare.run_wall_time_us":748,"raft.queue_time_us":36,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":229,"replication_time_us":3921,"spinlock_wait_cycles":1792}]]}
I20260617 07:53:16.944530 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a179c86f21864fd984fcedd2be1154d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:16.945142 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a179c86f21864fd984fcedd2be1154d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.939743 2086 raft_consensus.cc:493] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.946666 2086 raft_consensus.cc:515] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.947281 2086 leader_election.cc:290] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:16.942739 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:16.943141 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:16.944393 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:16.948869 851 leader_election.cc:343] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 6f2d9e473fd444efa6ab63cc51dbb2bd
I20260617 07:53:16.949134 1171 raft_consensus.cc:740] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:16.949419 1171 consensus_queue.cc:260] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:16.934839 744 tablet_service.cc:1558] Processing DeleteTablet for tablet a882ae04eeb94276bb78ded81fbea708 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.935285 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.949747 1170 ts_tablet_manager.cc:1929] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:16.935425 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 950c1c44020a4586b3197f5f68a38963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.936060 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d682ae37d74b4b967da0f8e2de6301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.949856 1170 log.cc:1199] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/b7c5ff28367b42d3a3922d2b789bc7ec
I20260617 07:53:16.949694 1846 rpcz_store.cc:276] 0617 07:53:11.745992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.746032 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:16.858244 (+5112212us) ts_tablet_manager.cc:1151] Deleting tablet 9cddb9e82c354f26b3abe56ebdefd008
0617 07:53:16.858252 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.910274 (+ 52022us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.929649 (+ 19375us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.932942 (+ 3293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5092095}
I20260617 07:53:16.943950 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.944756 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.945060 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.945377 748 tablet_service.cc:1558] Processing DeleteTablet for tablet d21f61a35ca544568bcfca1a6230deca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.945916 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c7e43e1a3df54efe992a86dd0bd0c149 with delete_type TABLET_DATA_DELETED (replaced by tablet 36ce60b466f7420992ef194d72b5718d) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.946352 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.947990 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.948494 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2d9e473fd444efa6ab63cc51dbb2bd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:16.950237 1170 ts_tablet_manager.cc:1950] T b7c5ff28367b42d3a3922d2b789bc7ec P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:16.948781 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.950490 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 9cddb9e82c354f26b3abe56ebdefd008 (table default.Table_b5dd15921c6b423fad2fcbc1f3731fae [id=a081ae8e54b9470697b78d45b2dd1e44]) successfully deleted
I20260617 07:53:16.950819 460 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 7d5bd47736774ba9a05426b46a057e80
I20260617 07:53:16.951017 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 173) took 3206 ms. Trace:
I20260617 07:53:16.951102 1170 rpcz_store.cc:276] 0617 07:53:13.744284 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.744338 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:16.754010 (+3009672us) ts_tablet_manager.cc:1151] Deleting tablet b7c5ff28367b42d3a3922d2b789bc7ec
0617 07:53:16.754019 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.826055 (+ 72036us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.949665 (+123610us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:16.951001 (+ 1336us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3007643}
I20260617 07:53:16.951251 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e47ba449880147f6a1209c001192aa4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:16.951409 1170 tablet_replica.cc:333] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:16.951581 1170 raft_consensus.cc:2243] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:16.951752 1170 raft_consensus.cc:2272] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:16.951869 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e47ba449880147f6a1209c001192aa4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.952766 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet b7c5ff28367b42d3a3922d2b789bc7ec (table default.Table_1557e8110d1340518c2f713297b804f6 [id=d079dbab725b43c0807868020b551ccb]) successfully deleted
W20260617 07:53:16.955154 852 leader_election.cc:343] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:16.955283 852 leader_election.cc:304] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.955730 2086 raft_consensus.cc:2749] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.956305 1171 ts_tablet_manager.cc:1434] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260617 07:53:16.955899 887 tablet_service.cc:1511] Processing CreateTablet for tablet 0f55c9a85e6e4b5ea7f2014cd0b7921a (DEFAULT_TABLE table=default.Table_d97e42eee9e14d7ca1ec6f5caf5744e0 [id=702315feb8774f2385c4705b72491441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:16.956825 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 77) took 5228 ms. Trace:
I20260617 07:53:16.956961 1846 rpcz_store.cc:276] 0617 07:53:11.728509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.729962 (+ 1453us) service_pool.cc:224] Handling call
0617 07:53:16.956693 (+5226731us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:16.956704 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.956805 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5190365}
I20260617 07:53:16.957459 1846 tablet_replica.cc:333] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:16.957470 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65bf5384ec244d36ba3d4e781c5eb8a3 already in progress: creating tablet
I20260617 07:53:16.957683 1846 raft_consensus.cc:2243] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:16.958091 1846 raft_consensus.cc:2272] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:16.962872 1171 tablet_bootstrap.cc:492] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:16.958892 2125 raft_consensus.cc:493] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:16.965852 2125 raft_consensus.cc:515] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:16.966260 1846 ts_tablet_manager.cc:1916] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:16.966528 2125 leader_election.cc:290] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:16.967208 713 leader_election.cc:343] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 59acdc64fe9247d28c4c277161b42f4f
W20260617 07:53:16.967588 716 leader_election.cc:343] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 59acdc64fe9247d28c4c277161b42f4f
I20260617 07:53:16.967684 716 leader_election.cc:304] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:16.968068 2125 raft_consensus.cc:2749] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:16.969847 1171 tablet_bootstrap.cc:654] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:16.980036 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 369442b72f754ee08dc6a484d51f2e99
I20260617 07:53:16.980999 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c74efd8727684d22be93a779848e0837"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:16.981674 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c74efd8727684d22be93a779848e0837 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.983044 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 739cadc7ad124e229441333de949f2c6
I20260617 07:53:16.983542 455 catalog_manager.cc:6784] ReplaceTablet: tablet 739cadc7ad124e229441333de949f2c6 deleted and replaced by tablet 4f95a13b909c4ef9be6c56a317b42c9b
I20260617 07:53:16.983865 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_5ea958c04885438e835ca06d85721a8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:16.984373 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ea958c04885438e835ca06d85721a8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:16.985183 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet e03a26e301e747febc4d5bafdc1a49c6
I20260617 07:53:16.985170 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 369442b72f754ee08dc6a484d51f2e99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:16 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:16.985671 456 catalog_manager.cc:6784] ReplaceTablet: tablet e03a26e301e747febc4d5bafdc1a49c6 deleted and replaced by tablet d7b981da1d2e4862824e933dc8babefc
I20260617 07:53:16.985893 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 35120ce002f24f2bb1ea0fdc59fbfc9d from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:16.987697 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 739cadc7ad124e229441333de949f2c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f95a13b909c4ef9be6c56a317b42c9b) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:16.988025 884 tablet_service.cc:1558] Processing DeleteTablet for tablet e03a26e301e747febc4d5bafdc1a49c6 with delete_type TABLET_DATA_DELETED (replaced by tablet d7b981da1d2e4862824e933dc8babefc) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:16.989372 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 369442b72f754ee08dc6a484d51f2e99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:16 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.991874 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 739cadc7ad124e229441333de949f2c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f95a13b909c4ef9be6c56a317b42c9b) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.992297 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet e03a26e301e747febc4d5bafdc1a49c6 with delete_type TABLET_DATA_DELETED (replaced by tablet d7b981da1d2e4862824e933dc8babefc) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:16.998065 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 369442b72f754ee08dc6a484d51f2e99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:16 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.998267 741 tablet_service.cc:1558] Processing DeleteTablet for tablet e03a26e301e747febc4d5bafdc1a49c6 with delete_type TABLET_DATA_DELETED (replaced by tablet d7b981da1d2e4862824e933dc8babefc) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:16.998461 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 739cadc7ad124e229441333de949f2c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f95a13b909c4ef9be6c56a317b42c9b) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.000247 1846 ts_tablet_manager.cc:1929] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:17.000375 1846 log.cc:1199] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/0dc0676db18c42259efb1ad7dbd140c8
I20260617 07:53:17.000852 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 35120ce002f24f2bb1ea0fdc59fbfc9d
I20260617 07:53:17.001375 456 catalog_manager.cc:6784] ReplaceTablet: tablet 35120ce002f24f2bb1ea0fdc59fbfc9d deleted and replaced by tablet c449d3e251aa4f06a9191114bff0e0e2
I20260617 07:53:17.002460 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d with delete_type TABLET_DATA_DELETED (replaced by tablet c449d3e251aa4f06a9191114bff0e0e2) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:17.005236 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d with delete_type TABLET_DATA_DELETED (replaced by tablet c449d3e251aa4f06a9191114bff0e0e2) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:17.007426 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d with delete_type TABLET_DATA_DELETED (replaced by tablet c449d3e251aa4f06a9191114bff0e0e2) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.000841 1846 ts_tablet_manager.cc:1950] T 0dc0676db18c42259efb1ad7dbd140c8 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.009114 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 79) took 5264 ms. Trace:
I20260617 07:53:17.010177 2087 raft_consensus.cc:493] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.010311 2087 raft_consensus.cc:515] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.010985 2087 leader_election.cc:290] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.011883 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa1c1fdede041d28570b85e63c401b7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:17.012138 1046 raft_consensus.cc:2468] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:17.012537 851 leader_election.cc:304] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:17.011432 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa1c1fdede041d28570b85e63c401b7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.012893 2087 raft_consensus.cc:2804] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:17.012971 2087 raft_consensus.cc:493] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:17.013036 2087 raft_consensus.cc:3060] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:17.013068 852 leader_election.cc:343] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.013300 1846 rpcz_store.cc:276] 0617 07:53:11.744288 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.744368 (+ 80us) service_pool.cc:224] Handling call
0617 07:53:16.957415 (+5213047us) ts_tablet_manager.cc:1151] Deleting tablet 0dc0676db18c42259efb1ad7dbd140c8
0617 07:53:16.957424 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:16.985638 (+ 28214us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.000167 (+ 14529us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.009089 (+ 8922us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5190499}
I20260617 07:53:17.013799 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 0dc0676db18c42259efb1ad7dbd140c8 (table default.Table_54be22b2fb3540f292a5ffa5ab372d0a [id=fc566654678945ea95c7d40693557ac2]) successfully deleted
I20260617 07:53:17.013855 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 80) took 5268 ms. Trace:
I20260617 07:53:17.013926 1846 rpcz_store.cc:276] 0617 07:53:11.745095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.749224 (+ 4129us) service_pool.cc:224] Handling call
0617 07:53:17.013745 (+5264521us) ts_tablet_manager.cc:1151] Deleting tablet 36ce60b466f7420992ef194d72b5718d
0617 07:53:17.013755 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.013841 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5246552}
I20260617 07:53:17.014318 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 95) took 5267 ms. Trace:
I20260617 07:53:17.014391 1846 rpcz_store.cc:276] 0617 07:53:11.747054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:11.753469 (+ 6415us) service_pool.cc:224] Handling call
0617 07:53:17.014234 (+5260765us) ts_tablet_manager.cc:1151] Deleting tablet 245cff69d83b43e98b1c72b8d3011347
0617 07:53:17.014242 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.014307 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5203455}
W20260617 07:53:17.014508 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 36ce60b466f7420992ef194d72b5718d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ce60b466f7420992ef194d72b5718d already in progress: creating tablet
W20260617 07:53:17.014829 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 245cff69d83b43e98b1c72b8d3011347 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 245cff69d83b43e98b1c72b8d3011347 already in progress: creating tablet
W20260617 07:53:17.015259 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c019792d23484fb789378bf377547415 consensus state has no leader
I20260617 07:53:17.015583 2087 raft_consensus.cc:515] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.016991 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa1c1fdede041d28570b85e63c401b7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:17.017100 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa1c1fdede041d28570b85e63c401b7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:17.017246 1050 raft_consensus.cc:3060] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:17.017503 852 leader_election.cc:343] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.019865 1050 raft_consensus.cc:2468] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:17.020808 851 leader_election.cc:304] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:17.020944 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f55c9a85e6e4b5ea7f2014cd0b7921a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.021071 2201 raft_consensus.cc:2804] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:17.021166 2201 raft_consensus.cc:697] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:17.021322 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:17.021428 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 121) took 4172 ms. Trace:
I20260617 07:53:17.021394 2201 consensus_queue.cc:237] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.021492 1846 rpcz_store.cc:276] 0617 07:53:12.848530 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.854776 (+ 6246us) service_pool.cc:224] Handling call
0617 07:53:17.021312 (+4166536us) ts_tablet_manager.cc:1151] Deleting tablet 737e9344fc824714a2c2596170637158
0617 07:53:17.021321 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.021412 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4165943}
W20260617 07:53:17.021941 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 737e9344fc824714a2c2596170637158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 737e9344fc824714a2c2596170637158 already in progress: creating tablet
I20260617 07:53:17.021981 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 122) took 4166 ms. Trace:
I20260617 07:53:17.022047 1846 rpcz_store.cc:276] 0617 07:53:12.857843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.867745 (+ 9902us) service_pool.cc:224] Handling call
0617 07:53:17.021889 (+4154144us) ts_tablet_manager.cc:1151] Deleting tablet 121339ab4842432e9fb7bc357750f8ad
0617 07:53:17.021898 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.021966 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4153957}
W20260617 07:53:17.022360 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 121339ab4842432e9fb7bc357750f8ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 121339ab4842432e9fb7bc357750f8ad already in progress: creating tablet
I20260617 07:53:17.022694 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 123) took 4154 ms. Trace:
I20260617 07:53:17.022778 1846 rpcz_store.cc:276] 0617 07:53:12.871414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.871474 (+ 60us) service_pool.cc:224] Handling call
0617 07:53:17.022566 (+4151092us) ts_tablet_manager.cc:1151] Deleting tablet 596ef68705c84791b54f07e03b219b4c
0617 07:53:17.022577 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.022674 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4150610}
W20260617 07:53:17.023170 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 596ef68705c84791b54f07e03b219b4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596ef68705c84791b54f07e03b219b4c already in progress: creating tablet
I20260617 07:53:17.023418 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 124) took 4151 ms. Trace:
I20260617 07:53:17.023517 1846 rpcz_store.cc:276] 0617 07:53:12.872224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.872279 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:17.023315 (+4151036us) ts_tablet_manager.cc:1151] Deleting tablet 0be19ece3a0a4a51abad7b8e2f3b2420
0617 07:53:17.023323 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.023404 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4150831}
I20260617 07:53:17.024024 2087 leader_election.cc:290] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.024104 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 125) took 4151 ms. Trace:
I20260617 07:53:17.024179 1846 rpcz_store.cc:276] 0617 07:53:12.872680 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.872725 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:17.024007 (+4151282us) ts_tablet_manager.cc:1151] Deleting tablet e897b111e65c497591c7daaa81d783c7
0617 07:53:17.024016 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.024089 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4151099}
W20260617 07:53:17.024464 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0be19ece3a0a4a51abad7b8e2f3b2420 already in progress: creating tablet
W20260617 07:53:17.024700 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e897b111e65c497591c7daaa81d783c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e897b111e65c497591c7daaa81d783c7 already in progress: creating tablet
I20260617 07:53:17.027796 1170 ts_tablet_manager.cc:1916] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.027979 454 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:17.028257 454 catalog_manager.cc:5696] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:17.028630 454 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:17.028918 454 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:17.029241 454 catalog_manager.cc:5696] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:17.029572 454 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]). Expected version 1 got 0
I20260617 07:53:17.029855 454 catalog_manager.cc:5696] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 1 to 2, leader changed from dc3bec007846459a9da0c7b8211e477b (127.0.105.131) to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 2 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:17.030571 454 catalog_manager.cc:5696] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:17.031016 454 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:17.031183 826 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:17.031559 454 catalog_manager.cc:5696] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:17.034309 2359 raft_consensus.cc:493] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.034482 2359 raft_consensus.cc:515] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.035158 2359 leader_election.cc:290] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:17.035915 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121339ab4842432e9fb7bc357750f8ad" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.036302 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_65df8fca2c7142f98705a6eb19589171"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:17.036422 986 leader_election.cc:343] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.036690 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_611e903704f44d74af4777fe0a8c5210"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:17.036983 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121339ab4842432e9fb7bc357750f8ad" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:17.037137 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65df8fca2c7142f98705a6eb19589171 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:17.037143 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_611e903704f44d74af4777fe0a8c5210 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:17.037405 988 leader_election.cc:343] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.037508 988 leader_election.cc:304] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:17.037943 2359 raft_consensus.cc:2749] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.039767 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_5a33989a09d74eb2978b216ba46a372f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:17.040238 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a33989a09d74eb2978b216ba46a372f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:17.043308 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 130) took 4101 ms. Trace:
I20260617 07:53:17.043462 1846 rpcz_store.cc:276] 0617 07:53:12.942282 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.943502 (+ 1220us) service_pool.cc:224] Handling call
0617 07:53:17.043182 (+4099680us) ts_tablet_manager.cc:1151] Deleting tablet 1f6264adc3994c22864ea73106ba2320
0617 07:53:17.043192 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.043286 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4099468}
I20260617 07:53:17.044453 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 128) took 4143 ms. Trace:
I20260617 07:53:17.044579 1846 rpcz_store.cc:276] 0617 07:53:12.900798 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.924549 (+ 23751us) service_pool.cc:224] Handling call
0617 07:53:17.044066 (+4119517us) ts_tablet_manager.cc:1151] Deleting tablet 4de8df5e15cb43c0b95ec5af3110db66
0617 07:53:17.044074 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.044437 (+ 363us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4098212}
W20260617 07:53:17.044909 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 1f6264adc3994c22864ea73106ba2320 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6264adc3994c22864ea73106ba2320 already in progress: creating tablet
I20260617 07:53:17.045080 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 129) took 4120 ms. Trace:
I20260617 07:53:17.045199 1846 rpcz_store.cc:276] 0617 07:53:12.925134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:12.941881 (+ 16747us) service_pool.cc:224] Handling call
0617 07:53:17.044987 (+4103106us) ts_tablet_manager.cc:1151] Deleting tablet 99ec78c123d448329b8442a0de0140d3
0617 07:53:17.044996 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.045066 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4099076}
W20260617 07:53:17.045315 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4de8df5e15cb43c0b95ec5af3110db66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4de8df5e15cb43c0b95ec5af3110db66 already in progress: creating tablet
I20260617 07:53:17.039191 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_20dbf4b3ced34a5faf8d96930d179360"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:17.046204 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 131) took 4012 ms. Trace:
W20260617 07:53:17.046742 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20dbf4b3ced34a5faf8d96930d179360 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:17.051527 460 master_service.cc:960] ReplaceTablet: received request to replace tablet c9657e0dd2a8459cb728bdfe8a68b840 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:17.052733 1846 rpcz_store.cc:276] 0617 07:53:13.033927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.037979 (+ 4052us) service_pool.cc:224] Handling call
0617 07:53:17.046111 (+4008132us) ts_tablet_manager.cc:1151] Deleting tablet 71e8f7118aaf4c6a9b9caab5abc030fa
0617 07:53:17.046121 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.046191 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3974205}
I20260617 07:53:17.053503 1846 tablet_replica.cc:333] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.053836 1846 raft_consensus.cc:2243] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.055265 1846 raft_consensus.cc:2272] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.056353 2373 tablet.cc:1724] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 07:53:17.057618 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 99ec78c123d448329b8442a0de0140d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99ec78c123d448329b8442a0de0140d3 already in progress: creating tablet
I20260617 07:53:17.064111 1172 tablet_bootstrap.cc:492] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:17.070317 1178 tablet_bootstrap.cc:492] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:17.070966 1846 ts_tablet_manager.cc:1916] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.071767 1178 ts_tablet_manager.cc:1403] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.200s user 0.003s sys 0.000s
I20260617 07:53:17.072777 1178 raft_consensus.cc:359] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.072957 1178 raft_consensus.cc:385] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.073005 1178 raft_consensus.cc:740] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.073588 1172 ts_tablet_manager.cc:1403] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.171s user 0.001s sys 0.005s
I20260617 07:53:17.074338 1172 raft_consensus.cc:359] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.074507 1172 raft_consensus.cc:385] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.074555 1172 raft_consensus.cc:740] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.074733 1172 consensus_queue.cc:260] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.079185 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.079241 747 tablet_service.cc:1558] Processing DeleteTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.079416 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.079584 748 tablet_service.cc:1558] Processing DeleteTablet for tablet cc84665c7849469aa27e6505dbed1516 with delete_type TABLET_DATA_DELETED (replaced by tablet 71e8f7118aaf4c6a9b9caab5abc030fa) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.079619 749 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.079720 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.079857 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f9db8a986b344548e435b77edc14cb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 63bf519b83c445798bddda3120b542ce) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.079926 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.079984 747 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.080111 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.080157 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.082079 2374 tablet.cc:1724] T 75f32eb8ec894e029a428bbd62caa0f5 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:17.082733 747 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.082935 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.083006 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.083086 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 121339ab4842432e9fb7bc357750f8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.083218 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.083257 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.084138 747 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8388648475499db50cc16a7c36775a with delete_type TABLET_DATA_DELETED (replaced by tablet 0cfb98aecc4546c88371436fcfbf8e86) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.084174 741 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.088212 1170 ts_tablet_manager.cc:1929] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:17.090528 1846 ts_tablet_manager.cc:1929] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.090677 2086 raft_consensus.cc:493] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.090812 2086 raft_consensus.cc:515] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.091428 2086 leader_election.cc:290] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.092170 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e4068fdcbb41de966bcc72a4d1d426" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:17.093860 1046 raft_consensus.cc:2468] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:17.094404 851 leader_election.cc:304] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:17.094696 2086 raft_consensus.cc:2804] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:17.094764 2086 raft_consensus.cc:493] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:17.094831 2086 raft_consensus.cc:3060] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.094955 1170 log.cc:1199] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/ee0e12aa4c60457182201a94caecda45
I20260617 07:53:17.095369 1170 ts_tablet_manager.cc:1950] T ee0e12aa4c60457182201a94caecda45 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:17.091768 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e4068fdcbb41de966bcc72a4d1d426" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:17.096040 852 leader_election.cc:343] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.096290 2087 raft_consensus.cc:493] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.096392 2087 raft_consensus.cc:515] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.096896 2087 leader_election.cc:290] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.097002 2087 consensus_queue.cc:1048] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:17.097236 2086 raft_consensus.cc:515] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.097700 2086 leader_election.cc:290] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.099305 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e4068fdcbb41de966bcc72a4d1d426" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:17.099841 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03d6dc473fc4be1a436fd71a06f403e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:17.100530 852 leader_election.cc:343] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:17.100760 852 leader_election.cc:343] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.101019 1846 log.cc:1199] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/7934f5fa0287427cb45fe568f0de8758
I20260617 07:53:17.101486 1846 ts_tablet_manager.cc:1950] T 7934f5fa0287427cb45fe568f0de8758 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.098608 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e4068fdcbb41de966bcc72a4d1d426" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:17.101696 1050 raft_consensus.cc:3060] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.102072 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4564c55b79844903a7e9dfffd3c69096"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:17.102769 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4564c55b79844903a7e9dfffd3c69096 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:17.103818 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 140) took 3479 ms. Trace:
I20260617 07:53:17.103905 1846 rpcz_store.cc:276] 0617 07:53:13.624109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.626226 (+ 2117us) service_pool.cc:224] Handling call
0617 07:53:17.053440 (+3427214us) ts_tablet_manager.cc:1151] Deleting tablet 7934f5fa0287427cb45fe568f0de8758
0617 07:53:17.053455 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.070489 (+ 17034us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x60d000012e88. stack: 00007f168e262086 00007f168e261e40 00007f168d21b3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f168dfd5b3e 00007f168dfd1c1c 00007f168e0cd97b 00007f168e0cce4a 00007f168e0ca72e 00007f1699b0786c 00007f1699b2c8cd 00007f1699b37f51 00007f169b5e2cb9 00007f169e1a5ae7
0617 07:53:17.077297 (+ 6808us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.090459 (+ 13162us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.103784 (+ 13325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33099136,"tablet-delete.queue_time_us":3426958}
I20260617 07:53:17.104192 1050 raft_consensus.cc:2468] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:17.104498 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_871f52a414934a248bcacbe3399ccee8" } modify_external_catalogs: true
I20260617 07:53:17.104684 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_871f52a414934a248bcacbe3399ccee8" } modify_external_catalogs: true
I20260617 07:53:17.104998 851 leader_election.cc:304] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:17.105234 772 raft_consensus.cc:3060] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.105370 2086 raft_consensus.cc:2804] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:17.105476 2086 raft_consensus.cc:697] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:17.105693 2086 consensus_queue.cc:237] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.110013 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 7934f5fa0287427cb45fe568f0de8758 (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]) successfully deleted
I20260617 07:53:17.113345 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.113591 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.113690 741 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.113796 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:17.113929 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.117511 745 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.119473 1098 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:17.126739 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 175) took 3246 ms. Trace:
I20260617 07:53:17.073191 1178 consensus_queue.cc:260] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.127140 1170 rpcz_store.cc:276] 0617 07:53:13.880194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.880307 (+ 113us) service_pool.cc:224] Handling call
0617 07:53:16.951364 (+3071057us) ts_tablet_manager.cc:1151] Deleting tablet ee0e12aa4c60457182201a94caecda45
0617 07:53:16.951374 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.055228 (+103854us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.088150 (+ 32922us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.126615 (+ 38465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22795,"tablet-delete.queue_time_us":3070869}
I20260617 07:53:17.129992 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet ee0e12aa4c60457182201a94caecda45 (table default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]) successfully deleted
W20260617 07:53:17.130738 851 leader_election.cc:343] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: d03d6dc473fc4be1a436fd71a06f403e
I20260617 07:53:17.130870 851 leader_election.cc:304] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:17.131220 2201 raft_consensus.cc:2749] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.130354 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 142) took 3506 ms. Trace:
I20260617 07:53:17.131975 1170 tablet_replica.cc:333] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:17.132601 1172 ts_tablet_manager.cc:1434] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.059s user 0.001s sys 0.001s
I20260617 07:53:17.134232 1170 raft_consensus.cc:2243] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.133781 1846 rpcz_store.cc:276] 0617 07:53:13.624251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.626580 (+ 2329us) service_pool.cc:224] Handling call
0617 07:53:17.128420 (+3501840us) ts_tablet_manager.cc:1151] Deleting tablet 9618a5c0c9dd4c368f5763c434f70da5
0617 07:53:17.128766 (+ 346us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.129951 (+ 1185us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3501518}
I20260617 07:53:17.135475 2201 raft_consensus.cc:493] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.135624 2201 raft_consensus.cc:515] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.136300 2201 leader_election.cc:290] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.138187 1170 raft_consensus.cc:2272] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.138821 1172 tablet_bootstrap.cc:492] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:17.136984 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.137194 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2777cf575a914f59b3459f3ce96f5d9a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.135349 1178 ts_tablet_manager.cc:1434] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.063s user 0.001s sys 0.001s
I20260617 07:53:17.141898 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2777cf575a914f59b3459f3ce96f5d9a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:17.142773 1178 tablet_bootstrap.cc:492] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:17.142786 852 leader_election.cc:343] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:17.143267 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9618a5c0c9dd4c368f5763c434f70da5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9618a5c0c9dd4c368f5763c434f70da5 already in progress: creating tablet
I20260617 07:53:17.143808 1052 raft_consensus.cc:2468] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:17.145634 851 leader_election.cc:304] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:17.145859 1170 ts_tablet_manager.cc:1916] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.146402 2201 raft_consensus.cc:2804] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:17.146517 2201 raft_consensus.cc:493] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:17.146605 2201 raft_consensus.cc:3060] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.150130 2201 raft_consensus.cc:515] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.151799 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b] alter complete (version 1)
I20260617 07:53:17.152810 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2777cf575a914f59b3459f3ce96f5d9a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:17.153007 1050 raft_consensus.cc:3060] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.156289 1050 raft_consensus.cc:2468] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:17.157176 851 leader_election.cc:304] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:17.157406 2087 raft_consensus.cc:2804] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:17.157498 2087 raft_consensus.cc:697] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:17.157737 2087 consensus_queue.cc:237] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.160337 2087 consensus_queue.cc:1048] T 464cf1effff241608f4a7255f2646b04 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:17.161119 2201 leader_election.cc:290] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.176034 1862 ts_tablet_manager.cc:1929] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:17.151677 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2777cf575a914f59b3459f3ce96f5d9a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:17.156776 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.173827 747 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:17.177980 852 leader_election.cc:343] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.175668 2125 raft_consensus.cc:493] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.178225 2125 raft_consensus.cc:515] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.178802 2125 leader_election.cc:290] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:17.178980 1862 log.cc:1199] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/ee0e12aa4c60457182201a94caecda45
I20260617 07:53:17.182112 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:17.182729 716 leader_election.cc:343] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 2684f3200e604bb6bf37a2f97a193eff
I20260617 07:53:17.182996 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.182986 1171 tablet_bootstrap.cc:492] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:17.184047 1171 ts_tablet_manager.cc:1403] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.221s user 0.045s sys 0.065s
I20260617 07:53:17.188827 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:17.190331 852 consensus_peers.cc:597] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:17.190728 713 leader_election.cc:343] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 2684f3200e604bb6bf37a2f97a193eff
I20260617 07:53:17.190842 713 leader_election.cc:304] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:17.191058 2125 raft_consensus.cc:2749] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.145241 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 143) took 3520 ms. Trace:
I20260617 07:53:17.191944 1846 rpcz_store.cc:276] 0617 07:53:13.624318 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.626773 (+ 2455us) service_pool.cc:224] Handling call
0617 07:53:17.143891 (+3517118us) ts_tablet_manager.cc:1151] Deleting tablet 63bf519b83c445798bddda3120b542ce
0617 07:53:17.143905 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.144991 (+ 1086us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3516704}
I20260617 07:53:17.192548 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:17.196213 1846 tablet_replica.cc:333] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.196455 1846 raft_consensus.cc:2243] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.196925 887 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:17.197122 1846 raft_consensus.cc:2272] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.198688 1846 ts_tablet_manager.cc:1916] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.199049 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:17.199272 1171 raft_consensus.cc:359] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.202845 1171 raft_consensus.cc:385] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.203891 1171 raft_consensus.cc:740] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.210466 1171 consensus_queue.cc:260] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.215199 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ec78c123d448329b8442a0de0140d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:17.218264 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 63bf519b83c445798bddda3120b542ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bf519b83c445798bddda3120b542ce already in progress: creating tablet
I20260617 07:53:17.219108 1171 ts_tablet_manager.cc:1434] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.033s user 0.004s sys 0.000s
I20260617 07:53:17.222295 1171 tablet_bootstrap.cc:492] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:17.225697 1846 ts_tablet_manager.cc:1929] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.228298 1846 log.cc:1199] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/cb95639e16ed423fbe60b15a1bcdf5a6
I20260617 07:53:17.228740 1846 ts_tablet_manager.cc:1950] T cb95639e16ed423fbe60b15a1bcdf5a6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:17.231613 2382 log.cc:927] Time spent T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260617 07:53:17.234565 1172 tablet_bootstrap.cc:654] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.245554 2201 consensus_queue.cc:1048] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:17.245646 1171 tablet_bootstrap.cc:654] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.246446 1862 ts_tablet_manager.cc:1950] T ee0e12aa4c60457182201a94caecda45 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:17.238834 2125 raft_consensus.cc:493] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.248976 2125 raft_consensus.cc:515] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.249665 2125 leader_election.cc:290] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:17.250290 713 leader_election.cc:343] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: df37ed81b17d4178adeb6057491b4cc9
I20260617 07:53:17.244907 2359 raft_consensus.cc:493] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.267978 2359 raft_consensus.cc:515] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.268707 2359 leader_election.cc:290] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:17.270161 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24066965db7141a6a970ec08f835a820" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:17.270804 986 leader_election.cc:343] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.242738 1178 tablet_bootstrap.cc:654] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.245957 2364 tablet.cc:1724] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:17.271298 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 570ae1e189a64da6bad10156b401ec46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.273547 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 144) took 3649 ms. Trace:
I20260617 07:53:17.274827 772 raft_consensus.cc:3060] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.275472 2364 tablet.cc:1724] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:17.279022 1846 rpcz_store.cc:276] 0617 07:53:13.624423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.626980 (+ 2557us) service_pool.cc:224] Handling call
0617 07:53:17.196158 (+3569178us) ts_tablet_manager.cc:1151] Deleting tablet cb95639e16ed423fbe60b15a1bcdf5a6
0617 07:53:17.196170 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.208960 (+ 12790us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.225632 (+ 16672us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.273530 (+ 47898us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3568988}
I20260617 07:53:17.280447 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet cb95639e16ed423fbe60b15a1bcdf5a6 (table default.Table_1e6b5c822e34499dac5e7bda83d587b2 [id=f2f2591e0ed7444d87b0149a964ba958]) successfully deleted
I20260617 07:53:17.280550 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 145) took 3656 ms. Trace:
I20260617 07:53:17.280824 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24066965db7141a6a970ec08f835a820" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:17.281366 716 leader_election.cc:343] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: df37ed81b17d4178adeb6057491b4cc9
I20260617 07:53:17.281461 716 leader_election.cc:304] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:17.281855 2125 raft_consensus.cc:2749] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:17.282380 988 leader_election.cc:343] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.282495 988 leader_election.cc:304] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:17.282928 2359 raft_consensus.cc:2749] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.282989 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 192) took 3430 ms. Trace:
I20260617 07:53:17.283087 1862 rpcz_store.cc:276] 0617 07:53:13.852216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.852256 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:16.840183 (+2987927us) ts_tablet_manager.cc:1151] Deleting tablet ee0e12aa4c60457182201a94caecda45
0617 07:53:16.840192 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.093931 (+253739us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.174345 (+ 80414us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.282954 (+108609us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2987782}
I20260617 07:53:17.280745 1846 rpcz_store.cc:276] 0617 07:53:13.624492 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.627213 (+ 2721us) service_pool.cc:224] Handling call
0617 07:53:17.280411 (+3653198us) ts_tablet_manager.cc:1151] Deleting tablet 0fd8cedb539748dc917128511325bbcc
0617 07:53:17.280424 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.280533 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3653025}
I20260617 07:53:17.283552 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet ee0e12aa4c60457182201a94caecda45 (table default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]) successfully deleted
I20260617 07:53:17.283970 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 147) took 3659 ms. Trace:
W20260617 07:53:17.283826 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0fd8cedb539748dc917128511325bbcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd8cedb539748dc917128511325bbcc already in progress: creating tablet
I20260617 07:53:17.284097 1846 rpcz_store.cc:276] 0617 07:53:13.624634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.627444 (+ 2810us) service_pool.cc:224] Handling call
0617 07:53:17.283867 (+3656423us) ts_tablet_manager.cc:1151] Deleting tablet 18f9bace06e34602acc7fcd7501b3671
0617 07:53:17.283877 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.283955 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3656263}
W20260617 07:53:17.284578 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 18f9bace06e34602acc7fcd7501b3671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18f9bace06e34602acc7fcd7501b3671 already in progress: creating tablet
I20260617 07:53:17.284710 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 148) took 3659 ms. Trace:
I20260617 07:53:17.284817 1846 rpcz_store.cc:276] 0617 07:53:13.624713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.627631 (+ 2918us) service_pool.cc:224] Handling call
0617 07:53:17.284565 (+3656934us) ts_tablet_manager.cc:1151] Deleting tablet 6d8f144d04af4ea18f99aee3b82f4a28
0617 07:53:17.284574 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.284641 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3656722}
W20260617 07:53:17.285199 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
I20260617 07:53:17.285231 1846 tablet_replica.cc:333] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.285454 1846 raft_consensus.cc:2243] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.285668 1846 raft_consensus.cc:2272] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.286329 1846 ts_tablet_manager.cc:1916] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.289848 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 245cff69d83b43e98b1c72b8d3011347 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.290458 1862 tablet_replica.cc:333] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:17.294052 741 tablet_service.cc:1558] Processing DeleteTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.294217 1862 raft_consensus.cc:2243] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:17.294508 1862 pending_rounds.cc:70] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:17.294600 1862 pending_rounds.cc:77] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772735560105984 op_type: NO_OP noop_request { }
I20260617 07:53:17.294724 1862 raft_consensus.cc:2889] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:17.294828 1862 raft_consensus.cc:2272] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.295825 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.300976 1172 tablet_bootstrap.cc:492] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:17.301128 1172 ts_tablet_manager.cc:1403] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.166s user 0.002s sys 0.002s
I20260617 07:53:17.301940 1172 raft_consensus.cc:359] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.303059 1172 raft_consensus.cc:385] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.303308 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 4996cde4d1514aa081257c802339abe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.303267 1172 raft_consensus.cc:740] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.303894 1172 consensus_queue.cc:260] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.304319 741 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.304807 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.306378 1178 tablet_bootstrap.cc:492] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:17.306514 1178 ts_tablet_manager.cc:1403] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.164s user 0.002s sys 0.002s
I20260617 07:53:17.307228 1178 raft_consensus.cc:359] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.307389 1178 raft_consensus.cc:385] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.307442 1178 raft_consensus.cc:740] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.307845 1178 consensus_queue.cc:260] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.309165 1178 ts_tablet_manager.cc:1434] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:17.312954 1846 ts_tablet_manager.cc:1929] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:17.315080 1172 ts_tablet_manager.cc:1434] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
W20260617 07:53:17.317128 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 9ed59705e05148f991844d47882dc151 (table default.Table_02ab5db216a449ff8e508fcc459791ae [id=13962b79508f4053b5cb01cd5e6b8b27], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9ed59705e05148f991844d47882dc151 consensus state has no leader
I20260617 07:53:17.313575 2364 tablet.cc:1724] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:17.314170 1178 tablet_bootstrap.cc:492] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:17.318269 1846 log.cc:1199] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/f2ce51c155c04897a4cf8f7b4ac9a5c6
I20260617 07:53:17.318511 1862 ts_tablet_manager.cc:1916] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.318749 1846 ts_tablet_manager.cc:1950] T f2ce51c155c04897a4cf8f7b4ac9a5c6 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.319476 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 149) took 3694 ms. Trace:
I20260617 07:53:17.319564 1846 rpcz_store.cc:276] 0617 07:53:13.624801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.627876 (+ 3075us) service_pool.cc:224] Handling call
0617 07:53:17.285195 (+3657319us) ts_tablet_manager.cc:1151] Deleting tablet f2ce51c155c04897a4cf8f7b4ac9a5c6
0617 07:53:17.285203 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.310142 (+ 24939us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.312902 (+ 2760us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.319459 (+ 6557us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3657160}
I20260617 07:53:17.319986 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 (table default.Table_bbc95ce139d8435387c7952fa8812d3b [id=7a019b84bca74a3cbd26a8fe985488ff]) successfully deleted
I20260617 07:53:17.321401 1172 tablet_bootstrap.cc:492] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:17.322347 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 150) took 3697 ms. Trace:
I20260617 07:53:17.322429 1846 rpcz_store.cc:276] 0617 07:53:13.624910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.628391 (+ 3481us) service_pool.cc:224] Handling call
0617 07:53:17.322236 (+3693845us) ts_tablet_manager.cc:1151] Deleting tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
0617 07:53:17.322245 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.322331 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3693641}
I20260617 07:53:17.326252 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 146) took 3701 ms. Trace:
I20260617 07:53:17.326638 1846 rpcz_store.cc:276] 0617 07:53:13.624558 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.627404 (+ 2846us) service_pool.cc:224] Handling call
0617 07:53:17.326148 (+3698744us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:17.326157 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.326236 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3684010}
W20260617 07:53:17.322824 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 already in progress: creating tablet
W20260617 07:53:17.327180 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e9488e8a501e404f85540fb045d8916f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9488e8a501e404f85540fb045d8916f already in progress: creating tablet
I20260617 07:53:17.327337 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 141) took 3703 ms. Trace:
I20260617 07:53:17.327674 1846 rpcz_store.cc:276] 0617 07:53:13.624181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.626513 (+ 2332us) service_pool.cc:224] Handling call
0617 07:53:17.327239 (+3700726us) ts_tablet_manager.cc:1151] Deleting tablet df5224716de249e9be9d7239407579a9
0617 07:53:17.327248 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.327322 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3666059}
W20260617 07:53:17.328244 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df5224716de249e9be9d7239407579a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df5224716de249e9be9d7239407579a9 already in progress: creating tablet
I20260617 07:53:17.328596 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 139) took 3704 ms. Trace:
I20260617 07:53:17.328852 1846 rpcz_store.cc:276] 0617 07:53:13.623986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.629293 (+ 5307us) service_pool.cc:224] Handling call
0617 07:53:17.328250 (+3698957us) ts_tablet_manager.cc:1151] Deleting tablet 706373f1f5d44edf81ed04183a8bdf89
0617 07:53:17.328504 (+ 254us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.328580 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3666923}
I20260617 07:53:17.329491 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 151) took 3700 ms. Trace:
I20260617 07:53:17.329805 1846 rpcz_store.cc:276] 0617 07:53:13.630636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.630772 (+ 136us) service_pool.cc:224] Handling call
0617 07:53:17.329400 (+3698628us) ts_tablet_manager.cc:1151] Deleting tablet a38bb8a140ef4bcab65aaa03bdb79040
0617 07:53:17.329407 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.329475 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3667906}
I20260617 07:53:17.330348 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_768b8c0a1c2b4100aa62ae9ce4250864" } new_table_name: "default.Table_5d79edb7235749f78af1a31e98d3d016" modify_external_catalogs: true
I20260617 07:53:17.330422 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 158) took 3654 ms. Trace:
I20260617 07:53:17.330485 1846 rpcz_store.cc:276] 0617 07:53:13.675618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.675807 (+ 189us) service_pool.cc:224] Handling call
0617 07:53:17.330335 (+3654528us) ts_tablet_manager.cc:1151] Deleting tablet 51e757e6f4ce4c6eb8223c4b6955245e
0617 07:53:17.330343 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.330410 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3654297}
I20260617 07:53:17.331485 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 159) took 3655 ms. Trace:
I20260617 07:53:17.331825 1846 rpcz_store.cc:276] 0617 07:53:13.675763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.676075 (+ 312us) service_pool.cc:224] Handling call
0617 07:53:17.331392 (+3655317us) ts_tablet_manager.cc:1151] Deleting tablet e55d63a25a2845dbbcce20e560361007
0617 07:53:17.331401 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.331469 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3655145}
I20260617 07:53:17.332401 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 152) took 3701 ms. Trace:
I20260617 07:53:17.332631 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_86c3fe6446874d28b25252b953f8c730" } modify_external_catalogs: true
I20260617 07:53:17.333082 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_86c3fe6446874d28b25252b953f8c730" } modify_external_catalogs: true
I20260617 07:53:17.334039 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2da085a4502d4943857234839bbbf9d9" } modify_external_catalogs: true
I20260617 07:53:17.334213 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2da085a4502d4943857234839bbbf9d9" } modify_external_catalogs: true
I20260617 07:53:17.337904 1846 rpcz_store.cc:276] 0617 07:53:13.644647 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.644692 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:17.332310 (+3687618us) ts_tablet_manager.cc:1151] Deleting tablet 630e540a77374c11895ab5a0e394b3bb
0617 07:53:17.332318 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.332386 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3635958}
I20260617 07:53:17.338692 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 153) took 3687 ms. Trace:
I20260617 07:53:17.339061 1846 rpcz_store.cc:276] 0617 07:53:13.650760 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.650804 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:17.338603 (+3687799us) ts_tablet_manager.cc:1151] Deleting tablet 80f67a6c1dcf4a69842452c371a9c078
0617 07:53:17.338613 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.338676 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3624208}
I20260617 07:53:17.339716 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 155) took 3682 ms. Trace:
I20260617 07:53:17.340029 1846 rpcz_store.cc:276] 0617 07:53:13.657145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.657190 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:17.339643 (+3682453us) ts_tablet_manager.cc:1151] Deleting tablet 7582d201bc5843949d4be08ee7586f9d
0617 07:53:17.339653 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.339703 (+ 50us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3581831}
I20260617 07:53:17.340643 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 156) took 3682 ms. Trace:
I20260617 07:53:17.340960 1846 rpcz_store.cc:276] 0617 07:53:13.658686 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.658731 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:17.340574 (+3681843us) ts_tablet_manager.cc:1151] Deleting tablet d7309d2b22c849ce980fd263a29ac77f
0617 07:53:17.340582 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.340630 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3581297}
I20260617 07:53:17.343051 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 161) took 3589 ms. Trace:
I20260617 07:53:17.343312 1846 rpcz_store.cc:276] 0617 07:53:13.753702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.753826 (+ 124us) service_pool.cc:224] Handling call
0617 07:53:17.341533 (+3587707us) ts_tablet_manager.cc:1151] Deleting tablet 3ae9261c0ac94defaecfc7d14ba1ae61
0617 07:53:17.341701 (+ 168us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.343034 (+ 1333us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3578405}
I20260617 07:53:17.343950 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 160) took 3667 ms. Trace:
I20260617 07:53:17.344297 1846 rpcz_store.cc:276] 0617 07:53:13.753084 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.753228 (+ 144us) service_pool.cc:224] Handling call
0617 07:53:17.343877 (+3590649us) ts_tablet_manager.cc:1151] Deleting tablet 19f8525046964950884b0f9aa515ec81
0617 07:53:17.343886 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.343934 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3580634}
I20260617 07:53:17.344946 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 154) took 3693 ms. Trace:
I20260617 07:53:17.345280 1846 rpcz_store.cc:276] 0617 07:53:13.651254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.651299 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:17.344875 (+3693576us) ts_tablet_manager.cc:1151] Deleting tablet 82cf9c672f3b4567b63e878a6ab11334
0617 07:53:17.344884 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.344932 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3580707}
I20260617 07:53:17.345659 965 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:17.346153 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 162) took 3591 ms. Trace:
I20260617 07:53:17.346493 1846 rpcz_store.cc:276] 0617 07:53:13.754660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.754737 (+ 77us) service_pool.cc:224] Handling call
0617 07:53:17.346059 (+3591322us) ts_tablet_manager.cc:1151] Deleting tablet 84f498f551ff4767bd16628b03f55ae2
0617 07:53:17.346067 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.346136 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3569454}
W20260617 07:53:17.346969 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 706373f1f5d44edf81ed04183a8bdf89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 706373f1f5d44edf81ed04183a8bdf89 already in progress: creating tablet
I20260617 07:53:17.347193 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 157) took 3687 ms. Trace:
I20260617 07:53:17.347527 1846 rpcz_store.cc:276] 0617 07:53:13.659380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.659433 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:17.347101 (+3687668us) ts_tablet_manager.cc:1151] Deleting tablet 9436fb7fca094eaab925748e254b1a62
0617 07:53:17.347109 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.347178 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3550279}
W20260617 07:53:17.347595 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a38bb8a140ef4bcab65aaa03bdb79040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a38bb8a140ef4bcab65aaa03bdb79040 already in progress: creating tablet
I20260617 07:53:17.348120 1846 tablet_replica.cc:333] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:17.348258 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e757e6f4ce4c6eb8223c4b6955245e already in progress: creating tablet
I20260617 07:53:17.348482 1846 raft_consensus.cc:2243] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.348511 1178 tablet_bootstrap.cc:654] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:17.348847 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
W20260617 07:53:17.349073 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 80f67a6c1dcf4a69842452c371a9c078 because the tablet was not found. No further retry: Not found: Tablet not found: 80f67a6c1dcf4a69842452c371a9c078
I20260617 07:53:17.348888 1846 raft_consensus.cc:2272] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.349573 1846 ts_tablet_manager.cc:1916] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:17.350087 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7582d201bc5843949d4be08ee7586f9d because the tablet was not found. No further retry: Not found: Tablet not found: 7582d201bc5843949d4be08ee7586f9d
W20260617 07:53:17.351333 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d7309d2b22c849ce980fd263a29ac77f because the tablet was not found. No further retry: Not found: Tablet not found: d7309d2b22c849ce980fd263a29ac77f
W20260617 07:53:17.352072 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae9261c0ac94defaecfc7d14ba1ae61 already in progress: creating tablet
W20260617 07:53:17.352846 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 19f8525046964950884b0f9aa515ec81 because the tablet was not found. No further retry: Not found: Tablet not found: 19f8525046964950884b0f9aa515ec81
W20260617 07:53:17.353550 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 82cf9c672f3b4567b63e878a6ab11334 because the tablet was not found. No further retry: Not found: Tablet not found: 82cf9c672f3b4567b63e878a6ab11334
W20260617 07:53:17.354323 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 84f498f551ff4767bd16628b03f55ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84f498f551ff4767bd16628b03f55ae2 already in progress: creating tablet
I20260617 07:53:17.357419 1172 tablet_bootstrap.cc:654] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.351055 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 283c08c31718433e83f0cedd799215fe
I20260617 07:53:17.359053 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 283c08c31718433e83f0cedd799215fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:17.359488 887 tablet_service.cc:1511] Processing CreateTablet for tablet fa6e25c657294fe2916fe1b121c1df9a (DEFAULT_TABLE table=default.Table_8ef09b6d20804caab974dc8388100817 [id=2bf2a7bc4ea94fa6bba50c8f95a7ab12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.359686 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 283c08c31718433e83f0cedd799215fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:17.359946 2386 raft_consensus.cc:493] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.360103 1018 tablet_service.cc:1511] Processing CreateTablet for tablet fa6e25c657294fe2916fe1b121c1df9a (DEFAULT_TABLE table=default.Table_8ef09b6d20804caab974dc8388100817 [id=2bf2a7bc4ea94fa6bba50c8f95a7ab12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.360488 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6e25c657294fe2916fe1b121c1df9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.360122 2386 raft_consensus.cc:515] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.361646 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de8df5e15cb43c0b95ec5af3110db66" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:17.362167 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de8df5e15cb43c0b95ec5af3110db66" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:17.362780 986 leader_election.cc:343] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:17.363256 988 leader_election.cc:343] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.363364 988 leader_election.cc:304] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:17.363555 2389 raft_consensus.cc:2749] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.363677 885 tablet_service.cc:1511] Processing CreateTablet for tablet a098a67c560741cca5552a455677e3ef (DEFAULT_TABLE table=default.Table_63f137a9bd9d4e5d8dcc35f9bbba57b3 [id=9d288a705558422dbda732e302513410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.363942 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6e25c657294fe2916fe1b121c1df9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.364214 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a098a67c560741cca5552a455677e3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.365952 1021 tablet_service.cc:1511] Processing CreateTablet for tablet a098a67c560741cca5552a455677e3ef (DEFAULT_TABLE table=default.Table_63f137a9bd9d4e5d8dcc35f9bbba57b3 [id=9d288a705558422dbda732e302513410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.366282 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a098a67c560741cca5552a455677e3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.370045 772 raft_consensus.cc:1275] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260617 07:53:17.370247 886 tablet_service.cc:1511] Processing CreateTablet for tablet b71de673a2c349cabc0d9ddc6bc8af38 (DEFAULT_TABLE table=default.Table_734685dc77ad4399a96c6bf50408058d [id=d86b4b3ca7704597adc81cd4f8e7a4b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.370635 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71de673a2c349cabc0d9ddc6bc8af38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.373971 2086 consensus_queue.cc:1048] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260617 07:53:17.375073 1022 tablet_service.cc:1511] Processing CreateTablet for tablet b71de673a2c349cabc0d9ddc6bc8af38 (DEFAULT_TABLE table=default.Table_734685dc77ad4399a96c6bf50408058d [id=d86b4b3ca7704597adc81cd4f8e7a4b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.375595 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71de673a2c349cabc0d9ddc6bc8af38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.363999 2386 leader_election.cc:290] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:17.360515 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_849fe4b41f7c48b8a8619a4f5f78e368" } new_table_name: "default.Table_cf59fff4b93345819e95a268c92f8c64" modify_external_catalogs: true
I20260617 07:53:17.374807 1172 tablet_bootstrap.cc:492] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:17.384217 456 catalog_manager.cc:5696] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:17.384683 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:17.384950 456 catalog_manager.cc:5696] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:17.384411 1172 ts_tablet_manager.cc:1403] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.005s
I20260617 07:53:17.385468 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:17.386279 887 tablet_service.cc:1511] Processing CreateTablet for tablet 17817982deee450490b16632363e4eda (DEFAULT_TABLE table=default.Table_380e0756ecdc418ab063466b537673ed [id=becee69f94094912a28ae62e41c66229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.386751 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17817982deee450490b16632363e4eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.386893 1178 tablet_bootstrap.cc:492] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:17.387019 1178 ts_tablet_manager.cc:1403] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.002s
I20260617 07:53:17.387605 1178 raft_consensus.cc:359] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.387754 1178 raft_consensus.cc:385] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.387801 1178 raft_consensus.cc:740] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
W20260617 07:53:17.380244 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
I20260617 07:53:17.388613 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 283c08c31718433e83f0cedd799215fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.388917 746 tablet_service.cc:1511] Processing CreateTablet for tablet b71de673a2c349cabc0d9ddc6bc8af38 (DEFAULT_TABLE table=default.Table_734685dc77ad4399a96c6bf50408058d [id=d86b4b3ca7704597adc81cd4f8e7a4b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.388944 741 tablet_service.cc:1511] Processing CreateTablet for tablet fa6e25c657294fe2916fe1b121c1df9a (DEFAULT_TABLE table=default.Table_8ef09b6d20804caab974dc8388100817 [id=2bf2a7bc4ea94fa6bba50c8f95a7ab12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.389000 747 tablet_service.cc:1511] Processing CreateTablet for tablet 17817982deee450490b16632363e4eda (DEFAULT_TABLE table=default.Table_380e0756ecdc418ab063466b537673ed [id=becee69f94094912a28ae62e41c66229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.388103 1178 consensus_queue.cc:260] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.389703 1178 ts_tablet_manager.cc:1434] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:17.390146 1171 tablet_bootstrap.cc:492] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:17.390216 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71de673a2c349cabc0d9ddc6bc8af38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.392222 1047 raft_consensus.cc:1275] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260617 07:53:17.393628 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6e25c657294fe2916fe1b121c1df9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.393970 745 tablet_service.cc:1511] Processing CreateTablet for tablet a098a67c560741cca5552a455677e3ef (DEFAULT_TABLE table=default.Table_63f137a9bd9d4e5d8dcc35f9bbba57b3 [id=9d288a705558422dbda732e302513410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.394272 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a098a67c560741cca5552a455677e3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.394443 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17817982deee450490b16632363e4eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.396166 1178 tablet_bootstrap.cc:492] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:17.402774 1172 raft_consensus.cc:359] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.404066 1172 raft_consensus.cc:385] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.404582 1172 raft_consensus.cc:740] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.406399 1172 consensus_queue.cc:260] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.408002 1178 tablet_bootstrap.cc:654] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.410691 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 17817982deee450490b16632363e4eda (DEFAULT_TABLE table=default.Table_380e0756ecdc418ab063466b537673ed [id=becee69f94094912a28ae62e41c66229]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.416586 1846 ts_tablet_manager.cc:1929] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.416707 1846 log.cc:1199] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/301bd4d6faec429ba71ce354c23d0f75
I20260617 07:53:17.392793 1898 consensus_queue.cc:1048] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260617 07:53:17.421041 1846 ts_tablet_manager.cc:1950] T 301bd4d6faec429ba71ce354c23d0f75 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.422086 886 tablet_service.cc:1511] Processing CreateTablet for tablet 3b93927458aa4ea29ea88c2efdcad52f (DEFAULT_TABLE table=default.Table_34966dbc9ee4429b877502acdc5ebe3c [id=b82a97c081f84a0da990cd1f0367638d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.423432 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17817982deee450490b16632363e4eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.411062 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 18e866278bb64196ba96e7d870195362 (DEFAULT_TABLE table=default.Table_2d9822f4cc9f41dbbbe65fe0b30fc2a5 [id=534b2735159a4ac8b7ecee572f406f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.424152 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e866278bb64196ba96e7d870195362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.412436 1172 ts_tablet_manager.cc:1434] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.027s user 0.001s sys 0.002s
I20260617 07:53:17.417238 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 3b93927458aa4ea29ea88c2efdcad52f (DEFAULT_TABLE table=default.Table_34966dbc9ee4429b877502acdc5ebe3c [id=b82a97c081f84a0da990cd1f0367638d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.424911 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b93927458aa4ea29ea88c2efdcad52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.425086 1172 tablet_bootstrap.cc:492] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:17.429399 884 tablet_service.cc:1511] Processing CreateTablet for tablet ed5563cfe75940168702bf237d8647cd (DEFAULT_TABLE table=default.Table_ac5369fc08d64d709036b33d6d55d2c2 [id=5323298149d34446bab6c875f3bcd0d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.431563 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5563cfe75940168702bf237d8647cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.432276 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b93927458aa4ea29ea88c2efdcad52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.437610 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 163) took 3673 ms. Trace:
I20260617 07:53:17.437793 1846 rpcz_store.cc:276] 0617 07:53:13.764508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.764556 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:17.348078 (+3583522us) ts_tablet_manager.cc:1151] Deleting tablet 301bd4d6faec429ba71ce354c23d0f75
0617 07:53:17.348088 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.402951 (+ 54863us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.416526 (+ 13575us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.437591 (+ 21065us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3550874}
I20260617 07:53:17.438330 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 166) took 3631 ms. Trace:
I20260617 07:53:17.409664 885 tablet_service.cc:1511] Processing CreateTablet for tablet 18e866278bb64196ba96e7d870195362 (DEFAULT_TABLE table=default.Table_2d9822f4cc9f41dbbbe65fe0b30fc2a5 [id=534b2735159a4ac8b7ecee572f406f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.438642 1846 rpcz_store.cc:276] 0617 07:53:13.806848 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.808199 (+ 1351us) service_pool.cc:224] Handling call
0617 07:53:17.438180 (+3629981us) ts_tablet_manager.cc:1151] Deleting tablet d965aa4e8dc244cdb93dd15cdee9070c
0617 07:53:17.438188 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.438303 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3623736}
I20260617 07:53:17.439404 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 165) took 3633 ms. Trace:
I20260617 07:53:17.439778 1846 rpcz_store.cc:276] 0617 07:53:13.806279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.808720 (+ 2441us) service_pool.cc:224] Handling call
0617 07:53:17.439308 (+3630588us) ts_tablet_manager.cc:1151] Deleting tablet 4d9ace137c4e496fafac4e729718577f
0617 07:53:17.439317 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.439391 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3622119}
I20260617 07:53:17.440410 1846 tablet_replica.cc:333] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.440791 1846 raft_consensus.cc:2243] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.441246 2386 raft_consensus.cc:493] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.441334 1846 raft_consensus.cc:2272] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.441519 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e866278bb64196ba96e7d870195362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.441568 2386 raft_consensus.cc:515] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.441886 1846 ts_tablet_manager.cc:1916] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.443110 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f90a0d37cb483faa540451bf4dbe85" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:17.443699 986 leader_election.cc:343] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.444195 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f90a0d37cb483faa540451bf4dbe85" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:17.444641 988 leader_election.cc:343] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.444115 2386 leader_election.cc:290] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:17.444742 988 leader_election.cc:304] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:17.445549 2386 raft_consensus.cc:2749] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.446108 1018 tablet_service.cc:1511] Processing CreateTablet for tablet ed5563cfe75940168702bf237d8647cd (DEFAULT_TABLE table=default.Table_ac5369fc08d64d709036b33d6d55d2c2 [id=5323298149d34446bab6c875f3bcd0d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.446480 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5563cfe75940168702bf237d8647cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.449556 746 tablet_service.cc:1511] Processing CreateTablet for tablet 18e866278bb64196ba96e7d870195362 (DEFAULT_TABLE table=default.Table_2d9822f4cc9f41dbbbe65fe0b30fc2a5 [id=534b2735159a4ac8b7ecee572f406f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.449597 1172 tablet_bootstrap.cc:654] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.449949 1846 ts_tablet_manager.cc:1929] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:17.448268 1171 ts_tablet_manager.cc:1403] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.226s user 0.005s sys 0.004s
I20260617 07:53:17.451115 884 tablet_service.cc:1511] Processing CreateTablet for tablet bf0d92f849b844609763705df1615ae4 (DEFAULT_TABLE table=default.Table_cf8a1de2a6034fababf6dd4a1667f37b [id=3202a9054adf46e0a4e4b752c132b71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.452049 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0d92f849b844609763705df1615ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.452507 2201 consensus_queue.cc:1048] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:17.450204 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e866278bb64196ba96e7d870195362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.454591 1846 log.cc:1199] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/b7c5ff28367b42d3a3922d2b789bc7ec
I20260617 07:53:17.454958 1846 ts_tablet_manager.cc:1950] T b7c5ff28367b42d3a3922d2b789bc7ec P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.456342 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 168) took 3649 ms. Trace:
I20260617 07:53:17.456418 1846 rpcz_store.cc:276] 0617 07:53:13.807041 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.808699 (+ 1658us) service_pool.cc:224] Handling call
0617 07:53:17.440372 (+3631673us) ts_tablet_manager.cc:1151] Deleting tablet b7c5ff28367b42d3a3922d2b789bc7ec
0617 07:53:17.440380 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.447242 (+ 6862us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.449904 (+ 2662us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.456323 (+ 6419us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3617957}
I20260617 07:53:17.456787 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 164) took 3650 ms. Trace:
I20260617 07:53:17.456849 1846 rpcz_store.cc:276] 0617 07:53:13.806156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.808740 (+ 2584us) service_pool.cc:224] Handling call
0617 07:53:17.456676 (+3647936us) ts_tablet_manager.cc:1151] Deleting tablet 53108a2d6c8b4398a568c14df8e0a23e
0617 07:53:17.456689 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.456773 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3632870}
I20260617 07:53:17.458461 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 167) took 3651 ms. Trace:
I20260617 07:53:17.458536 1846 rpcz_store.cc:276] 0617 07:53:13.806955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.808672 (+ 1717us) service_pool.cc:224] Handling call
0617 07:53:17.458365 (+3649693us) ts_tablet_manager.cc:1151] Deleting tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1
0617 07:53:17.458373 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.458446 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3632868}
I20260617 07:53:17.458809 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 169) took 3560 ms. Trace:
I20260617 07:53:17.458863 1846 rpcz_store.cc:276] 0617 07:53:13.898005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.898112 (+ 107us) service_pool.cc:224] Handling call
0617 07:53:17.458732 (+3560620us) ts_tablet_manager.cc:1151] Deleting tablet ee0e12aa4c60457182201a94caecda45
0617 07:53:17.458739 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.458798 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3556434}
I20260617 07:53:17.459103 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 170) took 3549 ms. Trace:
I20260617 07:53:17.459156 1846 rpcz_store.cc:276] 0617 07:53:13.910032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.910537 (+ 505us) service_pool.cc:224] Handling call
0617 07:53:17.459029 (+3548492us) ts_tablet_manager.cc:1151] Deleting tablet f15dcc10552d4747bad436538662bb66
0617 07:53:17.459036 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.459092 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3547495}
I20260617 07:53:17.459400 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 180) took 3209 ms. Trace:
I20260617 07:53:17.459458 1846 rpcz_store.cc:276] 0617 07:53:14.249504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.249602 (+ 98us) service_pool.cc:224] Handling call
0617 07:53:17.459316 (+3209714us) ts_tablet_manager.cc:1151] Deleting tablet ce7cb453c7b647f298a6ebe20fd0e45b
0617 07:53:17.459324 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.459388 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3207060}
I20260617 07:53:17.459714 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 182) took 3200 ms. Trace:
I20260617 07:53:17.459777 1846 rpcz_store.cc:276] 0617 07:53:14.259780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.259852 (+ 72us) service_pool.cc:224] Handling call
0617 07:53:17.459632 (+3199780us) ts_tablet_manager.cc:1151] Deleting tablet 77c3bf1860c34ee3821bf273234cb0a4
0617 07:53:17.459639 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.459703 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3196936}
I20260617 07:53:17.460049 747 tablet_service.cc:1511] Processing CreateTablet for tablet 3b93927458aa4ea29ea88c2efdcad52f (DEFAULT_TABLE table=default.Table_34966dbc9ee4429b877502acdc5ebe3c [id=b82a97c081f84a0da990cd1f0367638d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.460497 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b93927458aa4ea29ea88c2efdcad52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.461920 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 192) took 3108 ms. Trace:
I20260617 07:53:17.461982 1846 rpcz_store.cc:276] 0617 07:53:14.353332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.353384 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:17.461690 (+3108306us) ts_tablet_manager.cc:1151] Deleting tablet c9657e0dd2a8459cb728bdfe8a68b840
0617 07:53:17.461698 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.461904 (+ 206us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3095586}
I20260617 07:53:17.462651 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 193) took 3085 ms. Trace:
I20260617 07:53:17.462713 1846 rpcz_store.cc:276] 0617 07:53:14.377503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.377553 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:17.462566 (+3085013us) ts_tablet_manager.cc:1151] Deleting tablet 52af94bd46c941b8a27136ca0506e744
0617 07:53:17.462574 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.462636 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3075162}
I20260617 07:53:17.463444 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 194) took 3076 ms. Trace:
I20260617 07:53:17.463503 1846 rpcz_store.cc:276] 0617 07:53:14.386864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.386916 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:17.463363 (+3076447us) ts_tablet_manager.cc:1151] Deleting tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3
0617 07:53:17.463371 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.463432 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3075788}
I20260617 07:53:17.464293 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 195) took 3072 ms. Trace:
I20260617 07:53:17.464352 1846 rpcz_store.cc:276] 0617 07:53:14.391461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.391508 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:17.464205 (+3072697us) ts_tablet_manager.cc:1151] Deleting tablet 5f8602b87a20455884c16196a901d335
0617 07:53:17.464213 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.464279 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3067316}
I20260617 07:53:17.465054 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 198) took 2820 ms. Trace:
I20260617 07:53:17.465113 1846 rpcz_store.cc:276] 0617 07:53:14.644304 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.644347 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:17.464969 (+2820622us) ts_tablet_manager.cc:1151] Deleting tablet adbbe7eb5181431290f57ed9128181a3
0617 07:53:17.464977 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.465040 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2820297}
I20260617 07:53:17.465852 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 197) took 2821 ms. Trace:
I20260617 07:53:17.465934 1846 rpcz_store.cc:276] 0617 07:53:14.644223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.644477 (+ 254us) service_pool.cc:224] Handling call
0617 07:53:17.465749 (+2821272us) ts_tablet_manager.cc:1151] Deleting tablet 8db4fdde370e4d30bbf14285923644a1
0617 07:53:17.465758 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.465833 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2818319}
I20260617 07:53:17.460067 741 tablet_service.cc:1511] Processing CreateTablet for tablet ed5563cfe75940168702bf237d8647cd (DEFAULT_TABLE table=default.Table_ac5369fc08d64d709036b33d6d55d2c2 [id=5323298149d34446bab6c875f3bcd0d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.466787 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5563cfe75940168702bf237d8647cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.466822 1846 tablet_replica.cc:333] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.467221 1846 raft_consensus.cc:2243] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.467654 1846 raft_consensus.cc:2272] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.468371 1846 ts_tablet_manager.cc:1916] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:17.472561 852 consensus_peers.cc:597] T a632b42300d64471b516008ebca3312f P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:17.477262 1846 ts_tablet_manager.cc:1929] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:17.480139 1846 log.cc:1199] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/3e3d05dcda274f288aebc279aba3e10a
I20260617 07:53:17.480741 1846 ts_tablet_manager.cc:1950] T 3e3d05dcda274f288aebc279aba3e10a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.481917 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 196) took 2837 ms. Trace:
I20260617 07:53:17.482579 2389 raft_consensus.cc:493] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.482749 2389 raft_consensus.cc:515] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.482913 1846 rpcz_store.cc:276] 0617 07:53:14.644090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.649771 (+ 5681us) service_pool.cc:224] Handling call
0617 07:53:17.466786 (+2817015us) ts_tablet_manager.cc:1151] Deleting tablet 3e3d05dcda274f288aebc279aba3e10a
0617 07:53:17.466793 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.472550 (+ 5757us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.477213 (+ 4663us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.481899 (+ 4686us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2816730}
I20260617 07:53:17.483507 2389 leader_election.cc:290] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:17.483922 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f7c3f6260c4db690de1a5081bb2493" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.484997 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 199) took 2838 ms. Trace:
W20260617 07:53:17.485258 986 leader_election.cc:343] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.485359 1846 rpcz_store.cc:276] 0617 07:53:14.646586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.653814 (+ 7228us) service_pool.cc:224] Handling call
0617 07:53:17.484886 (+2831072us) ts_tablet_manager.cc:1151] Deleting tablet c58bbdbf59c7426c8adbbbe3f0aafaed
0617 07:53:17.484896 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.484983 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2830774}
I20260617 07:53:17.486048 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 200) took 2554 ms. Trace:
I20260617 07:53:17.486366 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f7c3f6260c4db690de1a5081bb2493" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:17.486799 1846 rpcz_store.cc:276] 0617 07:53:14.931752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.932234 (+ 482us) service_pool.cc:224] Handling call
0617 07:53:17.485949 (+2553715us) ts_tablet_manager.cc:1151] Deleting tablet 5942eea42c7541349ad7b6560e6777c8
0617 07:53:17.485959 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.486035 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2553451}
W20260617 07:53:17.486944 988 leader_election.cc:343] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.487056 988 leader_election.cc:304] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:17.487253 2389 raft_consensus.cc:2749] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.487455 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 201) took 2555 ms. Trace:
I20260617 07:53:17.487809 1846 rpcz_store.cc:276] 0617 07:53:14.931872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.932535 (+ 663us) service_pool.cc:224] Handling call
0617 07:53:17.487364 (+2554829us) ts_tablet_manager.cc:1151] Deleting tablet eb75a965740344c2bd0b68a8dda28be5
0617 07:53:17.487373 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.487442 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2554623}
I20260617 07:53:17.488436 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 242) took 1960 ms. Trace:
I20260617 07:53:17.488759 1846 rpcz_store.cc:276] 0617 07:53:15.528002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.528460 (+ 458us) service_pool.cc:224] Handling call
0617 07:53:17.488352 (+1959892us) ts_tablet_manager.cc:1151] Deleting tablet 3aa1c1fdede041d28570b85e63c401b7
0617 07:53:17.488360 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.488424 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1959671}
I20260617 07:53:17.489357 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 244) took 1923 ms. Trace:
I20260617 07:53:17.489668 1846 rpcz_store.cc:276] 0617 07:53:15.565773 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.578444 (+ 12671us) service_pool.cc:224] Handling call
0617 07:53:17.489275 (+1910831us) ts_tablet_manager.cc:1151] Deleting tablet 4e8e9692227147d6a8c6854133941b44
0617 07:53:17.489283 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.489345 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1910405}
I20260617 07:53:17.492326 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 243) took 1926 ms. Trace:
I20260617 07:53:17.492643 1846 rpcz_store.cc:276] 0617 07:53:15.565632 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.579260 (+ 13628us) service_pool.cc:224] Handling call
0617 07:53:17.492240 (+1912980us) ts_tablet_manager.cc:1151] Deleting tablet 488cc3a082b14dee8f70153e6f2925a4
0617 07:53:17.492249 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.492314 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1912793}
I20260617 07:53:17.493257 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 246) took 1891 ms. Trace:
I20260617 07:53:17.493589 1846 rpcz_store.cc:276] 0617 07:53:15.601810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.606166 (+ 4356us) service_pool.cc:224] Handling call
0617 07:53:17.493175 (+1887009us) ts_tablet_manager.cc:1151] Deleting tablet 68b448c65e684f49bf142ce2b5084d33
0617 07:53:17.493183 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.493246 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1886806}
I20260617 07:53:17.494310 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 245) took 1892 ms. Trace:
I20260617 07:53:17.494624 1846 rpcz_store.cc:276] 0617 07:53:15.601555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.606398 (+ 4843us) service_pool.cc:224] Handling call
0617 07:53:17.494228 (+1887830us) ts_tablet_manager.cc:1151] Deleting tablet 5364dfe28b8d4042941c8d8d4d1cf503
0617 07:53:17.494236 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.494298 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1887672}
I20260617 07:53:17.495208 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 247) took 1868 ms. Trace:
I20260617 07:53:17.495533 1846 rpcz_store.cc:276] 0617 07:53:15.626654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.638405 (+ 11751us) service_pool.cc:224] Handling call
0617 07:53:17.495118 (+1856713us) ts_tablet_manager.cc:1151] Deleting tablet 5578fd5cb3724ed5b92b313bd52889ad
0617 07:53:17.495126 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.495195 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1856521}
I20260617 07:53:17.496111 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 255) took 1554 ms. Trace:
I20260617 07:53:17.496428 1846 rpcz_store.cc:276] 0617 07:53:15.941978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.942097 (+ 119us) service_pool.cc:224] Handling call
0617 07:53:17.496024 (+1553927us) ts_tablet_manager.cc:1151] Deleting tablet d657fbccb4af40558033a971aab7f3e4
0617 07:53:17.496033 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.496098 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1544286}
I20260617 07:53:17.497057 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 256) took 1534 ms. Trace:
I20260617 07:53:17.497371 1018 tablet_service.cc:1511] Processing CreateTablet for tablet bf0d92f849b844609763705df1615ae4 (DEFAULT_TABLE table=default.Table_cf8a1de2a6034fababf6dd4a1667f37b [id=3202a9054adf46e0a4e4b752c132b71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.497393 1846 rpcz_store.cc:276] 0617 07:53:15.962432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.962512 (+ 80us) service_pool.cc:224] Handling call
0617 07:53:17.496972 (+1534460us) ts_tablet_manager.cc:1151] Deleting tablet 4681e8e3f1174b299d89ec541ca8e6b3
0617 07:53:17.496980 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.497044 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1534205}
I20260617 07:53:17.497586 1170 ts_tablet_manager.cc:1929] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.497699 1170 log.cc:1199] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/f15dcc10552d4747bad436538662bb66
I20260617 07:53:17.497819 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0d92f849b844609763705df1615ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.497975 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 257) took 1535 ms. Trace:
I20260617 07:53:17.498052 1170 ts_tablet_manager.cc:1950] T f15dcc10552d4747bad436538662bb66 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:17.498034 1846 rpcz_store.cc:276] 0617 07:53:15.962592 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.963346 (+ 754us) service_pool.cc:224] Handling call
0617 07:53:17.497885 (+1534539us) ts_tablet_manager.cc:1151] Deleting tablet 8c76bfcbd22e4bfb97346a1b56f68dab
0617 07:53:17.497893 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.497962 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1534358}
I20260617 07:53:17.498386 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 176) took 3618 ms. Trace:
I20260617 07:53:17.498466 1170 rpcz_store.cc:276] 0617 07:53:13.880400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.880441 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:17.131319 (+3250878us) ts_tablet_manager.cc:1151] Deleting tablet f15dcc10552d4747bad436538662bb66
0617 07:53:17.131631 (+ 312us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.244807 (+113176us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.497521 (+252714us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.498370 (+ 849us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3250182}
I20260617 07:53:17.498845 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 258) took 1536 ms. Trace:
I20260617 07:53:17.498909 1846 rpcz_store.cc:276] 0617 07:53:15.962695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.963361 (+ 666us) service_pool.cc:224] Handling call
0617 07:53:17.498760 (+1535399us) ts_tablet_manager.cc:1151] Deleting tablet ed9a99cdcbb74a3fb74654a26716a1c9
0617 07:53:17.498768 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.498832 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1530492}
I20260617 07:53:17.498991 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 186) took 3456 ms. Trace:
I20260617 07:53:17.499070 1170 rpcz_store.cc:276] 0617 07:53:14.042038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.042096 (+ 58us) service_pool.cc:224] Handling call
0617 07:53:17.498820 (+3456724us) ts_tablet_manager.cc:1151] Deleting tablet ce7cb453c7b647f298a6ebe20fd0e45b
0617 07:53:17.498831 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.498972 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3456504}
I20260617 07:53:17.499454 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 188) took 3453 ms. Trace:
I20260617 07:53:17.499621 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 259) took 1530 ms. Trace:
I20260617 07:53:17.499531 1170 rpcz_store.cc:276] 0617 07:53:14.045848 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.045891 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:17.499326 (+3453435us) ts_tablet_manager.cc:1151] Deleting tablet 77c3bf1860c34ee3821bf273234cb0a4
0617 07:53:17.499336 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.499437 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3452555}
I20260617 07:53:17.499684 1846 rpcz_store.cc:276] 0617 07:53:15.969592 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.973800 (+ 4208us) service_pool.cc:224] Handling call
0617 07:53:17.499538 (+1525738us) ts_tablet_manager.cc:1151] Deleting tablet dac3dc9d7da447cb8fdca84fdac0dc39
0617 07:53:17.499546 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.499608 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1522087}
I20260617 07:53:17.499888 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 198) took 3193 ms. Trace:
I20260617 07:53:17.499966 1170 rpcz_store.cc:276] 0617 07:53:14.306442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.306499 (+ 57us) service_pool.cc:224] Handling call
0617 07:53:17.499786 (+3193287us) ts_tablet_manager.cc:1151] Deleting tablet c9657e0dd2a8459cb728bdfe8a68b840
0617 07:53:17.499796 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.499872 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3193100}
I20260617 07:53:17.500291 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 199) took 3192 ms. Trace:
I20260617 07:53:17.500399 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 260) took 1505 ms. Trace:
I20260617 07:53:17.500370 1170 rpcz_store.cc:276] 0617 07:53:14.307434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.307484 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:17.500189 (+3192705us) ts_tablet_manager.cc:1151] Deleting tablet 52af94bd46c941b8a27136ca0506e744
0617 07:53:17.500200 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.500275 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3192558}
I20260617 07:53:17.500707 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 200) took 3174 ms. Trace:
I20260617 07:53:17.500783 1170 rpcz_store.cc:276] 0617 07:53:14.326664 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.326733 (+ 69us) service_pool.cc:224] Handling call
0617 07:53:17.500609 (+3173876us) ts_tablet_manager.cc:1151] Deleting tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3
0617 07:53:17.500619 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.500692 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3171221}
I20260617 07:53:17.500463 1846 rpcz_store.cc:276] 0617 07:53:15.995366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.995485 (+ 119us) service_pool.cc:224] Handling call
0617 07:53:17.500311 (+1504826us) ts_tablet_manager.cc:1151] Deleting tablet eba5976fcadd4add9c671300b431617b
0617 07:53:17.500320 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.500386 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1504600}
I20260617 07:53:17.501137 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 201) took 3138 ms. Trace:
I20260617 07:53:17.501214 1170 rpcz_store.cc:276] 0617 07:53:14.362700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.376076 (+ 13376us) service_pool.cc:224] Handling call
0617 07:53:17.501016 (+3124940us) ts_tablet_manager.cc:1151] Deleting tablet 5f8602b87a20455884c16196a901d335
0617 07:53:17.501024 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.501120 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3124751}
I20260617 07:53:17.501480 1170 tablet_replica.cc:333] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:17.510113 1171 raft_consensus.cc:359] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.510336 1171 raft_consensus.cc:385] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.510422 1171 raft_consensus.cc:740] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.510665 1171 consensus_queue.cc:260] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.511206 1172 tablet_bootstrap.cc:492] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:17.511461 1172 ts_tablet_manager.cc:1403] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.086s user 0.010s sys 0.000s
I20260617 07:53:17.512964 1846 tablet_replica.cc:333] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.513347 1846 raft_consensus.cc:2243] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.513751 1846 raft_consensus.cc:2272] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:17.480675 452 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:33527 (request call id 145) took 2892 ms (client timeout 1000 ms). Trace:
I20260617 07:53:17.514854 1846 ts_tablet_manager.cc:1916] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.514559 1172 raft_consensus.cc:359] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:17.520022 852 consensus_peers.cc:597] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:17.525584 1846 ts_tablet_manager.cc:1929] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.526510 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet f15dcc10552d4747bad436538662bb66 (table default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]) successfully deleted
I20260617 07:53:17.527810 1846 log.cc:1199] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/2684f3200e604bb6bf37a2f97a193eff
I20260617 07:53:17.528308 1846 ts_tablet_manager.cc:1950] T 2684f3200e604bb6bf37a2f97a193eff P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.531090 1846 tablet_replica.cc:333] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.531450 1846 raft_consensus.cc:2243] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.531841 1846 raft_consensus.cc:2272] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.532549 1846 ts_tablet_manager.cc:1916] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.533744 887 tablet_service.cc:1511] Processing CreateTablet for tablet 2c60d917996341109ae66b9af24f6cb4 (DEFAULT_TABLE table=default.Table_c94947b1e4614158b9ab608219830eec [id=fc4ea083d7ef44cb89d3994ea805e512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.535175 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c60d917996341109ae66b9af24f6cb4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:17.541617 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ce7cb453c7b647f298a6ebe20fd0e45b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce7cb453c7b647f298a6ebe20fd0e45b already in progress: creating tablet
W20260617 07:53:17.541900 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 77c3bf1860c34ee3821bf273234cb0a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77c3bf1860c34ee3821bf273234cb0a4 already in progress: creating tablet
I20260617 07:53:17.547813 1846 ts_tablet_manager.cc:1929] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.547962 1846 log.cc:1199] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/be14a95f458d440e86133ef65c484571
I20260617 07:53:17.548280 1846 ts_tablet_manager.cc:1950] T be14a95f458d440e86133ef65c484571 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:17.548669 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c9657e0dd2a8459cb728bdfe8a68b840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9657e0dd2a8459cb728bdfe8a68b840 already in progress: creating tablet
W20260617 07:53:17.548923 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 52af94bd46c941b8a27136ca0506e744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52af94bd46c941b8a27136ca0506e744 already in progress: creating tablet
W20260617 07:53:17.550048 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 already in progress: creating tablet
W20260617 07:53:17.550267 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5f8602b87a20455884c16196a901d335 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f8602b87a20455884c16196a901d335 already in progress: creating tablet
W20260617 07:53:17.547626 452 rpcz_store.cc:269] 0617 07:53:14.586199 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.586260 (+ 61us) service_pool.cc:224] Handling call
0617 07:53:17.478794 (+2892534us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52720,"reported_tablets":213}
I20260617 07:53:17.551985 1846 tablet_replica.cc:333] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.552132 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 301bd4d6faec429ba71ce354c23d0f75 (table default.Table_fe582a04705248b1bb25e1cc9bc1e653 [id=e0b7c87ef9274d74b6895e85ecc22012]) successfully deleted
I20260617 07:53:17.552228 1846 raft_consensus.cc:2243] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:17.552271 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 67277.9us
I20260617 07:53:17.552366 1846 raft_consensus.cc:2272] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.552923 1846 ts_tablet_manager.cc:1916] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:17.552946 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d965aa4e8dc244cdb93dd15cdee9070c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d965aa4e8dc244cdb93dd15cdee9070c already in progress: creating tablet
W20260617 07:53:17.553155 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4d9ace137c4e496fafac4e729718577f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9ace137c4e496fafac4e729718577f already in progress: creating tablet
I20260617 07:53:17.553754 1171 ts_tablet_manager.cc:1434] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.099s user 0.000s sys 0.002s
I20260617 07:53:17.554024 1171 tablet_bootstrap.cc:492] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:17.554325 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet b7c5ff28367b42d3a3922d2b789bc7ec (table default.Table_1557e8110d1340518c2f713297b804f6 [id=d079dbab725b43c0807868020b551ccb]) successfully deleted
W20260617 07:53:17.554543 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 53108a2d6c8b4398a568c14df8e0a23e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53108a2d6c8b4398a568c14df8e0a23e already in progress: creating tablet
W20260617 07:53:17.556706 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 already in progress: creating tablet
W20260617 07:53:17.557116 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ee0e12aa4c60457182201a94caecda45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee0e12aa4c60457182201a94caecda45 already in progress: creating tablet
W20260617 07:53:17.558285 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f15dcc10552d4747bad436538662bb66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f15dcc10552d4747bad436538662bb66 already in progress: creating tablet
W20260617 07:53:17.558636 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ce7cb453c7b647f298a6ebe20fd0e45b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce7cb453c7b647f298a6ebe20fd0e45b already in progress: creating tablet
I20260617 07:53:17.558856 1846 ts_tablet_manager.cc:1929] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.559026 1846 log.cc:1199] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/59acdc64fe9247d28c4c277161b42f4f
I20260617 07:53:17.559362 1846 ts_tablet_manager.cc:1950] T 59acdc64fe9247d28c4c277161b42f4f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.560007 1178 tablet_bootstrap.cc:492] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:17.560313 1178 ts_tablet_manager.cc:1403] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.164s user 0.004s sys 0.008s
I20260617 07:53:17.561007 1178 raft_consensus.cc:359] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.561182 1178 raft_consensus.cc:385] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.561246 1178 raft_consensus.cc:740] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.561446 1178 consensus_queue.cc:260] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:17.562000 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 77c3bf1860c34ee3821bf273234cb0a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77c3bf1860c34ee3821bf273234cb0a4 already in progress: creating tablet
W20260617 07:53:17.562333 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c9657e0dd2a8459cb728bdfe8a68b840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9657e0dd2a8459cb728bdfe8a68b840 already in progress: creating tablet
I20260617 07:53:17.563036 1178 ts_tablet_manager.cc:1434] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:17.563311 1178 tablet_bootstrap.cc:492] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:17.564692 1178 tablet_bootstrap.cc:654] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.569242 1171 tablet_bootstrap.cc:654] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:17.572902 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 52af94bd46c941b8a27136ca0506e744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52af94bd46c941b8a27136ca0506e744 already in progress: creating tablet
W20260617 07:53:17.573426 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 already in progress: creating tablet
I20260617 07:53:17.575366 1846 tablet_replica.cc:333] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.575598 1846 raft_consensus.cc:2243] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.575810 1846 raft_consensus.cc:2272] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.576341 1846 ts_tablet_manager.cc:1916] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.580099 1862 ts_tablet_manager.cc:1929] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:17.580212 1862 log.cc:1199] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/f15dcc10552d4747bad436538662bb66
I20260617 07:53:17.580588 1862 ts_tablet_manager.cc:1950] T f15dcc10552d4747bad436538662bb66 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:17.581447 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 193) took 3728 ms. Trace:
I20260617 07:53:17.581544 1862 rpcz_store.cc:276] 0617 07:53:13.852489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:13.852529 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:17.283382 (+3430853us) ts_tablet_manager.cc:1151] Deleting tablet f15dcc10552d4747bad436538662bb66
0617 07:53:17.283393 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.503268 (+219875us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.580023 (+ 76755us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.581429 (+ 1406us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3430734}
I20260617 07:53:17.581804 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_55cf1cae5fa44c55bef179cc6aa48834" } new_table_name: "default.Table_4567ec36d77142efb3f907152dc94596" modify_external_catalogs: true
I20260617 07:53:17.582491 1846 ts_tablet_manager.cc:1929] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.582690 1846 log.cc:1199] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/df37ed81b17d4178adeb6057491b4cc9
I20260617 07:53:17.583077 1846 ts_tablet_manager.cc:1950] T df37ed81b17d4178adeb6057491b4cc9 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.584151 1846 tablet_replica.cc:333] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.584407 1846 raft_consensus.cc:2243] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.584601 1846 raft_consensus.cc:2272] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.585405 1846 ts_tablet_manager.cc:1916] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.522640 2386 raft_consensus.cc:493] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.589980 2386 raft_consensus.cc:515] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.590636 2386 leader_election.cc:290] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:17.523259 1050 raft_consensus.cc:1275] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:17.590849 1846 ts_tablet_manager.cc:1929] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.590943 1846 log.cc:1199] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/0ebafc920ed34216be5fb115f9bc6f7f
I20260617 07:53:17.591146 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c019792d23484fb789378bf377547415" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.591231 1846 ts_tablet_manager.cc:1950] T 0ebafc920ed34216be5fb115f9bc6f7f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:17.591681 986 leader_election.cc:343] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.551581 1018 tablet_service.cc:1511] Processing CreateTablet for tablet dd00541a2b4f4381b5e27e9883204a52 (DEFAULT_TABLE table=default.Table_c8da9b218da342e49e258e24e72ea087 [id=531523b13cfb46988653a067bfb5015a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.552006 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 2c60d917996341109ae66b9af24f6cb4 (DEFAULT_TABLE table=default.Table_c94947b1e4614158b9ab608219830eec [id=fc4ea083d7ef44cb89d3994ea805e512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.592085 1170 raft_consensus.cc:2243] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.592262 1170 raft_consensus.cc:2272] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.592489 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd00541a2b4f4381b5e27e9883204a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.592522 1846 tablet_replica.cc:333] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.592674 1846 raft_consensus.cc:2243] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.592792 1846 raft_consensus.cc:2272] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.592792 1170 ts_tablet_manager.cc:1916] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.593236 1846 ts_tablet_manager.cc:1916] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.515365 1172 raft_consensus.cc:385] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.593369 1172 raft_consensus.cc:740] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.593838 1172 consensus_queue.cc:260] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.594523 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c60d917996341109ae66b9af24f6cb4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:17.602636 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5f8602b87a20455884c16196a901d335 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f8602b87a20455884c16196a901d335 already in progress: creating tablet
W20260617 07:53:17.602970 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet adbbe7eb5181431290f57ed9128181a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbbe7eb5181431290f57ed9128181a3 already in progress: creating tablet
W20260617 07:53:17.603322 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8db4fdde370e4d30bbf14285923644a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8db4fdde370e4d30bbf14285923644a1 already in progress: creating tablet
W20260617 07:53:17.604179 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c58bbdbf59c7426c8adbbbe3f0aafaed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c58bbdbf59c7426c8adbbbe3f0aafaed already in progress: creating tablet
I20260617 07:53:17.604493 1846 ts_tablet_manager.cc:1929] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.604650 1846 log.cc:1199] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/74ab8e93e3fe475ba9c7b5fce390a8ab
W20260617 07:53:17.604590 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5942eea42c7541349ad7b6560e6777c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5942eea42c7541349ad7b6560e6777c8 already in progress: creating tablet
W20260617 07:53:17.604919 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet eb75a965740344c2bd0b68a8dda28be5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb75a965740344c2bd0b68a8dda28be5 already in progress: creating tablet
I20260617 07:53:17.604996 1846 ts_tablet_manager.cc:1950] T 74ab8e93e3fe475ba9c7b5fce390a8ab P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:17.605332 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3aa1c1fdede041d28570b85e63c401b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3aa1c1fdede041d28570b85e63c401b7 already in progress: creating tablet
I20260617 07:53:17.605789 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 204) took 3489 ms. Trace:
I20260617 07:53:17.605793 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet f15dcc10552d4747bad436538662bb66 (table default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]) successfully deleted
W20260617 07:53:17.605968 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4e8e9692227147d6a8c6854133941b44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e8e9692227147d6a8c6854133941b44 already in progress: creating tablet
I20260617 07:53:17.605932 1862 rpcz_store.cc:276] 0617 07:53:14.116761 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.125071 (+ 8310us) service_pool.cc:224] Handling call
0617 07:53:17.605627 (+3480556us) ts_tablet_manager.cc:1151] Deleting tablet ce7cb453c7b647f298a6ebe20fd0e45b
0617 07:53:17.605638 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.605766 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3480332}
I20260617 07:53:17.606225 1846 tablet_replica.cc:333] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.606383 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 206) took 3489 ms. Trace:
I20260617 07:53:17.606431 1846 raft_consensus.cc:2243] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.606467 1862 rpcz_store.cc:276] 0617 07:53:14.116992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.160075 (+ 43083us) service_pool.cc:224] Handling call
0617 07:53:17.606283 (+3446208us) ts_tablet_manager.cc:1151] Deleting tablet 77c3bf1860c34ee3821bf273234cb0a4
0617 07:53:17.606293 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.606369 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3444446}
W20260617 07:53:17.606534 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ce7cb453c7b647f298a6ebe20fd0e45b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce7cb453c7b647f298a6ebe20fd0e45b already in progress: creating tablet
I20260617 07:53:17.606742 1846 raft_consensus.cc:2272] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.606787 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 220) took 3297 ms. Trace:
W20260617 07:53:17.606837 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 77c3bf1860c34ee3821bf273234cb0a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77c3bf1860c34ee3821bf273234cb0a4 already in progress: creating tablet
I20260617 07:53:17.606859 1862 rpcz_store.cc:276] 0617 07:53:14.309264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.309346 (+ 82us) service_pool.cc:224] Handling call
0617 07:53:17.606692 (+3297346us) ts_tablet_manager.cc:1151] Deleting tablet 52af94bd46c941b8a27136ca0506e744
0617 07:53:17.606700 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.606772 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3297148}
I20260617 07:53:17.607175 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 219) took 3298 ms. Trace:
I20260617 07:53:17.607201 1172 ts_tablet_manager.cc:1434] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.096s user 0.003s sys 0.000s
W20260617 07:53:17.607224 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 52af94bd46c941b8a27136ca0506e744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52af94bd46c941b8a27136ca0506e744 already in progress: creating tablet
I20260617 07:53:17.607250 1862 rpcz_store.cc:276] 0617 07:53:14.309104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.312009 (+ 2905us) service_pool.cc:224] Handling call
0617 07:53:17.607075 (+3295066us) ts_tablet_manager.cc:1151] Deleting tablet c9657e0dd2a8459cb728bdfe8a68b840
0617 07:53:17.607091 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.607160 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3294680}
I20260617 07:53:17.607563 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 221) took 3265 ms. Trace:
I20260617 07:53:17.607636 1862 rpcz_store.cc:276] 0617 07:53:14.343324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.343983 (+ 659us) service_pool.cc:224] Handling call
0617 07:53:17.607473 (+3263490us) ts_tablet_manager.cc:1151] Deleting tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3
0617 07:53:17.607483 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.607548 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3263270}
I20260617 07:53:17.607898 1846 ts_tablet_manager.cc:1916] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.607928 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 222) took 3221 ms. Trace:
I20260617 07:53:17.607988 1862 rpcz_store.cc:276] 0617 07:53:14.388347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.388772 (+ 425us) service_pool.cc:224] Handling call
0617 07:53:17.607840 (+3219068us) ts_tablet_manager.cc:1151] Deleting tablet 5f8602b87a20455884c16196a901d335
0617 07:53:17.607848 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.607914 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3218875}
I20260617 07:53:17.608217 1862 tablet_replica.cc:333] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:17.608393 1862 raft_consensus.cc:2243] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:17.608690 1862 raft_consensus.cc:2272] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.609167 1862 ts_tablet_manager.cc:1916] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.586786 1171 tablet_bootstrap.cc:492] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:17.592819 2086 consensus_queue.cc:1048] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:17.593384 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c019792d23484fb789378bf377547415" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:17.610206 988 leader_election.cc:343] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:17.610319 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c9657e0dd2a8459cb728bdfe8a68b840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9657e0dd2a8459cb728bdfe8a68b840 already in progress: creating tablet
I20260617 07:53:17.610337 988 leader_election.cc:304] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:17.610536 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 already in progress: creating tablet
W20260617 07:53:17.610778 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5f8602b87a20455884c16196a901d335 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f8602b87a20455884c16196a901d335 already in progress: creating tablet
I20260617 07:53:17.611061 2386 raft_consensus.cc:2749] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.611431 1171 ts_tablet_manager.cc:1403] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.009s
I20260617 07:53:17.613976 1846 ts_tablet_manager.cc:1929] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.614127 1846 log.cc:1199] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/570ae1e189a64da6bad10156b401ec46
I20260617 07:53:17.614442 1846 ts_tablet_manager.cc:1950] T 570ae1e189a64da6bad10156b401ec46 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.614948 1171 raft_consensus.cc:359] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.615353 1171 raft_consensus.cc:385] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.615504 1171 raft_consensus.cc:740] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.616312 1846 tablet_replica.cc:333] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:17.616020 1171 consensus_queue.cc:260] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.616536 1846 raft_consensus.cc:2243] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.616693 1846 raft_consensus.cc:2272] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.620235 2373 tablet.cc:1724] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:17.622470 1862 ts_tablet_manager.cc:1929] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:17.622555 1170 ts_tablet_manager.cc:1929] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:17.622659 1170 log.cc:1199] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/3e3d05dcda274f288aebc279aba3e10a
I20260617 07:53:17.622692 1862 log.cc:1199] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/3e3d05dcda274f288aebc279aba3e10a
I20260617 07:53:17.623066 1170 ts_tablet_manager.cc:1950] T 3e3d05dcda274f288aebc279aba3e10a P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:17.623106 1862 ts_tablet_manager.cc:1950] T 3e3d05dcda274f288aebc279aba3e10a P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:17.624007 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 223) took 3189 ms. Trace:
I20260617 07:53:17.624132 1862 rpcz_store.cc:276] 0617 07:53:14.434465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.434589 (+ 124us) service_pool.cc:224] Handling call
0617 07:53:17.608179 (+3173590us) ts_tablet_manager.cc:1151] Deleting tablet 3e3d05dcda274f288aebc279aba3e10a
0617 07:53:17.608187 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.619649 (+ 11462us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.622427 (+ 2778us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.623992 (+ 1565us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3173396}
I20260617 07:53:17.624570 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 224) took 3136 ms. Trace:
I20260617 07:53:17.624691 1862 rpcz_store.cc:276] 0617 07:53:14.487772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.487968 (+ 196us) service_pool.cc:224] Handling call
0617 07:53:17.624460 (+3136492us) ts_tablet_manager.cc:1151] Deleting tablet 8db4fdde370e4d30bbf14285923644a1
0617 07:53:17.624469 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.624557 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3136278}
W20260617 07:53:17.625205 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 8db4fdde370e4d30bbf14285923644a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8db4fdde370e4d30bbf14285923644a1 already in progress: creating tablet
I20260617 07:53:17.625358 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 226) took 3104 ms. Trace:
I20260617 07:53:17.625398 2374 tablet.cc:1724] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:17.625424 1862 rpcz_store.cc:276] 0617 07:53:14.520511 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.520564 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:17.625265 (+3104701us) ts_tablet_manager.cc:1151] Deleting tablet adbbe7eb5181431290f57ed9128181a3
0617 07:53:17.625273 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.625344 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3104510}
W20260617 07:53:17.626026 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet adbbe7eb5181431290f57ed9128181a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbbe7eb5181431290f57ed9128181a3 already in progress: creating tablet
I20260617 07:53:17.627121 1171 ts_tablet_manager.cc:1434] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.015s user 0.002s sys 0.001s
I20260617 07:53:17.629073 1846 ts_tablet_manager.cc:1916] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.629328 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 227) took 3092 ms. Trace:
I20260617 07:53:17.629956 1171 tablet_bootstrap.cc:492] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:17.629608 1862 rpcz_store.cc:276] 0617 07:53:14.536513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.536565 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:17.625749 (+3089184us) ts_tablet_manager.cc:1151] Deleting tablet c58bbdbf59c7426c8adbbbe3f0aafaed
0617 07:53:17.625756 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.629312 (+ 3556us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3088985}
I20260617 07:53:17.632395 1862 tablet_replica.cc:333] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:17.632618 1862 raft_consensus.cc:2243] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.632812 1862 raft_consensus.cc:2272] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.633410 1862 ts_tablet_manager.cc:1916] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:17.633575 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c58bbdbf59c7426c8adbbbe3f0aafaed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c58bbdbf59c7426c8adbbbe3f0aafaed already in progress: creating tablet
I20260617 07:53:17.634292 1171 tablet_bootstrap.cc:654] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.635268 1846 ts_tablet_manager.cc:1929] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.635574 1846 log.cc:1199] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/245cff69d83b43e98b1c72b8d3011347
I20260617 07:53:17.635893 1846 ts_tablet_manager.cc:1950] T 245cff69d83b43e98b1c72b8d3011347 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:17.640545 1172 tablet_bootstrap.cc:492] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:17.641520 1862 ts_tablet_manager.cc:1929] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.643404 1862 log.cc:1199] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5dcfb101cf51487692ef9a6a17f40804
I20260617 07:53:17.643402 1172 tablet_bootstrap.cc:654] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.643900 1862 ts_tablet_manager.cc:1950] T 5dcfb101cf51487692ef9a6a17f40804 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:17.606535 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 488cc3a082b14dee8f70153e6f2925a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 488cc3a082b14dee8f70153e6f2925a4 already in progress: creating tablet
W20260617 07:53:17.645304 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 68b448c65e684f49bf142ce2b5084d33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68b448c65e684f49bf142ce2b5084d33 already in progress: creating tablet
W20260617 07:53:17.646250 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5364dfe28b8d4042941c8d8d4d1cf503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5364dfe28b8d4042941c8d8d4d1cf503 already in progress: creating tablet
I20260617 07:53:17.646631 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 228) took 3098 ms. Trace:
I20260617 07:53:17.646843 1862 rpcz_store.cc:276] 0617 07:53:14.548199 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.548246 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:17.632352 (+3084106us) ts_tablet_manager.cc:1151] Deleting tablet 5dcfb101cf51487692ef9a6a17f40804
0617 07:53:17.632361 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.638623 (+ 6262us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.641465 (+ 2842us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.646608 (+ 5143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3083930}
I20260617 07:53:17.647439 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5dcfb101cf51487692ef9a6a17f40804 (table default.Table_34fb38a5ef96468bbf08872ea10e8a5f [id=01a22a92af6f4e8ba076834cad8ba182]) successfully deleted
W20260617 07:53:17.647568 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5578fd5cb3724ed5b92b313bd52889ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5578fd5cb3724ed5b92b313bd52889ad already in progress: creating tablet
I20260617 07:53:17.647697 885 tablet_service.cc:1511] Processing CreateTablet for tablet dd00541a2b4f4381b5e27e9883204a52 (DEFAULT_TABLE table=default.Table_c8da9b218da342e49e258e24e72ea087 [id=531523b13cfb46988653a067bfb5015a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.648247 1171 tablet_bootstrap.cc:492] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:17.648497 1171 ts_tablet_manager.cc:1403] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.005s
W20260617 07:53:17.648563 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d657fbccb4af40558033a971aab7f3e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d657fbccb4af40558033a971aab7f3e4 already in progress: creating tablet
I20260617 07:53:17.649605 1171 raft_consensus.cc:359] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.649648 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd00541a2b4f4381b5e27e9883204a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.649937 1171 raft_consensus.cc:385] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.650099 1171 raft_consensus.cc:740] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.650283 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 202) took 3215 ms. Trace:
I20260617 07:53:17.650346 1171 consensus_queue.cc:260] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.650378 1170 rpcz_store.cc:276] 0617 07:53:14.434816 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.435134 (+ 318us) service_pool.cc:224] Handling call
0617 07:53:17.501440 (+3066306us) ts_tablet_manager.cc:1151] Deleting tablet 3e3d05dcda274f288aebc279aba3e10a
0617 07:53:17.501450 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.595982 (+ 94532us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.622432 (+ 26450us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.650261 (+ 27829us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3066104}
I20260617 07:53:17.650933 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 203) took 3162 ms. Trace:
I20260617 07:53:17.651015 1170 rpcz_store.cc:276] 0617 07:53:14.488955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.489008 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:17.650696 (+3161688us) ts_tablet_manager.cc:1151] Deleting tablet 8db4fdde370e4d30bbf14285923644a1
0617 07:53:17.650706 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.650916 (+ 210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3161487}
I20260617 07:53:17.651151 1171 ts_tablet_manager.cc:1434] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:17.651368 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 204) took 3130 ms. Trace:
W20260617 07:53:17.651485 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 8db4fdde370e4d30bbf14285923644a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8db4fdde370e4d30bbf14285923644a1 already in progress: creating tablet
I20260617 07:53:17.651439 1170 rpcz_store.cc:276] 0617 07:53:14.521147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.521258 (+ 111us) service_pool.cc:224] Handling call
0617 07:53:17.651260 (+3130002us) ts_tablet_manager.cc:1151] Deleting tablet adbbe7eb5181431290f57ed9128181a3
0617 07:53:17.651270 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.651353 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3129813}
I20260617 07:53:17.651727 1171 tablet_bootstrap.cc:492] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:17.651867 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet adbbe7eb5181431290f57ed9128181a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbbe7eb5181431290f57ed9128181a3 already in progress: creating tablet
I20260617 07:53:17.651999 1862 tablet_replica.cc:333] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:17.649704 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4681e8e3f1174b299d89ec541ca8e6b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4681e8e3f1174b299d89ec541ca8e6b3 already in progress: creating tablet
I20260617 07:53:17.652287 1862 raft_consensus.cc:2243] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.652665 1862 raft_consensus.cc:2272] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.653245 1862 ts_tablet_manager.cc:1916] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.653615 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 205) took 3116 ms. Trace:
I20260617 07:53:17.653746 1170 rpcz_store.cc:276] 0617 07:53:14.537160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.537217 (+ 57us) service_pool.cc:224] Handling call
0617 07:53:17.653506 (+3116289us) ts_tablet_manager.cc:1151] Deleting tablet c58bbdbf59c7426c8adbbbe3f0aafaed
0617 07:53:17.653515 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.653601 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3116109}
I20260617 07:53:17.654134 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 206) took 2723 ms. Trace:
W20260617 07:53:17.654241 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c58bbdbf59c7426c8adbbbe3f0aafaed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c58bbdbf59c7426c8adbbbe3f0aafaed already in progress: creating tablet
I20260617 07:53:17.654249 1170 rpcz_store.cc:276] 0617 07:53:14.930624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.930901 (+ 277us) service_pool.cc:224] Handling call
0617 07:53:17.654035 (+2723134us) ts_tablet_manager.cc:1151] Deleting tablet 5942eea42c7541349ad7b6560e6777c8
0617 07:53:17.654043 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.654118 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2722947}
I20260617 07:53:17.654556 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 207) took 2721 ms. Trace:
I20260617 07:53:17.654630 1170 rpcz_store.cc:276] 0617 07:53:14.932903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.932978 (+ 75us) service_pool.cc:224] Handling call
0617 07:53:17.654455 (+2721477us) ts_tablet_manager.cc:1151] Deleting tablet eb75a965740344c2bd0b68a8dda28be5
0617 07:53:17.654463 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.654541 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2721312}
W20260617 07:53:17.654699 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5942eea42c7541349ad7b6560e6777c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5942eea42c7541349ad7b6560e6777c8 already in progress: creating tablet
I20260617 07:53:17.654881 1170 tablet_replica.cc:333] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:17.655184 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet eb75a965740344c2bd0b68a8dda28be5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb75a965740344c2bd0b68a8dda28be5 already in progress: creating tablet
I20260617 07:53:17.657460 1178 tablet_bootstrap.cc:492] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:17.658231 1178 ts_tablet_manager.cc:1403] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.095s user 0.003s sys 0.001s
I20260617 07:53:17.662395 1178 raft_consensus.cc:359] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.663216 1178 raft_consensus.cc:385] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.663625 1178 raft_consensus.cc:740] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.664667 1178 consensus_queue.cc:260] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.667688 1898 raft_consensus.cc:493] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.667860 1898 raft_consensus.cc:515] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.668954 1898 leader_election.cc:290] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.669670 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c8ddac0c747f6b44926f982233ea9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.669847 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c8ddac0c747f6b44926f982233ea9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:17.670043 1050 raft_consensus.cc:2468] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:17.670324 852 leader_election.cc:343] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.670465 851 leader_election.cc:304] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:17.670835 1898 raft_consensus.cc:2804] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:17.670926 1898 raft_consensus.cc:493] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:17.671041 1898 raft_consensus.cc:3060] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.667832 1178 ts_tablet_manager.cc:1434] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260617 07:53:17.672919 827 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:17.673235 2087 raft_consensus.cc:493] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.673362 2087 raft_consensus.cc:515] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.673599 1898 raft_consensus.cc:515] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.674264 2087 leader_election.cc:290] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.674412 1898 leader_election.cc:290] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.674963 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f7611958cf143438497c93f5f2bc098" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.675303 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c8ddac0c747f6b44926f982233ea9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:17.675843 852 leader_election.cc:343] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:17.676071 852 leader_election.cc:343] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.676847 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c8ddac0c747f6b44926f982233ea9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:17.677024 1052 raft_consensus.cc:3060] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.680186 1052 raft_consensus.cc:2468] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:17.680936 851 leader_election.cc:343] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 7f7611958cf143438497c93f5f2bc098
I20260617 07:53:17.681073 851 leader_election.cc:304] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:17.681469 851 leader_election.cc:304] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:17.681891 2201 raft_consensus.cc:2749] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.682214 2201 raft_consensus.cc:2804] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:17.682360 2201 raft_consensus.cc:697] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:17.682622 2201 consensus_queue.cc:237] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.682994 1178 tablet_bootstrap.cc:492] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:17.687122 1862 ts_tablet_manager.cc:1929] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.689101 1178 tablet_bootstrap.cc:654] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:17.694432 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 44842.8us
W20260617 07:53:17.694996 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ed9a99cdcbb74a3fb74654a26716a1c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed9a99cdcbb74a3fb74654a26716a1c9 already in progress: creating tablet
W20260617 07:53:17.695389 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet dac3dc9d7da447cb8fdca84fdac0dc39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dac3dc9d7da447cb8fdca84fdac0dc39 already in progress: creating tablet
W20260617 07:53:17.695719 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet eba5976fcadd4add9c671300b431617b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eba5976fcadd4add9c671300b431617b already in progress: creating tablet
W20260617 07:53:17.696035 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bc57a1e3bc8b434da43f484705476b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc57a1e3bc8b434da43f484705476b9b already in progress: creating tablet
W20260617 07:53:17.696343 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet beb8fbb44e6147be8c9605be886a8aea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet beb8fbb44e6147be8c9605be886a8aea already in progress: creating tablet
W20260617 07:53:17.696643 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70610822c57e45c7add7e1f5ce96d889 already in progress: creating tablet
W20260617 07:53:17.696946 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3fcf87953dc14bf190ac74101547e52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcf87953dc14bf190ac74101547e52f already in progress: creating tablet
W20260617 07:53:17.697259 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df705c2300064db680bec1fefab08d2f because the tablet was not found. No further retry: Not found: Tablet not found: df705c2300064db680bec1fefab08d2f
W20260617 07:53:17.697539 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d03d6dc473fc4be1a436fd71a06f403e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d03d6dc473fc4be1a436fd71a06f403e already in progress: creating tablet
W20260617 07:53:17.697863 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
W20260617 07:53:17.698203 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5203534569bd4da18bc06751f094735f because the tablet was not found. No further retry: Not found: Tablet not found: 5203534569bd4da18bc06751f094735f
I20260617 07:53:17.687613 1171 tablet_bootstrap.cc:654] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.700017 1862 log.cc:1199] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/6f2d9e473fd444efa6ab63cc51dbb2bd
I20260617 07:53:17.700547 1862 ts_tablet_manager.cc:1950] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:17.706709 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 229) took 3156 ms. Trace:
I20260617 07:53:17.709825 1178 tablet_bootstrap.cc:492] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:17.710125 1178 ts_tablet_manager.cc:1403] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.008s
I20260617 07:53:17.711396 1178 raft_consensus.cc:359] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.711803 1178 raft_consensus.cc:385] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.711985 1178 raft_consensus.cc:740] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.712543 1178 consensus_queue.cc:260] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.713755 1862 rpcz_store.cc:276] 0617 07:53:14.549813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.549859 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:17.651942 (+3102083us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:17.651950 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.684163 (+ 32213us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.687032 (+ 2869us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.706647 (+ 19615us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3101928}
I20260617 07:53:17.713900 1178 ts_tablet_manager.cc:1434] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260617 07:53:17.714283 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 230) took 3164 ms. Trace:
I20260617 07:53:17.714339 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 6f2d9e473fd444efa6ab63cc51dbb2bd (table default.Table_378c24318c924a5e8dcfb5295dc43493 [id=daa30b155c944cb098436474cfd8321c]) successfully deleted
I20260617 07:53:17.714386 1862 rpcz_store.cc:276] 0617 07:53:14.550175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.550217 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:17.714181 (+3163964us) ts_tablet_manager.cc:1151] Deleting tablet d21f61a35ca544568bcfca1a6230deca
0617 07:53:17.714190 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.714267 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3163822}
W20260617 07:53:17.714519 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a02dbb70eec84932917ef282fdae0bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a02dbb70eec84932917ef282fdae0bd7 already in progress: creating tablet
I20260617 07:53:17.714802 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 231) took 3164 ms. Trace:
W20260617 07:53:17.714825 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d21f61a35ca544568bcfca1a6230deca because the tablet was not found. No further retry: Not found: Tablet not found: d21f61a35ca544568bcfca1a6230deca
I20260617 07:53:17.714927 1862 rpcz_store.cc:276] 0617 07:53:14.550521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.550566 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:17.714730 (+3164164us) ts_tablet_manager.cc:1151] Deleting tablet c7e43e1a3df54efe992a86dd0bd0c149
0617 07:53:17.714738 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.714788 (+ 50us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3164023}
W20260617 07:53:17.715363 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c7e43e1a3df54efe992a86dd0bd0c149 because the tablet was not found. No further retry: Not found: Tablet not found: c7e43e1a3df54efe992a86dd0bd0c149
I20260617 07:53:17.715416 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 232) took 3164 ms. Trace:
I20260617 07:53:17.715488 1862 rpcz_store.cc:276] 0617 07:53:14.550994 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.551046 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:17.715338 (+3164292us) ts_tablet_manager.cc:1151] Deleting tablet 7392ca4ba6a140e19c57e962a26162af
0617 07:53:17.715349 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.715402 (+ 53us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3164149}
I20260617 07:53:17.715636 1172 tablet_bootstrap.cc:492] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:17.715795 1172 ts_tablet_manager.cc:1403] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.075s user 0.004s sys 0.000s
W20260617 07:53:17.716022 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7392ca4ba6a140e19c57e962a26162af because the tablet was not found. No further retry: Not found: Tablet not found: 7392ca4ba6a140e19c57e962a26162af
I20260617 07:53:17.716049 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 235) took 3005 ms. Trace:
I20260617 07:53:17.716114 1862 rpcz_store.cc:276] 0617 07:53:14.710832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.713549 (+ 2717us) service_pool.cc:224] Handling call
0617 07:53:17.715967 (+3002418us) ts_tablet_manager.cc:1151] Deleting tablet 9cddb9e82c354f26b3abe56ebdefd008
0617 07:53:17.715976 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.716036 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3001973}
W20260617 07:53:17.716653 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 9cddb9e82c354f26b3abe56ebdefd008 because the tablet was not found. No further retry: Not found: Tablet not found: 9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:17.716899 1178 tablet_bootstrap.cc:492] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:17.717191 1172 raft_consensus.cc:359] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.717463 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 236) took 3006 ms. Trace:
I20260617 07:53:17.717494 1172 raft_consensus.cc:385] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.717557 1172 raft_consensus.cc:740] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.717598 1862 rpcz_store.cc:276] 0617 07:53:14.710926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.712460 (+ 1534us) service_pool.cc:224] Handling call
0617 07:53:17.717384 (+3004924us) ts_tablet_manager.cc:1151] Deleting tablet 0ebafc920ed34216be5fb115f9bc6f7f
0617 07:53:17.717393 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.717446 (+ 53us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3003247}
I20260617 07:53:17.717901 1172 consensus_queue.cc:260] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:17.718052 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0ebafc920ed34216be5fb115f9bc6f7f because the tablet was not found. No further retry: Not found: Tablet not found: 0ebafc920ed34216be5fb115f9bc6f7f
I20260617 07:53:17.718122 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 237) took 2785 ms. Trace:
I20260617 07:53:17.718201 1862 rpcz_store.cc:276] 0617 07:53:14.932975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.933045 (+ 70us) service_pool.cc:224] Handling call
0617 07:53:17.718015 (+2784970us) ts_tablet_manager.cc:1151] Deleting tablet 5942eea42c7541349ad7b6560e6777c8
0617 07:53:17.718023 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.718109 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2784807}
W20260617 07:53:17.714825 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 already in progress: creating tablet
W20260617 07:53:17.718647 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5942eea42c7541349ad7b6560e6777c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5942eea42c7541349ad7b6560e6777c8 already in progress: creating tablet
I20260617 07:53:17.719182 1172 ts_tablet_manager.cc:1434] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260617 07:53:17.719226 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet b01721f68e3c41f4a2ffaf05bb180761 because the tablet was not found. No further retry: Not found: Tablet not found: b01721f68e3c41f4a2ffaf05bb180761
W20260617 07:53:17.720139 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6ddfb822b5af4bb6b664936c769d9625 because the tablet was not found. No further retry: Not found: Tablet not found: 6ddfb822b5af4bb6b664936c769d9625
W20260617 07:53:17.720897 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5a547dabaeb742ba941690f4895955bd because the tablet was not found. No further retry: Not found: Tablet not found: 5a547dabaeb742ba941690f4895955bd
I20260617 07:53:17.721581 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 238) took 2788 ms. Trace:
I20260617 07:53:17.721694 1862 rpcz_store.cc:276] 0617 07:53:14.933348 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:14.933389 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:17.721476 (+2788087us) ts_tablet_manager.cc:1151] Deleting tablet eb75a965740344c2bd0b68a8dda28be5
0617 07:53:17.721485 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.721564 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2787949}
W20260617 07:53:17.721839 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a882ae04eeb94276bb78ded81fbea708 because the tablet was not found. No further retry: Not found: Tablet not found: a882ae04eeb94276bb78ded81fbea708
W20260617 07:53:17.723022 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7f7611958cf143438497c93f5f2bc098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7611958cf143438497c93f5f2bc098 already in progress: creating tablet
I20260617 07:53:17.723611 1178 tablet_bootstrap.cc:654] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:17.724061 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet eb75a965740344c2bd0b68a8dda28be5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb75a965740344c2bd0b68a8dda28be5 already in progress: creating tablet
I20260617 07:53:17.724120 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 281) took 2167 ms. Trace:
I20260617 07:53:17.724193 1862 rpcz_store.cc:276] 0617 07:53:15.557168 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.557231 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:17.724013 (+2166782us) ts_tablet_manager.cc:1151] Deleting tablet 488cc3a082b14dee8f70153e6f2925a4
0617 07:53:17.724021 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.724106 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2166579}
I20260617 07:53:17.724594 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 282) took 2167 ms. Trace:
W20260617 07:53:17.724671 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 488cc3a082b14dee8f70153e6f2925a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 488cc3a082b14dee8f70153e6f2925a4 already in progress: creating tablet
W20260617 07:53:17.725530 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 82d682ae37d74b4b967da0f8e2de6301 because the tablet was not found. No further retry: Not found: Tablet not found: 82d682ae37d74b4b967da0f8e2de6301
W20260617 07:53:17.726382 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3f51c76d93674a91b5ada7821393020a because the tablet was not found. No further retry: Not found: Tablet not found: 3f51c76d93674a91b5ada7821393020a
I20260617 07:53:17.729759 1862 rpcz_store.cc:276] 0617 07:53:15.557271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.557463 (+ 192us) service_pool.cc:224] Handling call
0617 07:53:17.724500 (+2167037us) ts_tablet_manager.cc:1151] Deleting tablet 4e8e9692227147d6a8c6854133941b44
0617 07:53:17.724508 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.724580 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2166917}
I20260617 07:53:17.730284 1862 tablet_replica.cc:333] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:17.730271 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4e8e9692227147d6a8c6854133941b44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e8e9692227147d6a8c6854133941b44 already in progress: creating tablet
I20260617 07:53:17.730528 1862 raft_consensus.cc:2243] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
W20260617 07:53:17.730026 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 28e1fd7f91f94221884be2166f0cc793 because the tablet was not found. No further retry: Not found: Tablet not found: 28e1fd7f91f94221884be2166f0cc793
I20260617 07:53:17.730789 1862 pending_rounds.cc:70] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:17.730882 1862 pending_rounds.cc:77] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772736602005504 op_type: NO_OP noop_request { }
I20260617 07:53:17.731035 1862 raft_consensus.cc:2889] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260617 07:53:17.731138 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d9e473fd444efa6ab63cc51dbb2bd already in progress: creating tablet
W20260617 07:53:17.731549 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d21f61a35ca544568bcfca1a6230deca because the tablet was not found. No further retry: Not found: Tablet not found: d21f61a35ca544568bcfca1a6230deca
W20260617 07:53:17.731954 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c7e43e1a3df54efe992a86dd0bd0c149 because the tablet was not found. No further retry: Not found: Tablet not found: c7e43e1a3df54efe992a86dd0bd0c149
W20260617 07:53:17.732323 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 89783bab2e584fe9a8eda963f78bf3ec because the tablet was not found. No further retry: Not found: Tablet not found: 89783bab2e584fe9a8eda963f78bf3ec
W20260617 07:53:17.732679 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
W20260617 07:53:17.732993 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 950c1c44020a4586b3197f5f68a38963 because the tablet was not found. No further retry: Not found: Tablet not found: 950c1c44020a4586b3197f5f68a38963
W20260617 07:53:17.733358 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0c21efcad98348ebabcee4821dc4682e because the tablet was not found. No further retry: Not found: Tablet not found: 0c21efcad98348ebabcee4821dc4682e
W20260617 07:53:17.733668 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 369442b72f754ee08dc6a484d51f2e99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 369442b72f754ee08dc6a484d51f2e99 already in progress: creating tablet
I20260617 07:53:17.733791 1862 raft_consensus.cc:2272] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:17.734161 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e03a26e301e747febc4d5bafdc1a49c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03a26e301e747febc4d5bafdc1a49c6 already in progress: creating tablet
I20260617 07:53:17.734543 1171 tablet_bootstrap.cc:492] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:17.734570 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 739cadc7ad124e229441333de949f2c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 739cadc7ad124e229441333de949f2c6 already in progress: creating tablet
I20260617 07:53:17.734678 1171 ts_tablet_manager.cc:1403] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.083s user 0.010s sys 0.000s
W20260617 07:53:17.735123 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35120ce002f24f2bb1ea0fdc59fbfc9d already in progress: creating tablet
W20260617 07:53:17.735670 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 69996eb4ab6e40f9b2d97e00d766822a because the tablet was not found. No further retry: Not found: Tablet not found: 69996eb4ab6e40f9b2d97e00d766822a
I20260617 07:53:17.735682 1171 raft_consensus.cc:359] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.736357 1171 raft_consensus.cc:385] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.736429 1171 raft_consensus.cc:740] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.736636 1171 consensus_queue.cc:260] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:17.736703 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d80c2ffcf1b84df0bc6a468ea0929e80 because the tablet was not found. No further retry: Not found: Tablet not found: d80c2ffcf1b84df0bc6a468ea0929e80
I20260617 07:53:17.737112 1171 ts_tablet_manager.cc:1434] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:17.737447 1171 tablet_bootstrap.cc:492] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:17.737576 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 737e9344fc824714a2c2596170637158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 737e9344fc824714a2c2596170637158 already in progress: creating tablet
I20260617 07:53:17.739001 1171 tablet_bootstrap.cc:654] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:17.739665 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cc84665c7849469aa27e6505dbed1516 because the tablet was not found. No further retry: Not found: Tablet not found: cc84665c7849469aa27e6505dbed1516
W20260617 07:53:17.740490 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet de030009192748118b388eec555d90da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de030009192748118b388eec555d90da already in progress: creating tablet
I20260617 07:53:17.741232 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 2684f3200e604bb6bf37a2f97a193eff (table default.Table_9439306243c4451db8d00e183b7dbeda [id=3d4b592286ce4a06bcc5f3477fdbf25f]) successfully deleted
I20260617 07:53:17.734678 1862 ts_tablet_manager.cc:1916] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:17.742312 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0f9db8a986b344548e435b77edc14cb6 because the tablet was not found. No further retry: Not found: Tablet not found: 0f9db8a986b344548e435b77edc14cb6
W20260617 07:53:17.743500 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66140c5d364f453a8089f143cc96ede8 already in progress: creating tablet
I20260617 07:53:17.744374 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet be14a95f458d440e86133ef65c484571 (table default.Table_868af3e5fa6c43ab8593b4e6a0073a62 [id=16ff2f9be38e41fc81466c55286f0b42]) successfully deleted
I20260617 07:53:17.745424 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 59acdc64fe9247d28c4c277161b42f4f (table default.Table_656646625fa14241aca849fa3503ddd5 [id=7577addfbf5b4e7aab1db0a6e726ad7d]) successfully deleted
W20260617 07:53:17.746348 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
W20260617 07:53:17.747332 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bbc3d13d519843a9bc38e97dc85b67c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbc3d13d519843a9bc38e97dc85b67c8 already in progress: creating tablet
I20260617 07:53:17.748453 2201 raft_consensus.cc:493] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:17.748368 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65bf5384ec244d36ba3d4e781c5eb8a3 already in progress: creating tablet
I20260617 07:53:17.748582 2201 raft_consensus.cc:515] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.749116 2201 leader_election.cc:290] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.749536 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233cae2480ed457bbab22ead8c0bde2c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:17.749430 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 11794aa70824476e9751a41ab305cc80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11794aa70824476e9751a41ab305cc80 already in progress: creating tablet
I20260617 07:53:17.749662 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233cae2480ed457bbab22ead8c0bde2c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:17.749854 1052 raft_consensus.cc:2468] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:17.750201 852 leader_election.cc:343] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.750592 851 leader_election.cc:304] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
W20260617 07:53:17.750588 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 121339ab4842432e9fb7bc357750f8ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 121339ab4842432e9fb7bc357750f8ad already in progress: creating tablet
I20260617 07:53:17.750830 2201 raft_consensus.cc:2804] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:17.750900 2201 raft_consensus.cc:493] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:17.750952 2201 raft_consensus.cc:3060] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.753834 2201 raft_consensus.cc:515] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.754833 2201 leader_election.cc:290] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.755115 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233cae2480ed457bbab22ead8c0bde2c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:17.755673 852 leader_election.cc:343] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.755939 1170 raft_consensus.cc:2243] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.756135 1172 tablet_bootstrap.cc:492] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:17.756163 1170 raft_consensus.cc:2272] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.756655 1170 ts_tablet_manager.cc:1916] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.758077 1172 tablet_bootstrap.cc:654] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.758702 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233cae2480ed457bbab22ead8c0bde2c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:17.758877 1052 raft_consensus.cc:3060] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:17.758702 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5dcfb101cf51487692ef9a6a17f40804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dcfb101cf51487692ef9a6a17f40804 already in progress: creating tablet
W20260617 07:53:17.760030 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 95865af94c04410386d23cb369180611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95865af94c04410386d23cb369180611 already in progress: creating tablet
W20260617 07:53:17.761354 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ab8388648475499db50cc16a7c36775a because the tablet was not found. No further retry: Not found: Tablet not found: ab8388648475499db50cc16a7c36775a
W20260617 07:53:17.762565 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a2f21861cb6f481eae968edc733e6e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2f21861cb6f481eae968edc733e6e6f already in progress: creating tablet
W20260617 07:53:17.763810 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0dc0676db18c42259efb1ad7dbd140c8 because the tablet was not found. No further retry: Not found: Tablet not found: 0dc0676db18c42259efb1ad7dbd140c8
W20260617 07:53:17.765024 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 36ce60b466f7420992ef194d72b5718d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ce60b466f7420992ef194d72b5718d already in progress: creating tablet
I20260617 07:53:17.766639 1171 tablet_bootstrap.cc:492] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:17.766387 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8fa23bb0929440b1820afdce4b9e8d8c because the tablet was not found. No further retry: Not found: Tablet not found: 8fa23bb0929440b1820afdce4b9e8d8c
I20260617 07:53:17.766778 1171 ts_tablet_manager.cc:1403] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260617 07:53:17.767624 1171 raft_consensus.cc:359] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.767814 1171 raft_consensus.cc:385] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.767869 1171 raft_consensus.cc:740] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.768137 1171 consensus_queue.cc:260] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:17.770092 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f030d59f4e124f64bb62d05f0bb0f560 because the tablet was not found. No further retry: Not found: Tablet not found: f030d59f4e124f64bb62d05f0bb0f560
I20260617 07:53:17.771102 1862 ts_tablet_manager.cc:1929] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 07:53:17.771539 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92e55be5f28740fba65c1199a571d97a already in progress: creating tablet
W20260617 07:53:17.773193 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9cddb9e82c354f26b3abe56ebdefd008 because the tablet was not found. No further retry: Not found: Tablet not found: 9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:17.774677 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet df37ed81b17d4178adeb6057491b4cc9 (table default.Table_57d8a7f4af774adeb25c6a592b0c0800 [id=b1b850d52163487fa43a3699bf969f8b]) successfully deleted
I20260617 07:53:17.776108 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 0ebafc920ed34216be5fb115f9bc6f7f (table default.Table_72eda13c56884241ab3153e5cb1a72d1 [id=78af228b204f4bb5a4e5867d1a9f9124]) successfully deleted
I20260617 07:53:17.776640 1862 log.cc:1199] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/3aa1c1fdede041d28570b85e63c401b7
I20260617 07:53:17.777068 1862 ts_tablet_manager.cc:1950] T 3aa1c1fdede041d28570b85e63c401b7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:17.777859 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 279) took 2250 ms. Trace:
I20260617 07:53:17.777946 1862 rpcz_store.cc:276] 0617 07:53:15.527042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.566315 (+ 39273us) service_pool.cc:224] Handling call
0617 07:53:17.730238 (+2163923us) ts_tablet_manager.cc:1151] Deleting tablet 3aa1c1fdede041d28570b85e63c401b7
0617 07:53:17.730248 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.747968 (+ 17720us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.771034 (+ 23066us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.777840 (+ 6806us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2163734}
I20260617 07:53:17.778337 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 287) took 2167 ms. Trace:
I20260617 07:53:17.778404 1862 rpcz_store.cc:276] 0617 07:53:15.610783 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.611206 (+ 423us) service_pool.cc:224] Handling call
0617 07:53:17.778223 (+2167017us) ts_tablet_manager.cc:1151] Deleting tablet 68b448c65e684f49bf142ce2b5084d33
0617 07:53:17.778233 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.778321 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2166818}
I20260617 07:53:17.778708 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 286) took 2168 ms. Trace:
I20260617 07:53:17.778816 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]) successfully deleted
W20260617 07:53:17.779085 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 68b448c65e684f49bf142ce2b5084d33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68b448c65e684f49bf142ce2b5084d33 already in progress: creating tablet
I20260617 07:53:17.777697 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 74ab8e93e3fe475ba9c7b5fce390a8ab (table default.Table_be503ca177d549f6a02bc394edcc4fe7 [id=de6d213812d4427fa28250763779565e]) successfully deleted
W20260617 07:53:17.780732 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c7343400555f447b8a1721ba36d7766d because the tablet was not found. No further retry: Not found: Tablet not found: c7343400555f447b8a1721ba36d7766d
I20260617 07:53:17.761693 1052 raft_consensus.cc:2468] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:17.782516 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 570ae1e189a64da6bad10156b401ec46 (table default.Table_36ea1c171ce8494897cb86719e457f33 [id=c071149926f844bdbcd2b37be768ada6]) successfully deleted
I20260617 07:53:17.783787 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 245cff69d83b43e98b1c72b8d3011347 (table default.Table_1735b3a964d948ea9c83c11e8adf8c68 [id=7a799def323b4e8d958c34f9ace044a2]) successfully deleted
W20260617 07:53:17.786003 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a82e4d6c09bb4414ad7f3b760f7ae681 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a82e4d6c09bb4414ad7f3b760f7ae681 already in progress: creating tablet
W20260617 07:53:17.786943 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e05a97a4ab4ed7bff523d1fb1c59ae already in progress: creating tablet
I20260617 07:53:17.774921 1171 ts_tablet_manager.cc:1434] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260617 07:53:17.787853 1862 rpcz_store.cc:276] 0617 07:53:15.610617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.616367 (+ 5750us) service_pool.cc:224] Handling call
0617 07:53:17.778613 (+2162246us) ts_tablet_manager.cc:1151] Deleting tablet 5364dfe28b8d4042941c8d8d4d1cf503
0617 07:53:17.778621 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.778695 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2161969}
I20260617 07:53:17.788203 1171 tablet_bootstrap.cc:492] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:17.788267 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 290) took 2158 ms. Trace:
I20260617 07:53:17.788336 1862 rpcz_store.cc:276] 0617 07:53:15.629767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.629820 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:17.788153 (+2158333us) ts_tablet_manager.cc:1151] Deleting tablet 5578fd5cb3724ed5b92b313bd52889ad
0617 07:53:17.788160 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.788252 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2158086}
I20260617 07:53:17.788591 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 293) took 2156 ms. Trace:
I20260617 07:53:17.788663 1862 rpcz_store.cc:276] 0617 07:53:15.631931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.631983 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:17.788520 (+2156537us) ts_tablet_manager.cc:1151] Deleting tablet 4996cde4d1514aa081257c802339abe6
0617 07:53:17.788529 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.788578 (+ 49us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2156344}
I20260617 07:53:17.782282 851 leader_election.cc:304] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:17.788925 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 295) took 2156 ms. Trace:
I20260617 07:53:17.788985 1862 rpcz_store.cc:276] 0617 07:53:15.632124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.632171 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:17.788859 (+2156688us) ts_tablet_manager.cc:1151] Deleting tablet df4f9101deaa4e6ebddacbce14f32810
0617 07:53:17.788868 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.788915 (+ 47us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2156541}
I20260617 07:53:17.789228 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 294) took 2157 ms. Trace:
I20260617 07:53:17.789296 1862 rpcz_store.cc:276] 0617 07:53:15.632014 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.632214 (+ 200us) service_pool.cc:224] Handling call
0617 07:53:17.789166 (+2156952us) ts_tablet_manager.cc:1151] Deleting tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
0617 07:53:17.789175 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.789218 (+ 43us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2156822}
I20260617 07:53:17.789690 2386 raft_consensus.cc:493] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.789844 2386 raft_consensus.cc:515] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.790369 2386 leader_election.cc:290] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:17.790946 458 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet a4a35e3b7bb74667aa498c58a856cacc (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet a4a35e3b7bb74667aa498c58a856cacc consensus state has no leader
I20260617 07:53:17.791126 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2735f7dd40e54aec9004b9b38702607c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.791250 1172 tablet_bootstrap.cc:492] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:17.791570 1172 ts_tablet_manager.cc:1403] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
W20260617 07:53:17.791595 986 leader_election.cc:343] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:17.791903 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5364dfe28b8d4042941c8d8d4d1cf503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5364dfe28b8d4042941c8d8d4d1cf503 already in progress: creating tablet
W20260617 07:53:17.792145 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5578fd5cb3724ed5b92b313bd52889ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5578fd5cb3724ed5b92b313bd52889ad already in progress: creating tablet
W20260617 07:53:17.792348 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4996cde4d1514aa081257c802339abe6 because the tablet was not found. No further retry: Not found: Tablet not found: 4996cde4d1514aa081257c802339abe6
W20260617 07:53:17.792548 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet df4f9101deaa4e6ebddacbce14f32810 because the tablet was not found. No further retry: Not found: Tablet not found: df4f9101deaa4e6ebddacbce14f32810
W20260617 07:53:17.792758 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae because the tablet was not found. No further retry: Not found: Tablet not found: 57e05a97a4ab4ed7bff523d1fb1c59ae
I20260617 07:53:17.776544 1170 ts_tablet_manager.cc:1929] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.793892 1170 log.cc:1199] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/3aa1c1fdede041d28570b85e63c401b7
I20260617 07:53:17.794260 1170 ts_tablet_manager.cc:1950] T 3aa1c1fdede041d28570b85e63c401b7 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:17.794212 1172 raft_consensus.cc:359] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.794529 1172 raft_consensus.cc:385] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.794660 1172 raft_consensus.cc:740] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.794999 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 248) took 2267 ms. Trace:
I20260617 07:53:17.795127 1170 rpcz_store.cc:276] 0617 07:53:15.527619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.527672 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:17.654834 (+2127162us) ts_tablet_manager.cc:1151] Deleting tablet 3aa1c1fdede041d28570b85e63c401b7
0617 07:53:17.654843 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.759553 (+104710us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.776489 (+ 16936us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.794979 (+ 18490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1855,"tablet-delete.queue_time_us":2126971}
I20260617 07:53:17.795503 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 251) took 2262 ms. Trace:
I20260617 07:53:17.795594 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]) successfully deleted
I20260617 07:53:17.795579 1170 rpcz_store.cc:276] 0617 07:53:15.533298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.533349 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:17.795398 (+2262049us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:17.795407 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.795488 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2261863}
I20260617 07:53:17.795867 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 252) took 2262 ms. Trace:
I20260617 07:53:17.795945 1170 rpcz_store.cc:276] 0617 07:53:15.533406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.533576 (+ 170us) service_pool.cc:224] Handling call
0617 07:53:17.795793 (+2262217us) ts_tablet_manager.cc:1151] Deleting tablet 0fd8cedb539748dc917128511325bbcc
0617 07:53:17.795801 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.795853 (+ 52us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2262100}
W20260617 07:53:17.796023 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e9488e8a501e404f85540fb045d8916f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9488e8a501e404f85540fb045d8916f already in progress: creating tablet
I20260617 07:53:17.796233 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 253) took 2262 ms. Trace:
I20260617 07:53:17.796304 1170 rpcz_store.cc:276] 0617 07:53:15.533565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.533744 (+ 179us) service_pool.cc:224] Handling call
0617 07:53:17.796161 (+2262417us) ts_tablet_manager.cc:1151] Deleting tablet de030009192748118b388eec555d90da
0617 07:53:17.796170 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.796218 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2262303}
W20260617 07:53:17.796494 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0fd8cedb539748dc917128511325bbcc because the tablet was not found. No further retry: Not found: Tablet not found: 0fd8cedb539748dc917128511325bbcc
I20260617 07:53:17.796603 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 249) took 2263 ms. Trace:
I20260617 07:53:17.796674 1170 rpcz_store.cc:276] 0617 07:53:15.533080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.533143 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:17.796513 (+2263370us) ts_tablet_manager.cc:1151] Deleting tablet 11794aa70824476e9751a41ab305cc80
0617 07:53:17.796520 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.796589 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2262614}
W20260617 07:53:17.796932 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet de030009192748118b388eec555d90da because the tablet was not found. No further retry: Not found: Tablet not found: de030009192748118b388eec555d90da
I20260617 07:53:17.797024 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 250) took 2263 ms. Trace:
I20260617 07:53:17.797114 1170 rpcz_store.cc:276] 0617 07:53:15.533189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.534015 (+ 826us) service_pool.cc:224] Handling call
0617 07:53:17.796933 (+2262918us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:17.796941 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.797009 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2262770}
I20260617 07:53:17.797389 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 258) took 2237 ms. Trace:
W20260617 07:53:17.797403 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 11794aa70824476e9751a41ab305cc80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11794aa70824476e9751a41ab305cc80 already in progress: creating tablet
I20260617 07:53:17.797466 1170 rpcz_store.cc:276] 0617 07:53:15.560126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.560173 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:17.797319 (+2237146us) ts_tablet_manager.cc:1151] Deleting tablet 92e55be5f28740fba65c1199a571d97a
0617 07:53:17.797327 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.797375 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2236947}
I20260617 07:53:17.797772 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 260) took 2237 ms. Trace:
W20260617 07:53:17.797922 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet bbc3d13d519843a9bc38e97dc85b67c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbc3d13d519843a9bc38e97dc85b67c8 already in progress: creating tablet
W20260617 07:53:17.798149 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because the tablet was not found. No further retry: Not found: Tablet not found: 92e55be5f28740fba65c1199a571d97a
W20260617 07:53:17.798429 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4996cde4d1514aa081257c802339abe6 because the tablet was not found. No further retry: Not found: Tablet not found: 4996cde4d1514aa081257c802339abe6
W20260617 07:53:17.800024 458 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet e5544753b3144c1989f2ed99bffc2246 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e5544753b3144c1989f2ed99bffc2246 consensus state has no leader
I20260617 07:53:17.800464 1178 tablet_bootstrap.cc:492] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:17.800765 1178 ts_tablet_manager.cc:1403] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.013s
I20260617 07:53:17.802129 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 292) took 2170 ms. Trace:
I20260617 07:53:17.802227 1862 rpcz_store.cc:276] 0617 07:53:15.631862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.632320 (+ 458us) service_pool.cc:224] Handling call
0617 07:53:17.789458 (+2157138us) ts_tablet_manager.cc:1151] Deleting tablet df37ed81b17d4178adeb6057491b4cc9
0617 07:53:17.800073 (+ 10615us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.802107 (+ 2034us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2157022}
I20260617 07:53:17.802078 1178 raft_consensus.cc:359] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.802546 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 296) took 2170 ms. Trace:
I20260617 07:53:17.802524 1178 raft_consensus.cc:385] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.802626 1862 rpcz_store.cc:276] 0617 07:53:15.632517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.632667 (+ 150us) service_pool.cc:224] Handling call
0617 07:53:17.802473 (+2169806us) ts_tablet_manager.cc:1151] Deleting tablet 0cfb98aecc4546c88371436fcfbf8e86
0617 07:53:17.802482 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.802531 (+ 49us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2169666}
I20260617 07:53:17.802914 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 291) took 2171 ms. Trace:
I20260617 07:53:17.802906 1178 raft_consensus.cc:740] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.803001 1862 rpcz_store.cc:276] 0617 07:53:15.631775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.634622 (+ 2847us) service_pool.cc:224] Handling call
0617 07:53:17.802844 (+2168222us) ts_tablet_manager.cc:1151] Deleting tablet 59acdc64fe9247d28c4c277161b42f4f
0617 07:53:17.802852 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.802900 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2168035}
I20260617 07:53:17.803313 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 310) took 1865 ms. Trace:
I20260617 07:53:17.803393 1862 rpcz_store.cc:276] 0617 07:53:15.938237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.938401 (+ 164us) service_pool.cc:224] Handling call
0617 07:53:17.803219 (+1864818us) ts_tablet_manager.cc:1151] Deleting tablet 4681e8e3f1174b299d89ec541ca8e6b3
0617 07:53:17.803227 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.803298 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1864632}
I20260617 07:53:17.803683 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 312) took 1865 ms. Trace:
I20260617 07:53:17.803764 1862 rpcz_store.cc:276] 0617 07:53:15.938575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.938622 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:17.803593 (+1864971us) ts_tablet_manager.cc:1151] Deleting tablet 8c76bfcbd22e4bfb97346a1b56f68dab
0617 07:53:17.803601 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.803669 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1864824}
I20260617 07:53:17.803623 1178 consensus_queue.cc:260] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.804004 1862 tablet_replica.cc:333] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:17.804198 1862 raft_consensus.cc:2243] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:17.804503 1862 raft_consensus.cc:2272] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:17.799340 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df4f9101deaa4e6ebddacbce14f32810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df4f9101deaa4e6ebddacbce14f32810 already in progress: creating tablet
W20260617 07:53:17.805641 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0cfb98aecc4546c88371436fcfbf8e86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cfb98aecc4546c88371436fcfbf8e86 already in progress: creating tablet
I20260617 07:53:17.806293 1178 ts_tablet_manager.cc:1434] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260617 07:53:17.806674 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 283c08c31718433e83f0cedd799215fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 283c08c31718433e83f0cedd799215fe already in progress: creating tablet
I20260617 07:53:17.808341 747 tablet_service.cc:1511] Processing CreateTablet for tablet bf0d92f849b844609763705df1615ae4 (DEFAULT_TABLE table=default.Table_cf8a1de2a6034fababf6dd4a1667f37b [id=3202a9054adf46e0a4e4b752c132b71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.808718 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0d92f849b844609763705df1615ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.810871 1170 rpcz_store.cc:276] 0617 07:53:15.560293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.560403 (+ 110us) service_pool.cc:224] Handling call
0617 07:53:17.797660 (+2237257us) ts_tablet_manager.cc:1151] Deleting tablet 71e8f7118aaf4c6a9b9caab5abc030fa
0617 07:53:17.797667 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.797758 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2237130}
I20260617 07:53:17.811256 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 262) took 2250 ms. Trace:
W20260617 07:53:17.811259 458 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:33527 (request call id 146) took 1790 ms (client timeout 1000 ms). Trace:
I20260617 07:53:17.811334 1170 rpcz_store.cc:276] 0617 07:53:15.560481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.560561 (+ 80us) service_pool.cc:224] Handling call
0617 07:53:17.811164 (+2250603us) ts_tablet_manager.cc:1151] Deleting tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
0617 07:53:17.811174 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.811241 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2250483}
W20260617 07:53:17.811383 458 rpcz_store.cc:269] 0617 07:53:16.021127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.021847 (+ 720us) service_pool.cc:224] Handling call
0617 07:53:17.811221 (+1789374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76046,"reported_tablets":267}
W20260617 07:53:17.811537 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 71e8f7118aaf4c6a9b9caab5abc030fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71e8f7118aaf4c6a9b9caab5abc030fa already in progress: creating tablet
I20260617 07:53:17.811612 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 264) took 2251 ms. Trace:
I20260617 07:53:17.811676 1170 rpcz_store.cc:276] 0617 07:53:15.560631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.560697 (+ 66us) service_pool.cc:224] Handling call
0617 07:53:17.811537 (+2250840us) ts_tablet_manager.cc:1151] Deleting tablet a2f21861cb6f481eae968edc733e6e6f
0617 07:53:17.811545 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.811598 (+ 53us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2250734}
I20260617 07:53:17.811939 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 265) took 2251 ms. Trace:
I20260617 07:53:17.811993 1170 rpcz_store.cc:276] 0617 07:53:15.560711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.560817 (+ 106us) service_pool.cc:224] Handling call
0617 07:53:17.811855 (+2251038us) ts_tablet_manager.cc:1151] Deleting tablet 0be19ece3a0a4a51abad7b8e2f3b2420
0617 07:53:17.811862 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.811928 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2250945}
I20260617 07:53:17.812251 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 267) took 2251 ms. Trace:
I20260617 07:53:17.812310 1170 rpcz_store.cc:276] 0617 07:53:15.560889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.560925 (+ 36us) service_pool.cc:224] Handling call
0617 07:53:17.812187 (+2251262us) ts_tablet_manager.cc:1151] Deleting tablet 59acdc64fe9247d28c4c277161b42f4f
0617 07:53:17.812195 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.812240 (+ 45us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2251168}
I20260617 07:53:17.812536 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 266) took 2251 ms. Trace:
I20260617 07:53:17.812593 1170 rpcz_store.cc:276] 0617 07:53:15.560811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.561034 (+ 223us) service_pool.cc:224] Handling call
0617 07:53:17.812476 (+2251442us) ts_tablet_manager.cc:1151] Deleting tablet 66140c5d364f453a8089f143cc96ede8
0617 07:53:17.812483 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.812524 (+ 41us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2251356}
I20260617 07:53:17.812798 1170 tablet_replica.cc:333] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:17.812964 1170 raft_consensus.cc:2243] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.812978 1862 ts_tablet_manager.cc:1916] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.813117 1170 raft_consensus.cc:2272] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.813620 1170 ts_tablet_manager.cc:1916] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.814266 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_78c4ad680e8849b18da7d278b7ecaf51" } new_table_name: "default.Table_d5600121c81049589ce932a199273324" modify_external_catalogs: true
W20260617 07:53:17.817044 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae because the tablet was not found. No further retry: Not found: Tablet not found: 57e05a97a4ab4ed7bff523d1fb1c59ae
W20260617 07:53:17.817277 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a2f21861cb6f481eae968edc733e6e6f because the tablet was not found. No further retry: Not found: Tablet not found: a2f21861cb6f481eae968edc733e6e6f
W20260617 07:53:17.817469 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0be19ece3a0a4a51abad7b8e2f3b2420 already in progress: creating tablet
W20260617 07:53:17.817662 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 59acdc64fe9247d28c4c277161b42f4f because the tablet was not found. No further retry: Not found: Tablet not found: 59acdc64fe9247d28c4c277161b42f4f
W20260617 07:53:17.817874 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because the tablet was not found. No further retry: Not found: Tablet not found: 66140c5d364f453a8089f143cc96ede8
I20260617 07:53:17.794998 1172 consensus_queue.cc:260] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.818514 1172 ts_tablet_manager.cc:1434] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260617 07:53:17.818945 1178 tablet_bootstrap.cc:492] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:17.819965 747 tablet_service.cc:1511] Processing CreateTablet for tablet dd00541a2b4f4381b5e27e9883204a52 (DEFAULT_TABLE table=default.Table_c8da9b218da342e49e258e24e72ea087 [id=531523b13cfb46988653a067bfb5015a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.821555 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd00541a2b4f4381b5e27e9883204a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.824615 1172 tablet_bootstrap.cc:492] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:17.824707 741 tablet_service.cc:1511] Processing CreateTablet for tablet 2c60d917996341109ae66b9af24f6cb4 (DEFAULT_TABLE table=default.Table_c94947b1e4614158b9ab608219830eec [id=fc4ea083d7ef44cb89d3994ea805e512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:17.825057 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c60d917996341109ae66b9af24f6cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:17.829298 746 tablet_service.cc:1558] Processing DeleteTablet for tablet adbbe7eb5181431290f57ed9128181a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.829818 1898 raft_consensus.cc:2804] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:17.829972 1898 raft_consensus.cc:697] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:17.830108 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.830780 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2735f7dd40e54aec9004b9b38702607c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:17.830909 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet df37ed81b17d4178adeb6057491b4cc9 because the tablet was not found. No further retry: Not found: Tablet not found: df37ed81b17d4178adeb6057491b4cc9
W20260617 07:53:17.831146 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0cfb98aecc4546c88371436fcfbf8e86 because the tablet was not found. No further retry: Not found: Tablet not found: 0cfb98aecc4546c88371436fcfbf8e86
W20260617 07:53:17.831321 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 59acdc64fe9247d28c4c277161b42f4f because the tablet was not found. No further retry: Not found: Tablet not found: 59acdc64fe9247d28c4c277161b42f4f
W20260617 07:53:17.831506 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4681e8e3f1174b299d89ec541ca8e6b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4681e8e3f1174b299d89ec541ca8e6b3 already in progress: creating tablet
W20260617 07:53:17.832587 988 leader_election.cc:343] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.832715 988 leader_election.cc:304] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:17.832782 1178 tablet_bootstrap.cc:654] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.832952 2386 raft_consensus.cc:2749] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.835523 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:17.835556 749 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.835879 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.836148 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.836381 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad with delete_type TABLET_DATA_DELETED (replaced by tablet 01abd7aed0fd4d2b90db9f40029b5b37) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.836577 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.836719 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 531ccdf479814053b468a7d5802f5dde) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.836851 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 68b448c65e684f49bf142ce2b5084d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.837105 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.838311 741 tablet_service.cc:1558] Processing DeleteTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.841760 1172 tablet_bootstrap.cc:654] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.843608 1898 consensus_queue.cc:237] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.843914 1170 ts_tablet_manager.cc:1929] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:17.844009 1170 log.cc:1199] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/121339ab4842432e9fb7bc357750f8ad
I20260617 07:53:17.844054 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.844274 742 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.844313 1170 ts_tablet_manager.cc:1950] T 121339ab4842432e9fb7bc357750f8ad P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:17.844494 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 5203534569bd4da18bc06751f094735f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.844714 742 tablet_service.cc:1558] Processing DeleteTablet for tablet df705c2300064db680bec1fefab08d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.844893 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 52af94bd46c941b8a27136ca0506e744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.845058 742 tablet_service.cc:1558] Processing DeleteTablet for tablet b7c5ff28367b42d3a3922d2b789bc7ec with delete_type TABLET_DATA_DELETED (replaced by tablet 3bd63a5d7e8342d9b919aa0862f8cfc7) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.845255 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.845418 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.845603 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.845785 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f9db8a986b344548e435b77edc14cb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 63bf519b83c445798bddda3120b542ce) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.845768 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:17.845896 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.845983 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.846133 743 tablet_service.cc:1558] Processing DeleteTablet for tablet eb75a965740344c2bd0b68a8dda28be5 with delete_type TABLET_DATA_DELETED (replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.846197 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.846289 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:17.846364 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.846412 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db4fdde370e4d30bbf14285923644a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.846455 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
I20260617 07:53:17.846572 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.846717 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
I20260617 07:53:17.846745 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.846886 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:17.846918 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.847232 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:17.847410 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.847505 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:17.847621 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.847764 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.847919 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:17.848011 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ec78c123d448329b8442a0de0140d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.848171 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:17.848215 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.848371 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:17.848724 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:17.849046 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]). Expected version 3 got 0
I20260617 07:53:17.849259 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_a18dfbacf2d34929b9fd021add13fd7e [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 2 got 0
I20260617 07:53:17.849499 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_8dd1d9e74c1245e1afe42a16f20e57f6 [id=3824f4c443804be49d851e39e23ce3f7]). Expected version 3 got 0
I20260617 07:53:17.849850 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ca400838f5214d1a8f57e72c5068f0f9 (table default.Table_1a37fbbe9740440a8c245559a94b7f5f [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]). Expected version 1 got 0
I20260617 07:53:17.850222 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]). Expected version 1 got 0
I20260617 07:53:17.850777 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]). Expected version 1 got 0
I20260617 07:53:17.851406 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:17.851475 753 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.851679 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 with delete_type TABLET_DATA_DELETED (replaced by tablet f395f963a5a5400a966a8d4cc62aadf1) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.851836 757 tablet_service.cc:1558] Processing DeleteTablet for tablet d657fbccb4af40558033a971aab7f3e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.851996 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 706373f1f5d44edf81ed04183a8bdf89 with delete_type TABLET_DATA_DELETED (replaced by tablet e5544753b3144c1989f2ed99bffc2246) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.852193 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
I20260617 07:53:17.852416 2386 raft_consensus.cc:493] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.852558 2386 raft_consensus.cc:515] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.852752 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:17.852898 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a84c7a425c4e4bc0acd412f16cf2fa01 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:17.853178 2386 leader_election.cc:290] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:17.853380 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9ed59705e05148f991844d47882dc151 (table default.Table_02ab5db216a449ff8e508fcc459791ae [id=13962b79508f4053b5cb01cd5e6b8b27]). Expected version 1 got 0
I20260617 07:53:17.853597 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
I20260617 07:53:17.853842 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf4025a0f784cc6868950e51a45da2e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:17.854791 986 leader_election.cc:343] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.855093 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf4025a0f784cc6868950e51a45da2e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:17.856740 988 leader_election.cc:343] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.856846 988 leader_election.cc:304] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:17.857199 2386 raft_consensus.cc:2749] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.857529 741 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.858186 1171 tablet_bootstrap.cc:654] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.858860 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.859200 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.859628 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.860386 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.860918 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.861699 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:17.862272 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet adbbe7eb5181431290f57ed9128181a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbbe7eb5181431290f57ed9128181a3 already in progress: creating tablet
I20260617 07:53:17.862496 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 5942eea42c7541349ad7b6560e6777c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffa87a4304b43a89be0faa3c5ce0b2c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.865096 1862 ts_tablet_manager.cc:1929] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:17.865192 1862 log.cc:1199] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d657fbccb4af40558033a971aab7f3e4
W20260617 07:53:17.865255 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0be19ece3a0a4a51abad7b8e2f3b2420 already in progress: creating tablet
I20260617 07:53:17.865500 1862 ts_tablet_manager.cc:1950] T d657fbccb4af40558033a971aab7f3e4 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:17.865795 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cb95639e16ed423fbe60b15a1bcdf5a6 because the tablet was not found. No further retry: Not found: Tablet not found: cb95639e16ed423fbe60b15a1bcdf5a6
W20260617 07:53:17.866035 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0fd8cedb539748dc917128511325bbcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd8cedb539748dc917128511325bbcc already in progress: creating tablet
W20260617 07:53:17.866237 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 63bf519b83c445798bddda3120b542ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bf519b83c445798bddda3120b542ce already in progress: creating tablet
W20260617 07:53:17.866423 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5578fd5cb3724ed5b92b313bd52889ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5578fd5cb3724ed5b92b313bd52889ad already in progress: creating tablet
W20260617 07:53:17.866611 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 488cc3a082b14dee8f70153e6f2925a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 488cc3a082b14dee8f70153e6f2925a4 already in progress: creating tablet
W20260617 07:53:17.866796 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4681e8e3f1174b299d89ec541ca8e6b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4681e8e3f1174b299d89ec541ca8e6b3 already in progress: creating tablet
W20260617 07:53:17.866997 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 68b448c65e684f49bf142ce2b5084d33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68b448c65e684f49bf142ce2b5084d33 already in progress: creating tablet
W20260617 07:53:17.867203 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9618a5c0c9dd4c368f5763c434f70da5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9618a5c0c9dd4c368f5763c434f70da5 already in progress: creating tablet
W20260617 07:53:17.867450 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c9657e0dd2a8459cb728bdfe8a68b840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9657e0dd2a8459cb728bdfe8a68b840 already in progress: creating tablet
I20260617 07:53:17.868307 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 311) took 1929 ms. Trace:
I20260617 07:53:17.868419 1862 rpcz_store.cc:276] 0617 07:53:15.938375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.938425 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:17.803965 (+1865540us) ts_tablet_manager.cc:1151] Deleting tablet d657fbccb4af40558033a971aab7f3e4
0617 07:53:17.803974 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.850068 (+ 46094us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.865023 (+ 14955us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.868290 (+ 3267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1865130}
I20260617 07:53:17.868835 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d657fbccb4af40558033a971aab7f3e4 (table default.Table_de275810487f4911a911f2d6e00a8963 [id=1f208e21034e47a8a25e0e9988e5b156]) successfully deleted
I20260617 07:53:17.871284 1171 tablet_bootstrap.cc:492] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:17.871409 1171 ts_tablet_manager.cc:1403] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.083s user 0.005s sys 0.001s
I20260617 07:53:17.872094 1171 raft_consensus.cc:359] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.872277 1171 raft_consensus.cc:385] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.872329 1171 raft_consensus.cc:740] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.872551 1171 consensus_queue.cc:260] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.872992 1171 ts_tablet_manager.cc:1434] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:17.873265 1171 tablet_bootstrap.cc:492] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:17.874804 1171 tablet_bootstrap.cc:654] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.877557 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_0e7fa8cb8a9b49cb8ec27a4eef4a7d39 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 1 got 0
I20260617 07:53:17.878005 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9687dbd2616749f4bef7d9444bd89ddf (table default.Table_c1a736945bdc4725b14eb4db56fa777d [id=cff5df610d05436da1e53a7d7383b35a]). Expected version 1 got 0
I20260617 07:53:17.878327 1172 tablet_bootstrap.cc:492] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:17.878842 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 (table default.Table_1557e8110d1340518c2f713297b804f6 [id=d079dbab725b43c0807868020b551ccb]). Expected version 1 got 0
I20260617 07:53:17.879182 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (table default.Table_78c4ad680e8849b18da7d278b7ecaf51 [id=494c90461b61486ab6dad26bbd3acab5]). Expected version 1 got 0
I20260617 07:53:17.879598 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet b62ae096bfd347029ef8d7f0462dd111 (table default.Table_832c0052f588434faa10b821b4d09514 [id=4336b6e42a2b4c2d86fc98c56990bc8e]). Expected version 1 got 0
I20260617 07:53:17.879894 754 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b with delete_type TABLET_DATA_DELETED (replaced by tablet 0b85d49f255940eeaf343bfcf71e00e9) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.880201 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 531ccdf479814053b468a7d5802f5dde (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:17.880141 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 269) took 2319 ms. Trace:
I20260617 07:53:17.880475 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cdb1b67f4cb7463b98a63ec75d38890f (table default.Table_254698a40b82484f8ed8c47e68fb0b68 [id=a7b56d13c4944469995d657261551a5a]). Expected version 1 got 0
I20260617 07:53:17.880577 1170 rpcz_store.cc:276] 0617 07:53:15.561053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.561134 (+ 81us) service_pool.cc:224] Handling call
0617 07:53:17.812761 (+2251627us) ts_tablet_manager.cc:1151] Deleting tablet 121339ab4842432e9fb7bc357750f8ad
0617 07:53:17.812768 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.816480 (+ 3712us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.843864 (+ 27384us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:17.880120 (+ 36256us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2251539}
I20260617 07:53:17.880875 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a4a35e3b7bb74667aa498c58a856cacc (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 2 got 0
I20260617 07:53:17.881119 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 271) took 2319 ms. Trace:
I20260617 07:53:17.881319 1171 tablet_bootstrap.cc:492] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:17.881319 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a7c7083dff434fddbad7f2dcf2a6b6e6 (table default.Table_cab8bc4d921c47a2a986f4c3187d34c9 [id=23be61f7550c4f97bfa3c271e2372721]). Expected version 1 got 0
I20260617 07:53:17.881242 1170 rpcz_store.cc:276] 0617 07:53:15.561214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.561252 (+ 38us) service_pool.cc:224] Handling call
0617 07:53:17.881026 (+2319774us) ts_tablet_manager.cc:1151] Deleting tablet 2684f3200e604bb6bf37a2f97a193eff
0617 07:53:17.881036 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.881101 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2319620}
I20260617 07:53:17.881443 1171 ts_tablet_manager.cc:1403] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260617 07:53:17.881431 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_50c9e41224614d21a12eac5dea96559c [id=121feb8666fe4cb5b796fecf0bf1f8b0]) successfully deleted
I20260617 07:53:17.881824 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:17.881908 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 273) took 2320 ms. Trace:
W20260617 07:53:17.881925 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2684f3200e604bb6bf37a2f97a193eff because the tablet was not found. No further retry: Not found: Tablet not found: 2684f3200e604bb6bf37a2f97a193eff
I20260617 07:53:17.882079 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 2 got 0
I20260617 07:53:17.882066 1170 rpcz_store.cc:276] 0617 07:53:15.561391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.561436 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:17.881805 (+2320369us) ts_tablet_manager.cc:1151] Deleting tablet 9436fb7fca094eaab925748e254b1a62
0617 07:53:17.881813 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.881892 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2320257}
I20260617 07:53:17.882193 1171 raft_consensus.cc:359] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.882361 1171 raft_consensus.cc:385] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.882424 1171 raft_consensus.cc:740] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:17.882460 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
I20260617 07:53:17.882519 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 263) took 2321 ms. Trace:
I20260617 07:53:17.882618 1171 consensus_queue.cc:260] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.882696 1170 rpcz_store.cc:276] 0617 07:53:15.560559 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.561572 (+ 1013us) service_pool.cc:224] Handling call
0617 07:53:17.882416 (+2320844us) ts_tablet_manager.cc:1151] Deleting tablet 737e9344fc824714a2c2596170637158
0617 07:53:17.882425 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.882505 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2320734}
I20260617 07:53:17.883044 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]). Expected version 1 got 0
I20260617 07:53:17.883167 1171 ts_tablet_manager.cc:1434] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260617 07:53:17.883268 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 737e9344fc824714a2c2596170637158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 737e9344fc824714a2c2596170637158 already in progress: creating tablet
I20260617 07:53:17.883575 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 272) took 2322 ms. Trace:
I20260617 07:53:17.883572 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:17.883647 1170 rpcz_store.cc:276] 0617 07:53:15.561287 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.561705 (+ 418us) service_pool.cc:224] Handling call
0617 07:53:17.883480 (+2321775us) ts_tablet_manager.cc:1151] Deleting tablet e897b111e65c497591c7daaa81d783c7
0617 07:53:17.883487 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.883561 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2321626}
I20260617 07:53:17.883914 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
W20260617 07:53:17.884014 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e897b111e65c497591c7daaa81d783c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e897b111e65c497591c7daaa81d783c7 already in progress: creating tablet
I20260617 07:53:17.884232 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:17.884286 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 254) took 2324 ms. Trace:
I20260617 07:53:17.884373 1170 rpcz_store.cc:276] 0617 07:53:15.559817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.561760 (+ 1943us) service_pool.cc:224] Handling call
0617 07:53:17.884216 (+2322456us) ts_tablet_manager.cc:1151] Deleting tablet 36ce60b466f7420992ef194d72b5718d
0617 07:53:17.884224 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.884273 (+ 49us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322300}
W20260617 07:53:17.884768 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 36ce60b466f7420992ef194d72b5718d because the tablet was not found. No further retry: Not found: Tablet not found: 36ce60b466f7420992ef194d72b5718d
I20260617 07:53:17.885044 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 270) took 2323 ms. Trace:
I20260617 07:53:17.885113 1170 rpcz_store.cc:276] 0617 07:53:15.561131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.561889 (+ 758us) service_pool.cc:224] Handling call
0617 07:53:17.884975 (+2323086us) ts_tablet_manager.cc:1151] Deleting tablet 0f9db8a986b344548e435b77edc14cb6
0617 07:53:17.884983 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.885031 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322963}
W20260617 07:53:17.885456 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0f9db8a986b344548e435b77edc14cb6 because the tablet was not found. No further retry: Not found: Tablet not found: 0f9db8a986b344548e435b77edc14cb6
I20260617 07:53:17.885741 1170 tablet_replica.cc:333] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:17.885910 1170 raft_consensus.cc:2243] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:17.886044 1170 raft_consensus.cc:2272] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.886332 1172 ts_tablet_manager.cc:1403] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.000s
I20260617 07:53:17.887014 1172 raft_consensus.cc:359] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.888034 757 tablet_service.cc:1558] Processing DeleteTablet for tablet cc84665c7849469aa27e6505dbed1516 with delete_type TABLET_DATA_DELETED (replaced by tablet 71e8f7118aaf4c6a9b9caab5abc030fa) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.888134 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 979087485af94e159d3d0f2cb873899e (table default.Table_5238d7f8a8b649df9298e622257465f5 [id=7a23152402da4e608156935807a7b61b]). Expected version 1 got 0
I20260617 07:53:17.888383 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:17.888471 756 tablet_service.cc:1558] Processing DeleteTablet for tablet df5224716de249e9be9d7239407579a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.888568 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:17.888887 1171 tablet_bootstrap.cc:492] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:17.889034 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa with delete_type TABLET_DATA_DELETED (replaced by tablet 52af94bd46c941b8a27136ca0506e744) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.889042 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e5544753b3144c1989f2ed99bffc2246 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:17.889442 453 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:17.889546 760 tablet_service.cc:1558] Processing DeleteTablet for tablet ed9a99cdcbb74a3fb74654a26716a1c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 57c83de284064dd4a14fcea5ce6b08ad) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.889664 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 7934f5fa0287427cb45fe568f0de8758 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a35e3b7bb74667aa498c58a856cacc) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.889787 752 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.889918 744 tablet_service.cc:1558] Processing DeleteTablet for tablet f15dcc10552d4747bad436538662bb66 with delete_type TABLET_DATA_DELETED (replaced by tablet 262732996d6d47749830529ac025f42f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.890623 1171 tablet_bootstrap.cc:654] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.890596 753 tablet_service.cc:1558] Processing DeleteTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.890760 741 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.890980 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e8e9692227147d6a8c6854133941b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.891459 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.891579 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3d05dcda274f288aebc279aba3e10a with delete_type TABLET_DATA_DELETED (replaced by tablet bc57a1e3bc8b434da43f484705476b9b) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.894044 1172 raft_consensus.cc:385] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.894198 1172 raft_consensus.cc:740] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.894479 1172 consensus_queue.cc:260] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.888063 1170 ts_tablet_manager.cc:1916] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:17.896644 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 313) took 1957 ms. Trace:
I20260617 07:53:17.897142 1862 rpcz_store.cc:276] 0617 07:53:15.938910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.938955 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:17.878515 (+1939560us) ts_tablet_manager.cc:1151] Deleting tablet ed9a99cdcbb74a3fb74654a26716a1c9
0617 07:53:17.887576 (+ 9061us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.896618 (+ 9042us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1939429}
W20260617 07:53:17.898367 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ed9a99cdcbb74a3fb74654a26716a1c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed9a99cdcbb74a3fb74654a26716a1c9 already in progress: creating tablet
I20260617 07:53:17.899112 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 314) took 1931 ms. Trace:
I20260617 07:53:17.899813 1178 tablet_bootstrap.cc:492] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:17.899394 1862 rpcz_store.cc:276] 0617 07:53:15.967403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.977834 (+ 10431us) service_pool.cc:224] Handling call
0617 07:53:17.898600 (+1920766us) ts_tablet_manager.cc:1151] Deleting tablet dac3dc9d7da447cb8fdca84fdac0dc39
0617 07:53:17.898611 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.899000 (+ 389us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1920267}
I20260617 07:53:17.902341 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 315) took 1921 ms. Trace:
I20260617 07:53:17.902925 1172 ts_tablet_manager.cc:1434] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260617 07:53:17.903266 1172 tablet_bootstrap.cc:492] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:17.903507 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet dac3dc9d7da447cb8fdca84fdac0dc39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dac3dc9d7da447cb8fdca84fdac0dc39 already in progress: creating tablet
I20260617 07:53:17.902954 1862 rpcz_store.cc:276] 0617 07:53:15.980979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.981632 (+ 653us) service_pool.cc:224] Handling call
0617 07:53:17.901931 (+1920299us) ts_tablet_manager.cc:1151] Deleting tablet ab8388648475499db50cc16a7c36775a
0617 07:53:17.901941 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.902324 (+ 383us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1919924}
W20260617 07:53:17.904104 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ab8388648475499db50cc16a7c36775a because the tablet was not found. No further retry: Not found: Tablet not found: ab8388648475499db50cc16a7c36775a
I20260617 07:53:17.904762 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 317) took 1923 ms. Trace:
I20260617 07:53:17.905417 1172 tablet_bootstrap.cc:654] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.905187 1862 rpcz_store.cc:276] 0617 07:53:15.981208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.981773 (+ 565us) service_pool.cc:224] Handling call
0617 07:53:17.904171 (+1922398us) ts_tablet_manager.cc:1151] Deleting tablet df705c2300064db680bec1fefab08d2f
0617 07:53:17.904182 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.904582 (+ 400us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1921935}
W20260617 07:53:17.906567 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet df705c2300064db680bec1fefab08d2f because the tablet was not found. No further retry: Not found: Tablet not found: df705c2300064db680bec1fefab08d2f
I20260617 07:53:17.907130 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 318) took 1916 ms. Trace:
I20260617 07:53:17.907614 1862 rpcz_store.cc:276] 0617 07:53:15.990905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.999153 (+ 8248us) service_pool.cc:224] Handling call
0617 07:53:17.906732 (+1907579us) ts_tablet_manager.cc:1151] Deleting tablet eba5976fcadd4add9c671300b431617b
0617 07:53:17.906840 (+ 108us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.907111 (+ 271us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1907387}
I20260617 07:53:17.908921 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 69996eb4ab6e40f9b2d97e00d766822a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.909111 748 tablet_service.cc:1558] Processing DeleteTablet for tablet d21f61a35ca544568bcfca1a6230deca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.909332 741 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.909519 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.909680 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 336) took 1056 ms. Trace:
I20260617 07:53:17.910197 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c21efcad98348ebabcee4821dc4682e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.910004 1862 rpcz_store.cc:276] 0617 07:53:16.853114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.853166 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:17.908764 (+1055598us) ts_tablet_manager.cc:1151] Deleting tablet bc57a1e3bc8b434da43f484705476b9b
0617 07:53:17.908802 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.909666 (+ 864us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1055314}
I20260617 07:53:17.911365 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.911602 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.911962 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 337) took 1058 ms. Trace:
W20260617 07:53:17.912184 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet eba5976fcadd4add9c671300b431617b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eba5976fcadd4add9c671300b431617b already in progress: creating tablet
W20260617 07:53:17.912454 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet bc57a1e3bc8b434da43f484705476b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc57a1e3bc8b434da43f484705476b9b already in progress: creating tablet
I20260617 07:53:17.912675 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.912415 1862 rpcz_store.cc:276] 0617 07:53:16.853237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.854171 (+ 934us) service_pool.cc:224] Handling call
0617 07:53:17.910984 (+1056813us) ts_tablet_manager.cc:1151] Deleting tablet beb8fbb44e6147be8c9605be886a8aea
0617 07:53:17.910994 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.911851 (+ 857us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1056608}
W20260617 07:53:17.913671 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet beb8fbb44e6147be8c9605be886a8aea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet beb8fbb44e6147be8c9605be886a8aea already in progress: creating tablet
I20260617 07:53:17.914179 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.914428 750 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0e12aa4c60457182201a94caecda45 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b6f85399f924f619dd09465bb74f689) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.914681 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:17.915122 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3fcf87953dc14bf190ac74101547e52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcf87953dc14bf190ac74101547e52f already in progress: creating tablet
W20260617 07:53:17.915584 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d03d6dc473fc4be1a436fd71a06f403e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d03d6dc473fc4be1a436fd71a06f403e already in progress: creating tablet
W20260617 07:53:17.915987 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5203534569bd4da18bc06751f094735f because the tablet was not found. No further retry: Not found: Tablet not found: 5203534569bd4da18bc06751f094735f
W20260617 07:53:17.916416 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df705c2300064db680bec1fefab08d2f because the tablet was not found. No further retry: Not found: Tablet not found: df705c2300064db680bec1fefab08d2f
W20260617 07:53:17.919454 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 52af94bd46c941b8a27136ca0506e744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52af94bd46c941b8a27136ca0506e744 already in progress: creating tablet
W20260617 07:53:17.919879 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet b7c5ff28367b42d3a3922d2b789bc7ec because the tablet was not found. No further retry: Not found: Tablet not found: b7c5ff28367b42d3a3922d2b789bc7ec
W20260617 07:53:17.920362 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
W20260617 07:53:17.920876 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 84f498f551ff4767bd16628b03f55ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84f498f551ff4767bd16628b03f55ae2 already in progress: creating tablet
W20260617 07:53:17.921340 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2684f3200e604bb6bf37a2f97a193eff because the tablet was not found. No further retry: Not found: Tablet not found: 2684f3200e604bb6bf37a2f97a193eff
W20260617 07:53:17.921934 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0f9db8a986b344548e435b77edc14cb6 because the tablet was not found. No further retry: Not found: Tablet not found: 0f9db8a986b344548e435b77edc14cb6
W20260617 07:53:17.922921 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 18f9bace06e34602acc7fcd7501b3671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18f9bace06e34602acc7fcd7501b3671 already in progress: creating tablet
W20260617 07:53:17.923617 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 301bd4d6faec429ba71ce354c23d0f75 because the tablet was not found. No further retry: Not found: Tablet not found: 301bd4d6faec429ba71ce354c23d0f75
W20260617 07:53:17.924180 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet eb75a965740344c2bd0b68a8dda28be5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb75a965740344c2bd0b68a8dda28be5 already in progress: creating tablet
W20260617 07:53:17.924777 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 53108a2d6c8b4398a568c14df8e0a23e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53108a2d6c8b4398a568c14df8e0a23e already in progress: creating tablet
W20260617 07:53:17.925588 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
W20260617 07:53:17.926116 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8db4fdde370e4d30bbf14285923644a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8db4fdde370e4d30bbf14285923644a1 already in progress: creating tablet
W20260617 07:53:17.926548 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 because the tablet was not found. No further retry: Not found: Tablet not found: f2ce51c155c04897a4cf8f7b4ac9a5c6
W20260617 07:53:17.926955 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 596ef68705c84791b54f07e03b219b4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596ef68705c84791b54f07e03b219b4c already in progress: creating tablet
W20260617 07:53:17.927418 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4de8df5e15cb43c0b95ec5af3110db66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4de8df5e15cb43c0b95ec5af3110db66 already in progress: creating tablet
W20260617 07:53:17.928125 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4d9ace137c4e496fafac4e729718577f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9ace137c4e496fafac4e729718577f already in progress: creating tablet
W20260617 07:53:17.928743 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70610822c57e45c7add7e1f5ce96d889 already in progress: creating tablet
W20260617 07:53:17.929489 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 1f6264adc3994c22864ea73106ba2320 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6264adc3994c22864ea73106ba2320 already in progress: creating tablet
I20260617 07:53:17.916131 2386 raft_consensus.cc:493] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.929836 2386 raft_consensus.cc:515] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.930430 2386 leader_election.cc:290] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:17.930321 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 99ec78c123d448329b8442a0de0140d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99ec78c123d448329b8442a0de0140d3 already in progress: creating tablet
I20260617 07:53:17.930994 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba5976fcadd4add9c671300b431617b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:17.931160 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3aa1c1fdede041d28570b85e63c401b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3aa1c1fdede041d28570b85e63c401b7 already in progress: creating tablet
W20260617 07:53:17.931838 988 leader_election.cc:343] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:17.931948 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a02dbb70eec84932917ef282fdae0bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a02dbb70eec84932917ef282fdae0bd7 already in progress: creating tablet
W20260617 07:53:17.932817 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 77c3bf1860c34ee3821bf273234cb0a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77c3bf1860c34ee3821bf273234cb0a4 already in progress: creating tablet
W20260617 07:53:17.933480 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d657fbccb4af40558033a971aab7f3e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d657fbccb4af40558033a971aab7f3e4 already in progress: creating tablet
I20260617 07:53:17.934474 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba5976fcadd4add9c671300b431617b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.934916 1171 tablet_bootstrap.cc:492] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:17.935019 986 leader_election.cc:343] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:17.935065 1171 ts_tablet_manager.cc:1403] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.046s user 0.010s sys 0.000s
I20260617 07:53:17.935118 986 leader_election.cc:304] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:17.935247 744 tablet_service.cc:1558] Processing DeleteTablet for tablet bc57a1e3bc8b434da43f484705476b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.935461 2386 raft_consensus.cc:2749] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:17.935477 744 tablet_service.cc:1558] Processing DeleteTablet for tablet eba5976fcadd4add9c671300b431617b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.935642 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa23bb0929440b1820afdce4b9e8d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.935808 744 tablet_service.cc:1558] Processing DeleteTablet for tablet dac3dc9d7da447cb8fdca84fdac0dc39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.935803 1171 raft_consensus.cc:359] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.935981 1171 raft_consensus.cc:385] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.935984 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cddb9e82c354f26b3abe56ebdefd008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.936046 1171 raft_consensus.cc:740] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.936241 1171 consensus_queue.cc:260] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.936719 1171 ts_tablet_manager.cc:1434] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:17.936923 1898 raft_consensus.cc:493] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.936949 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.936993 1171 tablet_bootstrap.cc:492] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:17.937036 1898 raft_consensus.cc:515] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.937321 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f8602b87a20455884c16196a901d335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.937484 756 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.937598 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c76bfcbd22e4bfb97346a1b56f68dab with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5bd47736774ba9a05426b46a057e80) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.937731 760 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.937844 754 tablet_service.cc:1558] Processing DeleteTablet for tablet d80c2ffcf1b84df0bc6a468ea0929e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.937952 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 89783bab2e584fe9a8eda963f78bf3ec with delete_type TABLET_DATA_DELETED (replaced by tablet 233cae2480ed457bbab22ead8c0bde2c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.937922 2087 raft_consensus.cc:493] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.938061 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f51c76d93674a91b5ada7821393020a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.938058 2087 raft_consensus.cc:515] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.938166 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.938272 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.938381 748 tablet_service.cc:1558] Processing DeleteTablet for tablet e897b111e65c497591c7daaa81d783c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.938474 1178 ts_tablet_manager.cc:1403] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.000s
I20260617 07:53:17.938530 2087 leader_election.cc:290] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.938637 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e1fd7f91f94221884be2166f0cc793 with delete_type TABLET_DATA_DELETED (replaced by tablet 2735f7dd40e54aec9004b9b38702607c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.938817 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.938942 745 tablet_service.cc:1558] Processing DeleteTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.939054 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c7343400555f447b8a1721ba36d7766d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.939170 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dc0676db18c42259efb1ad7dbd140c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:02 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.939297 742 tablet_service.cc:1558] Processing DeleteTablet for tablet beb8fbb44e6147be8c9605be886a8aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.939409 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.939512 749 tablet_service.cc:1558] Processing DeleteTablet for tablet f030d59f4e124f64bb62d05f0bb0f560 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:03 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:17.940255 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956eefc9ac3147bb857a448563c6fb6f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:17.940420 1052 raft_consensus.cc:2468] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:17.941262 1171 tablet_bootstrap.cc:654] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.941372 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95865af94c04410386d23cb369180611" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:17.939172 1178 raft_consensus.cc:359] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.941948 1178 raft_consensus.cc:385] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.942020 1178 raft_consensus.cc:740] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.942133 851 leader_election.cc:304] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:17.942241 1178 consensus_queue.cc:260] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.942349 2087 raft_consensus.cc:2804] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:17.942415 2087 raft_consensus.cc:493] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260617 07:53:17.942407 851 leader_election.cc:343] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:17.942502 2087 raft_consensus.cc:3060] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.942689 1178 ts_tablet_manager.cc:1434] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 07:53:17.943029 1178 tablet_bootstrap.cc:492] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:17.944870 2087 raft_consensus.cc:515] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.945430 2087 leader_election.cc:290] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:17.945891 2125 raft_consensus.cc:493] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:17.945972 1178 tablet_bootstrap.cc:654] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:17.946018 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956eefc9ac3147bb857a448563c6fb6f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:17.946038 2125 raft_consensus.cc:515] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:17.946224 1050 raft_consensus.cc:3060] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:17.946704 2125 leader_election.cc:290] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:17.948706 1050 raft_consensus.cc:2468] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:17.949012 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:17.949812 851 leader_election.cc:304] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:17.950129 2087 raft_consensus.cc:2804] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:17.950237 2087 raft_consensus.cc:697] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:17.950462 2087 consensus_queue.cc:237] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.937664 1898 leader_election.cc:290] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:17.957867 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 706373f1f5d44edf81ed04183a8bdf89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 706373f1f5d44edf81ed04183a8bdf89 already in progress: creating tablet
I20260617 07:53:17.960289 2373 tablet.cc:1724] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:17.960960 2374 tablet.cc:1724] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:17.965993 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956eefc9ac3147bb857a448563c6fb6f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.966544 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95865af94c04410386d23cb369180611" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:17.967011 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956eefc9ac3147bb857a448563c6fb6f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:17.968274 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e9488e8a501e404f85540fb045d8916f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9488e8a501e404f85540fb045d8916f already in progress: creating tablet
W20260617 07:53:17.968674 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
W20260617 07:53:17.969014 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66140c5d364f453a8089f143cc96ede8 already in progress: creating tablet
W20260617 07:53:17.969376 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 already in progress: creating tablet
W20260617 07:53:17.969746 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e55d63a25a2845dbbcce20e560361007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55d63a25a2845dbbcce20e560361007 already in progress: creating tablet
W20260617 07:53:17.970118 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 737e9344fc824714a2c2596170637158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 737e9344fc824714a2c2596170637158 already in progress: creating tablet
W20260617 07:53:17.970500 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5364dfe28b8d4042941c8d8d4d1cf503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5364dfe28b8d4042941c8d8d4d1cf503 already in progress: creating tablet
W20260617 07:53:17.970865 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5942eea42c7541349ad7b6560e6777c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5942eea42c7541349ad7b6560e6777c8 already in progress: creating tablet
I20260617 07:53:17.971246 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 342) took 1028 ms. Trace:
I20260617 07:53:17.971417 1862 rpcz_store.cc:276] 0617 07:53:16.942627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.942683 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:17.913749 (+971066us) ts_tablet_manager.cc:1151] Deleting tablet 63bf519b83c445798bddda3120b542ce
0617 07:53:17.971103 (+ 57354us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.971216 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":965025}
I20260617 07:53:17.971969 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 344) took 1028 ms. Trace:
W20260617 07:53:17.972157 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 63bf519b83c445798bddda3120b542ce because the tablet was not found. No further retry: Not found: Tablet not found: 63bf519b83c445798bddda3120b542ce
I20260617 07:53:17.972146 1862 rpcz_store.cc:276] 0617 07:53:16.943052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.943100 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:17.971898 (+1028798us) ts_tablet_manager.cc:1151] Deleting tablet 92e55be5f28740fba65c1199a571d97a
0617 07:53:17.971906 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.971952 (+ 46us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1023182}
I20260617 07:53:17.972857 1171 tablet_bootstrap.cc:492] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:17.972963 1171 ts_tablet_manager.cc:1403] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.011s
I20260617 07:53:17.973635 1171 raft_consensus.cc:359] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.973816 1171 raft_consensus.cc:385] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:17.973877 1171 raft_consensus.cc:740] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:17.974104 1171 consensus_queue.cc:260] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:17.974625 1171 ts_tablet_manager.cc:1434] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260617 07:53:17.975116 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because the tablet was not found. No further retry: Not found: Tablet not found: 92e55be5f28740fba65c1199a571d97a
I20260617 07:53:17.977253 1178 tablet_bootstrap.cc:492] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:17.977465 1178 ts_tablet_manager.cc:1403] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.003s
I20260617 07:53:17.978605 1171 tablet_bootstrap.cc:492] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:17.978799 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ce7cb453c7b647f298a6ebe20fd0e45b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce7cb453c7b647f298a6ebe20fd0e45b already in progress: creating tablet
I20260617 07:53:17.980043 1171 tablet_bootstrap.cc:654] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:17.980768 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cc84665c7849469aa27e6505dbed1516 because the tablet was not found. No further retry: Not found: Tablet not found: cc84665c7849469aa27e6505dbed1516
W20260617 07:53:17.985419 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df5224716de249e9be9d7239407579a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df5224716de249e9be9d7239407579a9 already in progress: creating tablet
W20260617 07:53:17.985836 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 71e8f7118aaf4c6a9b9caab5abc030fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71e8f7118aaf4c6a9b9caab5abc030fa already in progress: creating tablet
W20260617 07:53:17.986235 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ed9a99cdcbb74a3fb74654a26716a1c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed9a99cdcbb74a3fb74654a26716a1c9 already in progress: creating tablet
W20260617 07:53:17.986624 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7934f5fa0287427cb45fe568f0de8758 because the tablet was not found. No further retry: Not found: Tablet not found: 7934f5fa0287427cb45fe568f0de8758
I20260617 07:53:17.986902 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 343) took 1044 ms. Trace:
I20260617 07:53:17.986991 1862 rpcz_store.cc:276] 0617 07:53:16.942775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.944323 (+ 1548us) service_pool.cc:224] Handling call
0617 07:53:17.972648 (+1028325us) ts_tablet_manager.cc:1151] Deleting tablet 53108a2d6c8b4398a568c14df8e0a23e
0617 07:53:17.978113 (+ 5465us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.986881 (+ 8768us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1023875}
W20260617 07:53:17.987049 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a38bb8a140ef4bcab65aaa03bdb79040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a38bb8a140ef4bcab65aaa03bdb79040 already in progress: creating tablet
W20260617 07:53:17.987532 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f15dcc10552d4747bad436538662bb66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f15dcc10552d4747bad436538662bb66 already in progress: creating tablet
W20260617 07:53:17.987996 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 53108a2d6c8b4398a568c14df8e0a23e because the tablet was not found. No further retry: Not found: Tablet not found: 53108a2d6c8b4398a568c14df8e0a23e
W20260617 07:53:17.987946 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d965aa4e8dc244cdb93dd15cdee9070c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d965aa4e8dc244cdb93dd15cdee9070c already in progress: creating tablet
W20260617 07:53:17.988605 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet de030009192748118b388eec555d90da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de030009192748118b388eec555d90da already in progress: creating tablet
I20260617 07:53:17.988670 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 347) took 1003 ms. Trace:
I20260617 07:53:17.988737 1862 rpcz_store.cc:276] 0617 07:53:16.985034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.985102 (+ 68us) service_pool.cc:224] Handling call
0617 07:53:17.988485 (+1003383us) ts_tablet_manager.cc:1151] Deleting tablet 369442b72f754ee08dc6a484d51f2e99
0617 07:53:17.988495 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.988653 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1003154}
W20260617 07:53:17.989092 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 369442b72f754ee08dc6a484d51f2e99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 369442b72f754ee08dc6a484d51f2e99 already in progress: creating tablet
W20260617 07:53:17.989418 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4e8e9692227147d6a8c6854133941b44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e8e9692227147d6a8c6854133941b44 already in progress: creating tablet
W20260617 07:53:17.989828 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7f7611958cf143438497c93f5f2bc098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7611958cf143438497c93f5f2bc098 already in progress: creating tablet
W20260617 07:53:17.990198 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3e3d05dcda274f288aebc279aba3e10a because the tablet was not found. No further retry: Not found: Tablet not found: 3e3d05dcda274f288aebc279aba3e10a
I20260617 07:53:17.993363 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:17.991636 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:17.995277 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 348) took 1007 ms. Trace:
I20260617 07:53:17.995361 1862 rpcz_store.cc:276] 0617 07:53:16.987411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.987641 (+ 230us) service_pool.cc:224] Handling call
0617 07:53:17.995174 (+1007533us) ts_tablet_manager.cc:1151] Deleting tablet 739cadc7ad124e229441333de949f2c6
0617 07:53:17.995183 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.995261 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1007333}
I20260617 07:53:17.995654 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 349) took 1008 ms. Trace:
I20260617 07:53:17.995709 1862 rpcz_store.cc:276] 0617 07:53:16.987584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.987984 (+ 400us) service_pool.cc:224] Handling call
0617 07:53:17.995573 (+1007589us) ts_tablet_manager.cc:1151] Deleting tablet e03a26e301e747febc4d5bafdc1a49c6
0617 07:53:17.995581 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.995643 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1007404}
W20260617 07:53:17.995869 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 739cadc7ad124e229441333de949f2c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 739cadc7ad124e229441333de949f2c6 already in progress: creating tablet
I20260617 07:53:17.996081 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 341) took 1053 ms. Trace:
I20260617 07:53:17.996143 1862 rpcz_store.cc:276] 0617 07:53:16.942489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.021260 (+ 78771us) service_pool.cc:224] Handling call
0617 07:53:17.996029 (+974769us) ts_tablet_manager.cc:1151] Deleting tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
0617 07:53:17.996035 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.996069 (+ 34us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":974597}
W20260617 07:53:17.996297 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e03a26e301e747febc4d5bafdc1a49c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03a26e301e747febc4d5bafdc1a49c6 already in progress: creating tablet
I20260617 07:53:17.996369 1862 tablet_replica.cc:333] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:17.996542 1862 raft_consensus.cc:2243] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:17.996546 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35120ce002f24f2bb1ea0fdc59fbfc9d already in progress: creating tablet
I20260617 07:53:17.996668 1862 raft_consensus.cc:2272] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:17.997155 1862 ts_tablet_manager.cc:1916] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:17.997218 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 because the tablet was not found. No further retry: Not found: Tablet not found: 3bee4c9cd9f2415ca54b8e85dbd326a7
I20260617 07:53:17.999374 1172 tablet_bootstrap.cc:492] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:17.999534 1172 ts_tablet_manager.cc:1403] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.096s user 0.002s sys 0.003s
I20260617 07:53:17.999738 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:18.000690 1171 tablet_bootstrap.cc:492] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.000838 1171 ts_tablet_manager.cc:1403] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.006s
W20260617 07:53:18.001605 852 leader_election.cc:343] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.001636 1171 raft_consensus.cc:359] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.001842 1171 raft_consensus.cc:385] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.001914 1171 raft_consensus.cc:740] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:18.002342 852 leader_election.cc:343] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.002458 852 leader_election.cc:304] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.002517 1171 consensus_queue.cc:260] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.002810 2201 raft_consensus.cc:2749] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.003000 1171 ts_tablet_manager.cc:1434] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260617 07:53:18.003158 852 leader_election.cc:343] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.003263 1171 tablet_bootstrap.cc:492] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.003932 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet b62ae096bfd347029ef8d7f0462dd111 (table default.Table_832c0052f588434faa10b821b4d09514 [id=4336b6e42a2b4c2d86fc98c56990bc8e]). Expected version 1 got 0
I20260617 07:53:18.004791 1171 tablet_bootstrap.cc:654] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.004983 2125 raft_consensus.cc:493] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.004664 713 leader_election.cc:304] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.005111 2125 raft_consensus.cc:515] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.005685 2125 leader_election.cc:290] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:18.005826 2125 raft_consensus.cc:2749] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.006829 1170 ts_tablet_manager.cc:1929] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:18.006974 1172 raft_consensus.cc:359] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.007165 1172 raft_consensus.cc:385] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.006976 1170 log.cc:1199] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/95865af94c04410386d23cb369180611
I20260617 07:53:18.007557 1170 ts_tablet_manager.cc:1950] T 95865af94c04410386d23cb369180611 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:18.007223 1172 raft_consensus.cc:740] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.008013 1172 consensus_queue.cc:260] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:18.010142 716 leader_election.cc:343] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 57e05a97a4ab4ed7bff523d1fb1c59ae
W20260617 07:53:18.006078 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 69996eb4ab6e40f9b2d97e00d766822a because the tablet was not found. No further retry: Not found: Tablet not found: 69996eb4ab6e40f9b2d97e00d766822a
I20260617 07:53:18.011245 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:18.013092 1172 ts_tablet_manager.cc:1434] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20260617 07:53:18.013597 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d21f61a35ca544568bcfca1a6230deca because the tablet was not found. No further retry: Not found: Tablet not found: d21f61a35ca544568bcfca1a6230deca
I20260617 07:53:18.013546 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
W20260617 07:53:18.015224 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bbc3d13d519843a9bc38e97dc85b67c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbc3d13d519843a9bc38e97dc85b67c8 already in progress: creating tablet
I20260617 07:53:18.014978 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_849fe4b41f7c48b8a8619a4f5f78e368 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 1 got 0
W20260617 07:53:18.016435 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
I20260617 07:53:18.016768 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:18.018864 1172 tablet_bootstrap.cc:492] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:18.018189 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0c21efcad98348ebabcee4821dc4682e because the tablet was not found. No further retry: Not found: Tablet not found: 0c21efcad98348ebabcee4821dc4682e
I20260617 07:53:18.020602 1172 tablet_bootstrap.cc:654] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:18.020368 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
I20260617 07:53:18.020762 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
W20260617 07:53:18.022109 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 already in progress: creating tablet
W20260617 07:53:18.023619 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 already in progress: creating tablet
I20260617 07:53:18.024003 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
W20260617 07:53:18.025779 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5dcfb101cf51487692ef9a6a17f40804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dcfb101cf51487692ef9a6a17f40804 already in progress: creating tablet
I20260617 07:53:18.027931 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:18.028452 1171 tablet_bootstrap.cc:492] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.028589 1171 ts_tablet_manager.cc:1403] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.009s
W20260617 07:53:18.028381 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ee0e12aa4c60457182201a94caecda45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee0e12aa4c60457182201a94caecda45 already in progress: creating tablet
I20260617 07:53:18.029388 1171 raft_consensus.cc:359] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.029562 1171 raft_consensus.cc:385] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.029619 1171 raft_consensus.cc:740] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.029858 1171 consensus_queue.cc:260] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.030422 1171 ts_tablet_manager.cc:1434] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260617 07:53:18.030131 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae9261c0ac94defaecfc7d14ba1ae61 already in progress: creating tablet
I20260617 07:53:18.030709 1171 tablet_bootstrap.cc:492] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.029994 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
W20260617 07:53:18.031606 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bc57a1e3bc8b434da43f484705476b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc57a1e3bc8b434da43f484705476b9b already in progress: creating tablet
I20260617 07:53:18.032490 1171 tablet_bootstrap.cc:654] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.032948 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
W20260617 07:53:18.033290 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet eba5976fcadd4add9c671300b431617b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eba5976fcadd4add9c671300b431617b already in progress: creating tablet
W20260617 07:53:18.034631 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8fa23bb0929440b1820afdce4b9e8d8c because the tablet was not found. No further retry: Not found: Tablet not found: 8fa23bb0929440b1820afdce4b9e8d8c
W20260617 07:53:18.036319 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet dac3dc9d7da447cb8fdca84fdac0dc39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dac3dc9d7da447cb8fdca84fdac0dc39 already in progress: creating tablet
I20260617 07:53:18.037964 2125 raft_consensus.cc:493] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.038098 2125 raft_consensus.cc:515] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:18.037834 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9cddb9e82c354f26b3abe56ebdefd008 because the tablet was not found. No further retry: Not found: Tablet not found: 9cddb9e82c354f26b3abe56ebdefd008
I20260617 07:53:18.038666 2125 leader_election.cc:290] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:18.039211 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3275c99834f404f84b96fcc7944cd00" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:18.039692 2201 raft_consensus.cc:493] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.039796 2201 raft_consensus.cc:515] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.039108 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ca400838f5214d1a8f57e72c5068f0f9 (table default.Table_1a37fbbe9740440a8c245559a94b7f5f [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]). Expected version 1 got 0
I20260617 07:53:18.040308 2201 leader_election.cc:290] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.040817 2201 raft_consensus.cc:493] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.040923 2201 raft_consensus.cc:515] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:18.040630 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e757e6f4ce4c6eb8223c4b6955245e already in progress: creating tablet
I20260617 07:53:18.041028 2087 consensus_queue.cc:1048] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:18.041396 2201 leader_election.cc:290] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.041855 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c019792d23484fb789378bf377547415" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:18.042464 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5f8602b87a20455884c16196a901d335 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f8602b87a20455884c16196a901d335 already in progress: creating tablet
I20260617 07:53:18.043107 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f90a0d37cb483faa540451bf4dbe85" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.043287 1052 raft_consensus.cc:2468] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.043526 1047 raft_consensus.cc:2468] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.043145 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 979087485af94e159d3d0f2cb873899e (table default.Table_5238d7f8a8b649df9298e622257465f5 [id=7a23152402da4e608156935807a7b61b]). Expected version 1 got 0
I20260617 07:53:18.043946 851 leader_election.cc:304] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:18.044231 851 leader_election.cc:304] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:18.044656 1898 raft_consensus.cc:2804] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.044719 1898 raft_consensus.cc:493] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.044770 1898 raft_consensus.cc:3060] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:18.045212 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 already in progress: creating tablet
I20260617 07:53:18.046756 1171 tablet_bootstrap.cc:492] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.046878 1171 ts_tablet_manager.cc:1403] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.001s
W20260617 07:53:18.046574 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8c76bfcbd22e4bfb97346a1b56f68dab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c76bfcbd22e4bfb97346a1b56f68dab already in progress: creating tablet
I20260617 07:53:18.047299 2087 raft_consensus.cc:2804] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.047369 2087 raft_consensus.cc:493] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.047433 2087 raft_consensus.cc:3060] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.047051 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:18.047660 1171 raft_consensus.cc:359] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.047816 1171 raft_consensus.cc:385] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.047873 1171 raft_consensus.cc:740] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.048118 1171 consensus_queue.cc:260] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:18.048262 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet be14a95f458d440e86133ef65c484571 because the tablet was not found. No further retry: Not found: Tablet not found: be14a95f458d440e86133ef65c484571
I20260617 07:53:18.048625 1171 ts_tablet_manager.cc:1434] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:18.048905 1171 tablet_bootstrap.cc:492] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.050655 1171 tablet_bootstrap.cc:654] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.051016 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 268) took 2490 ms. Trace:
W20260617 07:53:18.051431 713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 46887.4us
I20260617 07:53:18.051560 1170 rpcz_store.cc:276] 0617 07:53:15.560971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.562033 (+ 1062us) service_pool.cc:224] Handling call
0617 07:53:17.885669 (+2323636us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:17.885678 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:17.922760 (+ 37082us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.006764 (+ 84004us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.050991 (+ 44227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2323541}
I20260617 07:53:18.052055 2201 raft_consensus.cc:493] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.052166 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 95865af94c04410386d23cb369180611 (table default.Table_a9de59c0e19946de8df23f1869eab317 [id=9b3274df0c184a92af3bc0f10185e41e]) successfully deleted
I20260617 07:53:18.052244 2201 raft_consensus.cc:515] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.052845 2201 leader_election.cc:290] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.053442 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24066965db7141a6a970ec08f835a820" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.053614 1047 raft_consensus.cc:2468] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.054049 851 leader_election.cc:304] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:18.054333 2201 raft_consensus.cc:2804] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.054409 2201 raft_consensus.cc:493] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.054461 2201 raft_consensus.cc:3060] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.054507 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c019792d23484fb789378bf377547415" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.055197 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f90a0d37cb483faa540451bf4dbe85" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.056274 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24066965db7141a6a970ec08f835a820" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.057263 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 261) took 2496 ms. Trace:
I20260617 07:53:18.057898 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3275c99834f404f84b96fcc7944cd00" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.057420 1170 rpcz_store.cc:276] 0617 07:53:15.560378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.562145 (+ 1767us) service_pool.cc:224] Handling call
0617 07:53:18.051856 (+2489711us) ts_tablet_manager.cc:1151] Deleting tablet 3ae9261c0ac94defaecfc7d14ba1ae61
0617 07:53:18.051865 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.057240 (+ 5375us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2489619}
W20260617 07:53:18.059512 852 consensus_peers.cc:597] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:18.059720 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 because the tablet was not found. No further retry: Not found: Tablet not found: 3ae9261c0ac94defaecfc7d14ba1ae61
W20260617 07:53:18.059902 852 leader_election.cc:343] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.060253 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 256) took 2500 ms. Trace:
W20260617 07:53:18.060724 852 leader_election.cc:343] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:18.061563 852 leader_election.cc:343] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.062209 1170 rpcz_store.cc:276] 0617 07:53:15.559981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.563949 (+ 3968us) service_pool.cc:224] Handling call
0617 07:53:18.060116 (+2496167us) ts_tablet_manager.cc:1151] Deleting tablet 488cc3a082b14dee8f70153e6f2925a4
0617 07:53:18.060128 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.060233 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2495857}
W20260617 07:53:18.062249 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d80c2ffcf1b84df0bc6a468ea0929e80 because the tablet was not found. No further retry: Not found: Tablet not found: d80c2ffcf1b84df0bc6a468ea0929e80
I20260617 07:53:18.062079 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
W20260617 07:53:18.063040 713 leader_election.cc:343] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 57e05a97a4ab4ed7bff523d1fb1c59ae
W20260617 07:53:18.063820 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 89783bab2e584fe9a8eda963f78bf3ec because the tablet was not found. No further retry: Not found: Tablet not found: 89783bab2e584fe9a8eda963f78bf3ec
I20260617 07:53:18.063709 713 leader_election.cc:304] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:18.065263 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3f51c76d93674a91b5ada7821393020a because the tablet was not found. No further retry: Not found: Tablet not found: 3f51c76d93674a91b5ada7821393020a
W20260617 07:53:18.066066 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 488cc3a082b14dee8f70153e6f2925a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 488cc3a082b14dee8f70153e6f2925a4 already in progress: creating tablet
I20260617 07:53:18.066515 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 257) took 2506 ms. Trace:
I20260617 07:53:18.066653 1170 rpcz_store.cc:276] 0617 07:53:15.560057 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.564298 (+ 4241us) service_pool.cc:224] Handling call
0617 07:53:18.066371 (+2502073us) ts_tablet_manager.cc:1151] Deleting tablet 4e8e9692227147d6a8c6854133941b44
0617 07:53:18.066401 (+ 30us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.066496 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2501715}
W20260617 07:53:18.066982 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65bf5384ec244d36ba3d4e781c5eb8a3 already in progress: creating tablet
I20260617 07:53:18.066823 713 leader_election.cc:304] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.068248 2125 raft_consensus.cc:2749] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.068621 2430 raft_consensus.cc:2749] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:18.068765 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
W20260617 07:53:18.071967 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e897b111e65c497591c7daaa81d783c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e897b111e65c497591c7daaa81d783c7 already in progress: creating tablet
W20260617 07:53:18.073060 852 consensus_peers.cc:597] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:18.073846 826 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
W20260617 07:53:18.074314 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 28e1fd7f91f94221884be2166f0cc793 because the tablet was not found. No further retry: Not found: Tablet not found: 28e1fd7f91f94221884be2166f0cc793
W20260617 07:53:18.075482 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d9e473fd444efa6ab63cc51dbb2bd already in progress: creating tablet
I20260617 07:53:18.075538 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
W20260617 07:53:18.076503 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c58bbdbf59c7426c8adbbbe3f0aafaed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c58bbdbf59c7426c8adbbbe3f0aafaed already in progress: creating tablet
I20260617 07:53:18.077152 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a84c7a425c4e4bc0acd412f16cf2fa01 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
W20260617 07:53:18.077517 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c7343400555f447b8a1721ba36d7766d because the tablet was not found. No further retry: Not found: Tablet not found: c7343400555f447b8a1721ba36d7766d
W20260617 07:53:18.078452 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0dc0676db18c42259efb1ad7dbd140c8 because the tablet was not found. No further retry: Not found: Tablet not found: 0dc0676db18c42259efb1ad7dbd140c8
W20260617 07:53:18.079879 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet beb8fbb44e6147be8c9605be886a8aea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet beb8fbb44e6147be8c9605be886a8aea already in progress: creating tablet
I20260617 07:53:18.080443 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9ed59705e05148f991844d47882dc151 (table default.Table_02ab5db216a449ff8e508fcc459791ae [id=13962b79508f4053b5cb01cd5e6b8b27]). Expected version 1 got 0
W20260617 07:53:18.080798 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 36ce60b466f7420992ef194d72b5718d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ce60b466f7420992ef194d72b5718d already in progress: creating tablet
I20260617 07:53:18.081202 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
W20260617 07:53:18.081697 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f030d59f4e124f64bb62d05f0bb0f560 because the tablet was not found. No further retry: Not found: Tablet not found: f030d59f4e124f64bb62d05f0bb0f560
I20260617 07:53:18.082842 1171 tablet_bootstrap.cc:492] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.083007 1171 ts_tablet_manager.cc:1403] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.006s
I20260617 07:53:18.083158 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9687dbd2616749f4bef7d9444bd89ddf (table default.Table_c1a736945bdc4725b14eb4db56fa777d [id=cff5df610d05436da1e53a7d7383b35a]). Expected version 1 got 0
I20260617 07:53:18.083752 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]). Expected version 1 got 0
I20260617 07:53:18.083845 1171 raft_consensus.cc:359] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.084028 1171 raft_consensus.cc:385] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.084131 1171 raft_consensus.cc:740] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.084362 1171 consensus_queue.cc:260] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.084717 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 (table default.Table_1557e8110d1340518c2f713297b804f6 [id=d079dbab725b43c0807868020b551ccb]). Expected version 1 got 0
I20260617 07:53:18.085337 1171 ts_tablet_manager.cc:1434] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:18.085480 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (table default.Table_78c4ad680e8849b18da7d278b7ecaf51 [id=494c90461b61486ab6dad26bbd3acab5]). Expected version 1 got 0
I20260617 07:53:18.085638 1171 tablet_bootstrap.cc:492] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.086683 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a4a35e3b7bb74667aa498c58a856cacc (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 2 got 0
I20260617 07:53:18.087426 1171 tablet_bootstrap.cc:654] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.069459 1172 tablet_bootstrap.cc:492] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
W20260617 07:53:18.087808 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4e8e9692227147d6a8c6854133941b44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e8e9692227147d6a8c6854133941b44 already in progress: creating tablet
I20260617 07:53:18.087942 1172 ts_tablet_manager.cc:1403] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.000s
I20260617 07:53:18.087886 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 531ccdf479814053b468a7d5802f5dde (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:18.088174 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 275) took 2504 ms. Trace:
I20260617 07:53:18.088220 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cdb1b67f4cb7463b98a63ec75d38890f (table default.Table_254698a40b82484f8ed8c47e68fb0b68 [id=a7b56d13c4944469995d657261551a5a]). Expected version 1 got 0
I20260617 07:53:18.088251 1170 rpcz_store.cc:276] 0617 07:53:15.583960 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.584030 (+ 70us) service_pool.cc:224] Handling call
0617 07:53:18.088060 (+2504030us) ts_tablet_manager.cc:1151] Deleting tablet 74ab8e93e3fe475ba9c7b5fce390a8ab
0617 07:53:18.088076 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.088155 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2503728}
W20260617 07:53:18.088726 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab because the tablet was not found. No further retry: Not found: Tablet not found: 74ab8e93e3fe475ba9c7b5fce390a8ab
I20260617 07:53:18.088728 1172 raft_consensus.cc:359] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.088874 1172 raft_consensus.cc:385] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.088923 1172 raft_consensus.cc:740] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.089041 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 255) took 2529 ms. Trace:
I20260617 07:53:18.089040 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a7c7083dff434fddbad7f2dcf2a6b6e6 (table default.Table_cab8bc4d921c47a2a986f4c3187d34c9 [id=23be61f7550c4f97bfa3c271e2372721]). Expected version 1 got 0
I20260617 07:53:18.089100 1172 consensus_queue.cc:260] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.089551 1172 ts_tablet_manager.cc:1434] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:18.089797 1172 tablet_bootstrap.cc:492] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.091322 1172 tablet_bootstrap.cc:654] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.091991 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_0e7fa8cb8a9b49cb8ec27a4eef4a7d39 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 1 got 0
I20260617 07:53:18.089100 1170 rpcz_store.cc:276] 0617 07:53:15.559899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.584459 (+ 24560us) service_pool.cc:224] Handling call
0617 07:53:18.088944 (+2504485us) ts_tablet_manager.cc:1151] Deleting tablet a38bb8a140ef4bcab65aaa03bdb79040
0617 07:53:18.088953 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.089028 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2504245}
W20260617 07:53:18.092635 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a38bb8a140ef4bcab65aaa03bdb79040 because the tablet was not found. No further retry: Not found: Tablet not found: a38bb8a140ef4bcab65aaa03bdb79040
I20260617 07:53:18.092979 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 274) took 2509 ms. Trace:
I20260617 07:53:18.093102 1170 rpcz_store.cc:276] 0617 07:53:15.583841 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.584890 (+ 1049us) service_pool.cc:224] Handling call
0617 07:53:18.092900 (+2508010us) ts_tablet_manager.cc:1151] Deleting tablet df37ed81b17d4178adeb6057491b4cc9
0617 07:53:18.092909 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.092964 (+ 55us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2507787}
W20260617 07:53:18.093535 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet df37ed81b17d4178adeb6057491b4cc9 because the tablet was not found. No further retry: Not found: Tablet not found: df37ed81b17d4178adeb6057491b4cc9
I20260617 07:53:18.093545 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 2 got 0
I20260617 07:53:18.094131 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:18.094228 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 280) took 2492 ms. Trace:
I20260617 07:53:18.094297 1170 rpcz_store.cc:276] 0617 07:53:15.602176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.602531 (+ 355us) service_pool.cc:224] Handling call
0617 07:53:18.094146 (+2491615us) ts_tablet_manager.cc:1151] Deleting tablet df4f9101deaa4e6ebddacbce14f32810
0617 07:53:18.094156 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.094212 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2491434}
W20260617 07:53:18.094779 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet df4f9101deaa4e6ebddacbce14f32810 because the tablet was not found. No further retry: Not found: Tablet not found: df4f9101deaa4e6ebddacbce14f32810
I20260617 07:53:18.095126 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 278) took 2493 ms. Trace:
I20260617 07:53:18.095263 1170 rpcz_store.cc:276] 0617 07:53:15.602013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.602690 (+ 677us) service_pool.cc:224] Handling call
0617 07:53:18.095026 (+2492336us) ts_tablet_manager.cc:1151] Deleting tablet 245cff69d83b43e98b1c72b8d3011347
0617 07:53:18.095038 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.095105 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2491964}
I20260617 07:53:18.095599 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
W20260617 07:53:18.095777 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 245cff69d83b43e98b1c72b8d3011347 because the tablet was not found. No further retry: Not found: Tablet not found: 245cff69d83b43e98b1c72b8d3011347
I20260617 07:53:18.096112 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 282) took 2492 ms. Trace:
I20260617 07:53:18.096133 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:18.096236 1170 rpcz_store.cc:276] 0617 07:53:15.603193 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.603239 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:18.096046 (+2492807us) ts_tablet_manager.cc:1151] Deleting tablet d03d6dc473fc4be1a436fd71a06f403e
0617 07:53:18.096054 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.096100 (+ 46us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2492650}
W20260617 07:53:18.096596 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d03d6dc473fc4be1a436fd71a06f403e because the tablet was not found. No further retry: Not found: Tablet not found: d03d6dc473fc4be1a436fd71a06f403e
I20260617 07:53:18.096868 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 279) took 2494 ms. Trace:
I20260617 07:53:18.096834 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:18.096994 1170 rpcz_store.cc:276] 0617 07:53:15.602092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.603550 (+ 1458us) service_pool.cc:224] Handling call
0617 07:53:18.096800 (+2493250us) ts_tablet_manager.cc:1151] Deleting tablet 0cfb98aecc4546c88371436fcfbf8e86
0617 07:53:18.096808 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.096854 (+ 46us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2493122}
W20260617 07:53:18.097491 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0cfb98aecc4546c88371436fcfbf8e86 because the tablet was not found. No further retry: Not found: Tablet not found: 0cfb98aecc4546c88371436fcfbf8e86
I20260617 07:53:18.097905 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 283) took 2494 ms. Trace:
I20260617 07:53:18.098037 1170 rpcz_store.cc:276] 0617 07:53:15.603507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.603715 (+ 208us) service_pool.cc:224] Handling call
0617 07:53:18.097811 (+2494096us) ts_tablet_manager.cc:1151] Deleting tablet 99ec78c123d448329b8442a0de0140d3
0617 07:53:18.097822 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.097886 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2493976}
I20260617 07:53:18.099771 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:18.102087 1862 ts_tablet_manager.cc:1929] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:18.102222 1862 log.cc:1199] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/3ae9261c0ac94defaecfc7d14ba1ae61
I20260617 07:53:18.102155 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e5544753b3144c1989f2ed99bffc2246 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:18.102555 1862 ts_tablet_manager.cc:1950] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:18.103204 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]). Expected version 1 got 0
I20260617 07:53:18.103789 2435 raft_consensus.cc:493] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.103911 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:18.104372 2435 raft_consensus.cc:515] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.104974 1898 raft_consensus.cc:515] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.105118 2435 leader_election.cc:290] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.105588 1898 leader_election.cc:290] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.106101 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f90a0d37cb483faa540451bf4dbe85" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:18.106434 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121339ab4842432e9fb7bc357750f8ad" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:18.107259 851 leader_election.cc:343] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 121339ab4842432e9fb7bc357750f8ad
W20260617 07:53:18.107800 852 leader_election.cc:343] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:18.108024 852 leader_election.cc:343] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.108150 852 leader_election.cc:304] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:18.098567 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 99ec78c123d448329b8442a0de0140d3 because the tablet was not found. No further retry: Not found: Tablet not found: 99ec78c123d448329b8442a0de0140d3
I20260617 07:53:18.108590 1898 raft_consensus.cc:2749] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.109187 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f90a0d37cb483faa540451bf4dbe85" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.109382 1050 raft_consensus.cc:3060] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.110232 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 284) took 2506 ms. Trace:
I20260617 07:53:18.110335 1170 rpcz_store.cc:276] 0617 07:53:15.603949 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.603991 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:18.110124 (+2506133us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:18.110134 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.110217 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2505996}
W20260617 07:53:18.110774 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a02dbb70eec84932917ef282fdae0bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a02dbb70eec84932917ef282fdae0bd7 already in progress: creating tablet
I20260617 07:53:18.111179 1170 tablet_replica.cc:333] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:18.113508 1171 tablet_bootstrap.cc:492] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.113683 1171 ts_tablet_manager.cc:1403] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.001s
W20260617 07:53:18.114351 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9f7a4ea634f429794b402439d19bbfe consensus state has no leader
I20260617 07:53:18.114539 461 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 246) took 1071 ms. Trace:
I20260617 07:53:18.114526 1171 raft_consensus.cc:359] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.114712 1171 raft_consensus.cc:385] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.114784 1171 raft_consensus.cc:740] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.115000 1171 consensus_queue.cc:260] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.114673 461 rpcz_store.cc:276] 0617 07:53:17.043017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.330165 (+287148us) service_pool.cc:224] Handling call
0617 07:53:17.330571 (+ 406us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:17.330796 (+ 225us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:17.331453 (+ 657us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:17.334596 (+ 3143us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:17.345096 (+ 10500us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:18.114485 (+769389us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:17.335701 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:17.335790 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:17.335796 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:17.335800 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:17.335882 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:17.335891 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:17.335896 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:17.335942 (+ 46us) tablet.cc:701] Row locks acquired
0617 07:53:17.335944 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:17.335971 (+ 27us) write_op.cc:270] Start()
0617 07:53:17.335996 (+ 25us) write_op.cc:276] Timestamp: P: 1781682797335905 usec, L: 0
0617 07:53:17.335998 (+ 2us) op_driver.cc:348] REPLICATION: starting
0617 07:53:17.336123 (+ 125us) log.cc:844] Serialized 405 byte log entry
0617 07:53:17.341897 (+ 5774us) op_driver.cc:464] REPLICATION: finished
0617 07:53:17.342451 (+ 554us) write_op.cc:301] APPLY: starting
0617 07:53:17.342462 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:17.342501 (+ 39us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:17.342525 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:17.342565 (+ 40us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:17.342593 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:17.342599 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:17.342653 (+ 54us) log.cc:844] Serialized 23 byte log entry
0617 07:53:17.342696 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.342707 (+ 11us) write_op.cc:454] Released schema lock
0617 07:53:17.342713 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:17.342777 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.342781 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":510,"apply.run_cpu_time_us":319,"apply.run_wall_time_us":318,"num_ops":1,"prepare.queue_time_us":755,"prepare.run_cpu_time_us":492,"prepare.run_wall_time_us":491,"raft.queue_time_us":408,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":5877}]]}
I20260617 07:53:18.115468 1171 ts_tablet_manager.cc:1434] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:18.115578 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_5b32814e8ada4019bbdf078311f1a5ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.115823 1171 tablet_bootstrap.cc:492] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:18.116164 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b32814e8ada4019bbdf078311f1a5ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.117549 1171 tablet_bootstrap.cc:654] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.121508 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 49f0f68dcef34228a1b2a018e8aa329e
W20260617 07:53:18.121572 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c2bae0d7dfe4512b1674796e5dacf27 consensus state has no leader
I20260617 07:53:18.125401 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.121706 458 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 251) took 1034 ms. Trace:
W20260617 07:53:18.126253 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 49f0f68dcef34228a1b2a018e8aa329e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49f0f68dcef34228a1b2a018e8aa329e already in progress: creating tablet
I20260617 07:53:18.125917 458 rpcz_store.cc:276] 0617 07:53:17.087203 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.814074 (+726871us) service_pool.cc:224] Handling call
0617 07:53:17.814436 (+ 362us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:17.814658 (+ 222us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:17.815095 (+ 437us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:17.815156 (+ 61us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:17.821481 (+ 6325us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.821486 (+ 5us) write_op.cc:454] Released schema lock
0617 07:53:17.821699 (+ 213us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:18.121670 (+299971us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:17.815713 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:17.815838 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:17.815847 (+ 9us) write_op.cc:435] Acquired schema lock
0617 07:53:17.815851 (+ 4us) tablet.cc:662] Decoding operations
0617 07:53:17.815955 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:17.815967 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:17.815972 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:17.816030 (+ 58us) tablet.cc:701] Row locks acquired
0617 07:53:17.816032 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:17.816067 (+ 35us) write_op.cc:270] Start()
0617 07:53:17.816098 (+ 31us) write_op.cc:276] Timestamp: P: 1781682797816001 usec, L: 0
0617 07:53:17.816101 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:17.816283 (+ 182us) log.cc:844] Serialized 405 byte log entry
0617 07:53:17.819662 (+ 3379us) op_driver.cc:464] REPLICATION: finished
0617 07:53:17.819778 (+ 116us) write_op.cc:301] APPLY: starting
0617 07:53:17.819793 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:17.819834 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:17.819869 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:17.819916 (+ 47us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:17.819965 (+ 49us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:17.819972 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:17.820043 (+ 71us) log.cc:844] Serialized 23 byte log entry
0617 07:53:17.820104 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.820121 (+ 17us) write_op.cc:454] Released schema lock
0617 07:53:17.820128 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":70,"apply.run_cpu_time_us":400,"apply.run_wall_time_us":400,"num_ops":1,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":669,"prepare.run_wall_time_us":669,"raft.queue_time_us":66,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":260,"replication_time_us":3532}]]}
I20260617 07:53:18.126662 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e3c486f7fa954fc68ec3f00121664da5" } modify_external_catalogs: true
I20260617 07:53:18.126856 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.126837 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e3c486f7fa954fc68ec3f00121664da5" } modify_external_catalogs: true
I20260617 07:53:18.127310 459 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 249) took 1043 ms. Trace:
I20260617 07:53:18.127417 459 rpcz_store.cc:276] 0617 07:53:17.083652 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.360222 (+276570us) service_pool.cc:224] Handling call
0617 07:53:17.381857 (+ 21635us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:17.382088 (+ 231us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:17.501665 (+119577us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:17.526181 (+ 24516us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:17.560304 (+ 34123us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:18.127277 (+566973us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:17.552872 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:17.553003 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:17.553011 (+ 8us) write_op.cc:435] Acquired schema lock
0617 07:53:17.553013 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:17.553115 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:17.553128 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:17.553132 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:17.553208 (+ 76us) tablet.cc:701] Row locks acquired
0617 07:53:17.553210 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:17.553246 (+ 36us) write_op.cc:270] Start()
0617 07:53:17.553278 (+ 32us) write_op.cc:276] Timestamp: P: 1781682797553205 usec, L: 0
0617 07:53:17.553282 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:17.553456 (+ 174us) log.cc:844] Serialized 405 byte log entry
0617 07:53:17.557037 (+ 3581us) op_driver.cc:464] REPLICATION: finished
0617 07:53:17.557178 (+ 141us) write_op.cc:301] APPLY: starting
0617 07:53:17.557191 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:17.557237 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:17.557267 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:17.557319 (+ 52us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:17.557352 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:17.557362 (+ 10us) write_op.cc:312] APPLY: finished
0617 07:53:17.557439 (+ 77us) log.cc:844] Serialized 23 byte log entry
0617 07:53:17.557506 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.557526 (+ 20us) write_op.cc:454] Released schema lock
0617 07:53:17.557532 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:17.557666 (+ 134us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.557670 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6764,"child_traces":[["op",{"apply.queue_time_us":87,"apply.run_cpu_time_us":481,"apply.run_wall_time_us":481,"num_ops":1,"prepare.queue_time_us":44,"prepare.run_cpu_time_us":682,"prepare.run_wall_time_us":684,"raft.queue_time_us":125,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":1049,"replication_time_us":3728}]]}
I20260617 07:53:18.128161 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a50277d75b6b4544961f33c42a936cd2" } modify_external_catalogs: true
I20260617 07:53:18.128322 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a50277d75b6b4544961f33c42a936cd2" } modify_external_catalogs: true
I20260617 07:53:18.122108 460 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 245) took 1083 ms. Trace:
I20260617 07:53:18.128693 460 rpcz_store.cc:276] 0617 07:53:17.038920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.104324 (+ 65404us) service_pool.cc:224] Handling call
0617 07:53:17.104798 (+ 474us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:17.104938 (+ 140us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:17.104993 (+ 55us) catalog_manager.cc:2849] Locking tablets
0617 07:53:17.336770 (+231777us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:17.414271 (+ 77501us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:17.524040 (+109769us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:18.121463 (+597423us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:18.122041 (+ 578us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:17.339966 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:17.340099 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:17.340103 (+ 4us) write_op.cc:435] Acquired schema lock
0617 07:53:17.340106 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:17.340218 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:17.340225 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:17.340229 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:17.340306 (+ 77us) tablet.cc:701] Row locks acquired
0617 07:53:17.340310 (+ 4us) write_op.cc:260] PREPARE: finished
0617 07:53:17.340337 (+ 27us) write_op.cc:270] Start()
0617 07:53:17.340359 (+ 22us) write_op.cc:276] Timestamp: P: 1781682797340320 usec, L: 0
0617 07:53:17.340362 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:17.340521 (+ 159us) log.cc:844] Serialized 762 byte log entry
0617 07:53:17.412841 (+ 72320us) op_driver.cc:464] REPLICATION: finished
0617 07:53:17.413532 (+ 691us) write_op.cc:301] APPLY: starting
0617 07:53:17.413542 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:17.413575 (+ 33us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:17.413618 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:17.413678 (+ 60us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:17.413724 (+ 46us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:17.413732 (+ 8us) write_op.cc:312] APPLY: finished
0617 07:53:17.413788 (+ 56us) log.cc:844] Serialized 29 byte log entry
0617 07:53:17.413829 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.413843 (+ 14us) write_op.cc:454] Released schema lock
0617 07:53:17.413848 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:17.413899 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.413902 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":657,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":364,"num_ops":2,"prepare.queue_time_us":2627,"prepare.run_cpu_time_us":603,"prepare.run_wall_time_us":602,"replication_time_us":72460}]]}
I20260617 07:53:18.129427 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_379c9732503049fa8e201f6b86a96023"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.129978 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_379c9732503049fa8e201f6b86a96023 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.135412 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e] alter complete (version 1)
W20260617 07:53:18.136255 456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:46601 (request call id 220) took 917 ms (client timeout 1000 ms). Trace:
W20260617 07:53:18.136376 456 rpcz_store.cc:269] 0617 07:53:17.218461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.329373 (+110912us) service_pool.cc:224] Handling call
0617 07:53:18.136211 (+806838us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:17.528783 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:17.528878 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:17.528884 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:17.528887 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:17.529009 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:17.529024 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:17.529029 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:17.529163 (+ 134us) tablet.cc:701] Row locks acquired
0617 07:53:17.529166 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:17.529204 (+ 38us) write_op.cc:270] Start()
0617 07:53:17.529239 (+ 35us) write_op.cc:276] Timestamp: P: 1781682797529164 usec, L: 0
0617 07:53:17.529243 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:17.529419 (+ 176us) log.cc:844] Serialized 913 byte log entry
0617 07:53:17.533657 (+ 4238us) op_driver.cc:464] REPLICATION: finished
0617 07:53:17.536952 (+ 3295us) write_op.cc:301] APPLY: starting
0617 07:53:17.536966 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:17.537002 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:17.537032 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:17.537100 (+ 68us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:17.537132 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:17.537140 (+ 8us) write_op.cc:312] APPLY: finished
0617 07:53:17.537204 (+ 64us) log.cc:844] Serialized 29 byte log entry
0617 07:53:17.537265 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.537284 (+ 19us) write_op.cc:454] Released schema lock
0617 07:53:17.537291 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:17.537356 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.537359 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 07:53:18.128715 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:18.128832 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:18.128838 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:18.128841 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:18.128929 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:18.128938 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:18.128943 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:18.128997 (+ 54us) tablet.cc:701] Row locks acquired
0617 07:53:18.128999 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:18.129026 (+ 27us) write_op.cc:270] Start()
0617 07:53:18.129060 (+ 34us) write_op.cc:276] Timestamp: P: 1781682798128980 usec, L: 0
0617 07:53:18.129063 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:18.129230 (+ 167us) log.cc:844] Serialized 356 byte log entry
0617 07:53:18.134492 (+ 5262us) op_driver.cc:464] REPLICATION: finished
0617 07:53:18.134579 (+ 87us) write_op.cc:301] APPLY: starting
0617 07:53:18.134591 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:18.134621 (+ 30us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:18.134654 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:18.134698 (+ 44us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:18.134725 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:18.134731 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:18.134789 (+ 58us) log.cc:844] Serialized 23 byte log entry
0617 07:53:18.134831 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.134842 (+ 11us) write_op.cc:454] Released schema lock
0617 07:53:18.134848 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:18.134909 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.134912 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50675,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":3242,"apply.run_cpu_time_us":401,"apply.run_wall_time_us":400,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":738,"prepare.run_wall_time_us":738,"raft.queue_time_us":66,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":229,"replication_time_us":4387}],["op",{"apply.queue_time_us":49,"apply.run_cpu_time_us":323,"apply.run_wall_time_us":323,"num_ops":1,"prepare.queue_time_us":7319,"prepare.run_cpu_time_us":584,"prepare.run_wall_time_us":585,"replication_time_us":5402}]]}
I20260617 07:53:18.137274 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.137377 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4a4a4aa9eb5b41a797441b36757c7db8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.137540 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.122574 1047 raft_consensus.cc:1275] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:18.132990 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.140691 2435 consensus_queue.cc:1048] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:18.136471 1172 tablet_bootstrap.cc:492] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:18.141151 1172 ts_tablet_manager.cc:1403] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.051s user 0.014s sys 0.002s
I20260617 07:53:18.141302 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 446114516f164dc0a956f2ccbf2e7c35
I20260617 07:53:18.141870 455 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 248) took 1090 ms. Trace:
I20260617 07:53:18.141912 1172 raft_consensus.cc:359] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.142076 1172 raft_consensus.cc:385] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.142128 1172 raft_consensus.cc:740] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.142310 1172 consensus_queue.cc:260] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.141968 455 rpcz_store.cc:276] 0617 07:53:17.051613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.333900 (+282287us) service_pool.cc:224] Handling call
0617 07:53:17.334341 (+ 441us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:17.334480 (+ 139us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:17.334527 (+ 47us) catalog_manager.cc:2849] Locking tablets
0617 07:53:17.335536 (+ 1009us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:17.414230 (+ 78694us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:17.524106 (+109876us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:18.141256 (+617150us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:18.141806 (+ 550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:17.339408 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:17.339505 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:17.339509 (+ 4us) write_op.cc:435] Acquired schema lock
0617 07:53:17.339511 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:17.339592 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:17.339600 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:17.339605 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:17.339684 (+ 79us) tablet.cc:701] Row locks acquired
0617 07:53:17.339686 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:17.339713 (+ 27us) write_op.cc:270] Start()
0617 07:53:17.339737 (+ 24us) write_op.cc:276] Timestamp: P: 1781682797339696 usec, L: 0
0617 07:53:17.339740 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:17.339871 (+ 131us) log.cc:844] Serialized 731 byte log entry
0617 07:53:17.412764 (+ 72893us) op_driver.cc:464] REPLICATION: finished
0617 07:53:17.412953 (+ 189us) write_op.cc:301] APPLY: starting
0617 07:53:17.412970 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:17.413017 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:17.413069 (+ 52us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:17.413145 (+ 76us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:17.413182 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:17.413189 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:17.413271 (+ 82us) log.cc:844] Serialized 29 byte log entry
0617 07:53:17.413334 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.413356 (+ 22us) write_op.cc:454] Released schema lock
0617 07:53:17.413362 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:17.413456 (+ 94us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.413460 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":133,"apply.run_cpu_time_us":485,"apply.run_wall_time_us":484,"mutex_wait_us":28,"num_ops":2,"prepare.queue_time_us":3163,"prepare.run_cpu_time_us":522,"prepare.run_wall_time_us":523,"replication_time_us":72988}]]}
I20260617 07:53:18.142725 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6059c873bed34cf5aad6dc245f4bb700" } new_table_name: "default.Table_e69b3e0b162d4abba8bc3e39e9799f56" modify_external_catalogs: true
I20260617 07:53:18.143155 461 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:33390 (request call id 252) took 1047 ms. Trace:
I20260617 07:53:18.143258 461 rpcz_store.cc:276] 0617 07:53:17.095473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.115357 (+1019884us) service_pool.cc:224] Handling call
0617 07:53:18.116253 (+ 896us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 07:53:18.116742 (+ 489us) catalog_manager.cc:2172] Created new table and tablet info
0617 07:53:18.142861 (+ 26119us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 07:53:18.143010 (+ 149us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 07:53:18.143101 (+ 91us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:18.117484 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:18.117612 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:18.117619 (+ 7us) write_op.cc:435] Acquired schema lock
0617 07:53:18.117621 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:18.117739 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:18.117754 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:18.117762 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:18.117856 (+ 94us) tablet.cc:701] Row locks acquired
0617 07:53:18.117859 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:18.117902 (+ 43us) write_op.cc:270] Start()
0617 07:53:18.117938 (+ 36us) write_op.cc:276] Timestamp: P: 1781682798117853 usec, L: 0
0617 07:53:18.117941 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:18.118126 (+ 185us) log.cc:844] Serialized 433 byte log entry
0617 07:53:18.130128 (+ 12002us) op_driver.cc:464] REPLICATION: finished
0617 07:53:18.130288 (+ 160us) write_op.cc:301] APPLY: starting
0617 07:53:18.130301 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:18.130344 (+ 43us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:18.130366 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:18.130485 (+ 119us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:18.130520 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 07:53:18.130526 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:18.130592 (+ 66us) log.cc:844] Serialized 29 byte log entry
0617 07:53:18.130639 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.130654 (+ 15us) write_op.cc:454] Released schema lock
0617 07:53:18.130660 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:18.130751 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.130755 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":435,"apply.run_wall_time_us":435,"num_ops":2,"prepare.queue_time_us":225,"prepare.run_cpu_time_us":753,"prepare.run_wall_time_us":754,"raft.queue_time_us":33,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":222,"replication_time_us":12161,"spinlock_wait_cycles":3456}]]}
I20260617 07:53:18.144099 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2a74749dc2164127b0c24e5e6fe5df46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.144569 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a74749dc2164127b0c24e5e6fe5df46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.144569 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 446114516f164dc0a956f2ccbf2e7c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.145469 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 446114516f164dc0a956f2ccbf2e7c35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 446114516f164dc0a956f2ccbf2e7c35 already in progress: creating tablet
I20260617 07:53:18.146112 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 446114516f164dc0a956f2ccbf2e7c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:18.147835 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a4a4aa9eb5b41a797441b36757c7db8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.149426 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 446114516f164dc0a956f2ccbf2e7c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.149772 1170 raft_consensus.cc:2243] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:18.149921 1170 raft_consensus.cc:2272] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:18.150444 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1077b4b7bbb44940ba86c9aa6b6d7ff4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.150898 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1077b4b7bbb44940ba86c9aa6b6d7ff4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.158660 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 44b06e32039e4ad28924f5173035820a from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:18.159404 1172 ts_tablet_manager.cc:1434] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.018s user 0.005s sys 0.005s
I20260617 07:53:18.159773 1172 tablet_bootstrap.cc:492] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.161595 1172 tablet_bootstrap.cc:654] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.161727 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_93a30efc9eaf4d88a07a973b6dd6c51a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.162307 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93a30efc9eaf4d88a07a973b6dd6c51a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.163013 2440 raft_consensus.cc:493] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.163152 2440 raft_consensus.cc:515] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.164366 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf5384ec244d36ba3d4e781c5eb8a3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:18.164897 988 leader_election.cc:343] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.165706 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf5384ec244d36ba3d4e781c5eb8a3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:18.166352 986 leader_election.cc:343] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.166451 986 leader_election.cc:304] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:18.166654 2386 raft_consensus.cc:2749] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.166687 2440 leader_election.cc:290] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:18.167732 1178 raft_consensus.cc:359] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.168939 1171 tablet_bootstrap.cc:492] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.169142 1171 ts_tablet_manager.cc:1403] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.000s
I20260617 07:53:18.169968 1171 raft_consensus.cc:359] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.170203 1171 raft_consensus.cc:385] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.170331 1171 raft_consensus.cc:740] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.170578 1171 consensus_queue.cc:260] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.170933 460 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 from {username='slave'} at 127.0.0.1:33390
W20260617 07:53:18.171892 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe42e90971464554b1a029b401568938 consensus state has no leader
I20260617 07:53:18.172176 452 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:33390 (request call id 250) took 1085 ms. Trace:
I20260617 07:53:18.172286 452 rpcz_store.cc:276] 0617 07:53:17.086668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.554022 (+467354us) service_pool.cc:224] Handling call
0617 07:53:17.658631 (+104609us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:17.658856 (+ 225us) catalog_manager.cc:3750] Apply alter schema
0617 07:53:17.659059 (+ 203us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 07:53:17.659144 (+ 85us) catalog_manager.cc:3940] Updating metadata on disk
0617 07:53:17.667584 (+ 8440us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.667590 (+ 6us) write_op.cc:454] Released schema lock
0617 07:53:17.673864 (+ 6274us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 07:53:18.172140 (+498276us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:17.659727 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:17.659868 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:17.659874 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:17.659909 (+ 35us) tablet.cc:662] Decoding operations
0617 07:53:17.660007 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:17.660019 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:17.660024 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 07:53:17.660084 (+ 60us) tablet.cc:701] Row locks acquired
0617 07:53:17.660086 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:17.660125 (+ 39us) write_op.cc:270] Start()
0617 07:53:17.660156 (+ 31us) write_op.cc:276] Timestamp: P: 1781682797660074 usec, L: 0
0617 07:53:17.660160 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 07:53:17.660370 (+ 210us) log.cc:844] Serialized 405 byte log entry
0617 07:53:17.665368 (+ 4998us) op_driver.cc:464] REPLICATION: finished
0617 07:53:17.665492 (+ 124us) write_op.cc:301] APPLY: starting
0617 07:53:17.665506 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:17.665552 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:17.665579 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:17.665624 (+ 45us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:17.665658 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:17.665667 (+ 9us) write_op.cc:312] APPLY: finished
0617 07:53:17.665779 (+ 112us) log.cc:844] Serialized 23 byte log entry
0617 07:53:17.665838 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:17.665856 (+ 18us) write_op.cc:454] Released schema lock
0617 07:53:17.665862 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":73,"apply.run_cpu_time_us":422,"apply.run_wall_time_us":421,"num_ops":1,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":746,"prepare.run_wall_time_us":748,"raft.queue_time_us":66,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":243,"replication_time_us":5175}]]}
I20260617 07:53:18.175709 1172 tablet_bootstrap.cc:492] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:18.175870 1172 ts_tablet_manager.cc:1403] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.002s
I20260617 07:53:18.176224 1170 ts_tablet_manager.cc:1916] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:18.177035 1172 raft_consensus.cc:359] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.177278 1172 raft_consensus.cc:385] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.177382 1172 raft_consensus.cc:740] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.177724 1172 consensus_queue.cc:260] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.178368 1172 ts_tablet_manager.cc:1434] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:18.178839 1172 tablet_bootstrap.cc:492] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.180269 1171 ts_tablet_manager.cc:1434] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260617 07:53:18.180590 1171 tablet_bootstrap.cc:492] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.180905 1172 tablet_bootstrap.cc:654] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.182753 1171 tablet_bootstrap.cc:654] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.190117 1178 raft_consensus.cc:385] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.190398 1178 raft_consensus.cc:740] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.190428 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet a0dcd837e1c54af696394e7a6c4d26f0
I20260617 07:53:18.191159 749 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dcd837e1c54af696394e7a6c4d26f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.191591 884 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dcd837e1c54af696394e7a6c4d26f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.191771 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dcd837e1c54af696394e7a6c4d26f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:18.192495 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a0dcd837e1c54af696394e7a6c4d26f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0dcd837e1c54af696394e7a6c4d26f0 already in progress: creating tablet
I20260617 07:53:18.192900 1171 tablet_bootstrap.cc:492] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.193058 2373 tablet.cc:1724] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:18.193066 1171 ts_tablet_manager.cc:1403] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.001s
I20260617 07:53:18.194578 1171 raft_consensus.cc:359] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.194764 1171 raft_consensus.cc:385] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.194834 1171 raft_consensus.cc:740] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.199812 1098 heartbeater.cc:499] Master 127.0.105.190:41615 was elected leader, sending a full tablet report...
I20260617 07:53:18.203444 1172 tablet_bootstrap.cc:492] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:18.203580 1172 ts_tablet_manager.cc:1403] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.000s
I20260617 07:53:18.204248 1172 raft_consensus.cc:359] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.204406 1172 raft_consensus.cc:385] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.204452 1172 raft_consensus.cc:740] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.204685 1172 consensus_queue.cc:260] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.205241 1172 ts_tablet_manager.cc:1434] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:18.205492 1172 tablet_bootstrap.cc:492] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.207120 1172 tablet_bootstrap.cc:654] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.207588 1171 consensus_queue.cc:260] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.208238 1171 ts_tablet_manager.cc:1434] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260617 07:53:18.208540 1171 tablet_bootstrap.cc:492] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.210304 2087 raft_consensus.cc:515] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.211038 2087 leader_election.cc:290] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.211346 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c019792d23484fb789378bf377547415" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:18.211640 1050 raft_consensus.cc:2468] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:18.211906 852 leader_election.cc:343] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.214110 455 master_service.cc:960] ReplaceTablet: received request to replace tablet e03a26e301e747febc4d5bafdc1a49c6 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:18.214522 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:18.214790 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 306742b9da81497991d58947bf3c1ebb from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:18.214951 851 leader_election.cc:304] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.215121 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_93379979809441178fa6c159c07f77ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.215422 2435 raft_consensus.cc:2804] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:18.215550 2435 raft_consensus.cc:697] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
W20260617 07:53:18.215704 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93379979809441178fa6c159c07f77ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.215646 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_93e8d29da1584b79abf1bd4823335929"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.215818 2435 consensus_queue.cc:237] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.216024 1171 tablet_bootstrap.cc:654] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:18.216127 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93e8d29da1584b79abf1bd4823335929 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.217377 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c019792d23484fb789378bf377547415" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.217589 1050 raft_consensus.cc:3060] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.222399 1898 raft_consensus.cc:493] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.222512 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1aca1a9fa2a640cd8e74ee5d6f9fc169"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.222556 1898 raft_consensus.cc:515] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:18.222981 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1aca1a9fa2a640cd8e74ee5d6f9fc169 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.223165 1898 leader_election.cc:290] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.224206 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28538804fd254dc8b4a341debf508a85" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.224184 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28538804fd254dc8b4a341debf508a85" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.224355 1046 raft_consensus.cc:2468] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:18.224786 852 leader_election.cc:343] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.225118 851 leader_election.cc:304] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.225812 1898 raft_consensus.cc:2804] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.225904 1898 raft_consensus.cc:493] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.226014 1898 raft_consensus.cc:3060] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.228390 2373 tablet.cc:1724] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:18.235529 2087 raft_consensus.cc:493] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.235707 2087 raft_consensus.cc:515] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.236450 2087 leader_election.cc:290] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.236817 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5578fd5cb3724ed5b92b313bd52889ad" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.237236 1044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5578fd5cb3724ed5b92b313bd52889ad" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:18.237520 852 leader_election.cc:343] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:18.237789 851 leader_election.cc:343] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.237915 851 leader_election.cc:304] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.238344 2374 tablet.cc:1724] T 2777cf575a914f59b3459f3ce96f5d9a P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:18.238440 2087 raft_consensus.cc:2749] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.251686 1171 tablet_bootstrap.cc:492] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.251852 1171 ts_tablet_manager.cc:1403] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.008s
I20260617 07:53:18.253033 1171 raft_consensus.cc:359] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.253233 1171 raft_consensus.cc:385] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.253336 1171 raft_consensus.cc:740] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.254391 1171 consensus_queue.cc:260] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.254961 1171 ts_tablet_manager.cc:1434] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:18.190722 1178 consensus_queue.cc:260] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.258426 1171 tablet_bootstrap.cc:492] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.261184 1171 tablet_bootstrap.cc:654] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.263789 1178 ts_tablet_manager.cc:1434] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.098s user 0.001s sys 0.000s
I20260617 07:53:18.264920 1178 tablet_bootstrap.cc:492] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:18.268882 1170 ts_tablet_manager.cc:1929] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:18.269001 1170 log.cc:1199] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/3fcf87953dc14bf190ac74101547e52f
I20260617 07:53:18.269299 1170 ts_tablet_manager.cc:1950] T 3fcf87953dc14bf190ac74101547e52f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:18.279488 2201 raft_consensus.cc:515] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.280256 2201 leader_election.cc:290] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.280447 2201 raft_consensus.cc:493] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.280578 2201 raft_consensus.cc:515] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.281232 2201 leader_election.cc:290] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.282001 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24066965db7141a6a970ec08f835a820" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:18.282209 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_28ed4c5efaf94cb498246499e67db6c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.282356 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f7a4ea634f429794b402439d19bbfe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.283179 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c2ab276e39134bfb97bec45ec6d13aea" } modify_external_catalogs: true
I20260617 07:53:18.283353 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c2ab276e39134bfb97bec45ec6d13aea" } modify_external_catalogs: true
W20260617 07:53:18.284832 852 leader_election.cc:343] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:18.285044 852 leader_election.cc:343] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.285840 1044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f7a4ea634f429794b402439d19bbfe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.285948 1050 raft_consensus.cc:2468] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:18.286036 1044 raft_consensus.cc:2468] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.286537 851 leader_election.cc:304] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.287163 851 leader_election.cc:304] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.287571 2087 raft_consensus.cc:2804] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.287669 2087 raft_consensus.cc:493] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.287770 2087 raft_consensus.cc:3060] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.288184 2201 raft_consensus.cc:2804] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:18.288426 2201 raft_consensus.cc:697] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:18.288702 2201 consensus_queue.cc:237] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.288847 2452 tablet.cc:1724] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:18.290035 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24066965db7141a6a970ec08f835a820" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.290248 1047 raft_consensus.cc:3060] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:18.290375 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28ed4c5efaf94cb498246499e67db6c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.293664 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 358) took 1104 ms. Trace:
I20260617 07:53:18.293799 1862 rpcz_store.cc:276] 0617 07:53:17.188722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.188778 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:17.996332 (+807554us) ts_tablet_manager.cc:1151] Deleting tablet 3ae9261c0ac94defaecfc7d14ba1ae61
0617 07:53:17.996339 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.046131 (+ 49792us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.098820 (+ 52689us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.293622 (+194802us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":807372}
I20260617 07:53:18.294245 1862 tablet_replica.cc:333] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:18.294430 1862 raft_consensus.cc:2243] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:18.294569 1862 raft_consensus.cc:2272] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:18.295105 1862 ts_tablet_manager.cc:1916] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:18.298099 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 3ae9261c0ac94defaecfc7d14ba1ae61 (table default.Table_f906af88bdcd40169dad534822931936 [id=cd20d0490cb74168b4ff032d0f943992]) successfully deleted
I20260617 07:53:18.310873 2435 raft_consensus.cc:493] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.311162 2435 raft_consensus.cc:515] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.312693 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d94915d96694d6f9a86063640e5fe18" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:18.313623 852 leader_election.cc:343] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.313943 2435 leader_election.cc:290] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.314379 1018 tablet_service.cc:1511] Processing CreateTablet for tablet ca7f2c98a6a14243a201af5cf49f6cb3 (DEFAULT_TABLE table=default.Table_611e903704f44d74af4777fe0a8c5210 [id=32fb6ed5aaff4e6990b99b32037a10e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.314306 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d94915d96694d6f9a86063640e5fe18" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.315285 1052 raft_consensus.cc:2468] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.317361 884 tablet_service.cc:1511] Processing CreateTablet for tablet ca7f2c98a6a14243a201af5cf49f6cb3 (DEFAULT_TABLE table=default.Table_611e903704f44d74af4777fe0a8c5210 [id=32fb6ed5aaff4e6990b99b32037a10e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.318109 886 tablet_service.cc:1511] Processing CreateTablet for tablet c76a4fc523c44a44a7a0c9b6ed1c1734 (DEFAULT_TABLE table=default.Table_20dbf4b3ced34a5faf8d96930d179360 [id=9e6637baccc44e1fa57b61b21d2de2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.319089 749 tablet_service.cc:1511] Processing CreateTablet for tablet ca7f2c98a6a14243a201af5cf49f6cb3 (DEFAULT_TABLE table=default.Table_611e903704f44d74af4777fe0a8c5210 [id=32fb6ed5aaff4e6990b99b32037a10e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.319553 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca7f2c98a6a14243a201af5cf49f6cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.320402 887 tablet_service.cc:1511] Processing CreateTablet for tablet cc8bf9876afc48bf81bf3020701a2939 (DEFAULT_TABLE table=default.Table_e47ba449880147f6a1209c001192aa4b [id=08c778e42e8e455eaf28951706171a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.321797 894 tablet_service.cc:1511] Processing CreateTablet for tablet c449d3e251aa4f06a9191114bff0e0e2 (DEFAULT_TABLE table=default.Table_8cb4ea8e1a39478fa0b788e049009950 [id=c1fbbdf211d24d72bc0673e2ab662d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.322069 885 tablet_service.cc:1511] Processing CreateTablet for tablet 12727ad13f0747ce8d9710a71ba2c075 (DEFAULT_TABLE table=default.Table_5a33989a09d74eb2978b216ba46a372f [id=bed11028cf904965a31e443315b3f8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.322336 2435 raft_consensus.cc:493] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:18.322569 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (table default.Table_d5600121c81049589ce932a199273324 [id=494c90461b61486ab6dad26bbd3acab5], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6c2bae0d7dfe4512b1674796e5dacf27 consensus state has no leader
I20260617 07:53:18.322625 750 tablet_service.cc:1511] Processing CreateTablet for tablet c76a4fc523c44a44a7a0c9b6ed1c1734 (DEFAULT_TABLE table=default.Table_20dbf4b3ced34a5faf8d96930d179360 [id=9e6637baccc44e1fa57b61b21d2de2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.322710 2435 raft_consensus.cc:515] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.323015 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c76a4fc523c44a44a7a0c9b6ed1c1734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.324769 895 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4731f058ba4f70a6a3aa5802ab6ba0 (DEFAULT_TABLE table=default.Table_65df8fca2c7142f98705a6eb19589171 [id=45e15f5f463d4e7182c9d0ab8691323b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.325524 2435 leader_election.cc:290] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.318037 1021 tablet_service.cc:1511] Processing CreateTablet for tablet c76a4fc523c44a44a7a0c9b6ed1c1734 (DEFAULT_TABLE table=default.Table_20dbf4b3ced34a5faf8d96930d179360 [id=9e6637baccc44e1fa57b61b21d2de2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.319489 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 12727ad13f0747ce8d9710a71ba2c075 (DEFAULT_TABLE table=default.Table_5a33989a09d74eb2978b216ba46a372f [id=bed11028cf904965a31e443315b3f8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.325884 741 tablet_service.cc:1511] Processing CreateTablet for tablet 6343f3d909ac4438b882283ab2b25a6d (DEFAULT_TABLE table=default.Table_c74efd8727684d22be93a779848e0837 [id=eccb336681e44a7d87d3902fef4b289a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.321198 1019 tablet_service.cc:1511] Processing CreateTablet for tablet cc8bf9876afc48bf81bf3020701a2939 (DEFAULT_TABLE table=default.Table_e47ba449880147f6a1209c001192aa4b [id=08c778e42e8e455eaf28951706171a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.322235 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c449d3e251aa4f06a9191114bff0e0e2 (DEFAULT_TABLE table=default.Table_8cb4ea8e1a39478fa0b788e049009950 [id=c1fbbdf211d24d72bc0673e2ab662d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.326260 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6343f3d909ac4438b882283ab2b25a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.323609 1032 tablet_service.cc:1511] Processing CreateTablet for tablet d7b981da1d2e4862824e933dc8babefc (DEFAULT_TABLE table=default.Table_e90ad53742c6427a87f6e2dfad5f9e54 [id=30f9fa100b704eb9bbc9a42cd664a4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.324204 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630e540a77374c11895ab5a0e394b3bb" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:18.327147 851 leader_election.cc:343] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.327663 851 leader_election.cc:304] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.325305 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4731f058ba4f70a6a3aa5802ab6ba0 (DEFAULT_TABLE table=default.Table_65df8fca2c7142f98705a6eb19589171 [id=45e15f5f463d4e7182c9d0ab8691323b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.328234 2086 raft_consensus.cc:2804] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.328338 2086 raft_consensus.cc:493] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.328459 2086 raft_consensus.cc:3060] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.329180 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 6343f3d909ac4438b882283ab2b25a6d (DEFAULT_TABLE table=default.Table_c74efd8727684d22be93a779848e0837 [id=eccb336681e44a7d87d3902fef4b289a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.329972 882 tablet_service.cc:1511] Processing CreateTablet for tablet 6343f3d909ac4438b882283ab2b25a6d (DEFAULT_TABLE table=default.Table_c74efd8727684d22be93a779848e0837 [id=eccb336681e44a7d87d3902fef4b289a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.330019 742 tablet_service.cc:1511] Processing CreateTablet for tablet 12727ad13f0747ce8d9710a71ba2c075 (DEFAULT_TABLE table=default.Table_5a33989a09d74eb2978b216ba46a372f [id=bed11028cf904965a31e443315b3f8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.330214 748 tablet_service.cc:1511] Processing CreateTablet for tablet ea4c1033487a4dd2a73bd5148d5bb8f9 (DEFAULT_TABLE table=default.Table_5ea958c04885438e835ca06d85721a8f [id=c6c53ee6dd5d400489ff9572a891c050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.330386 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12727ad13f0747ce8d9710a71ba2c075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.330554 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea4c1033487a4dd2a73bd5148d5bb8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.330902 881 tablet_service.cc:1511] Processing CreateTablet for tablet ea4c1033487a4dd2a73bd5148d5bb8f9 (DEFAULT_TABLE table=default.Table_5ea958c04885438e835ca06d85721a8f [id=c6c53ee6dd5d400489ff9572a891c050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.333012 879 tablet_service.cc:1511] Processing CreateTablet for tablet d73460bcd4f648cc9f51e30a0a1b7342 (DEFAULT_TABLE table=default.Table_a179c86f21864fd984fcedd2be1154d1 [id=c028c09416d4445f90b0fe3cf1a20e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.333667 759 tablet_service.cc:1511] Processing CreateTablet for tablet c39b4f54b47a4e40943899251c1874cd (DEFAULT_TABLE table=default.Table_4564c55b79844903a7e9dfffd3c69096 [id=82633a6773d64cc9be1f1dff622f3009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.334061 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b4f54b47a4e40943899251c1874cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.334189 743 tablet_service.cc:1511] Processing CreateTablet for tablet cc8bf9876afc48bf81bf3020701a2939 (DEFAULT_TABLE table=default.Table_e47ba449880147f6a1209c001192aa4b [id=08c778e42e8e455eaf28951706171a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.334543 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8bf9876afc48bf81bf3020701a2939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.337935 1178 tablet_bootstrap.cc:654] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.338012 758 tablet_service.cc:1511] Processing CreateTablet for tablet d73460bcd4f648cc9f51e30a0a1b7342 (DEFAULT_TABLE table=default.Table_a179c86f21864fd984fcedd2be1154d1 [id=c028c09416d4445f90b0fe3cf1a20e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.338147 746 tablet_service.cc:1511] Processing CreateTablet for tablet c449d3e251aa4f06a9191114bff0e0e2 (DEFAULT_TABLE table=default.Table_8cb4ea8e1a39478fa0b788e049009950 [id=c1fbbdf211d24d72bc0673e2ab662d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.338354 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73460bcd4f648cc9f51e30a0a1b7342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.338822 745 tablet_service.cc:1511] Processing CreateTablet for tablet d7b981da1d2e4862824e933dc8babefc (DEFAULT_TABLE table=default.Table_e90ad53742c6427a87f6e2dfad5f9e54 [id=30f9fa100b704eb9bbc9a42cd664a4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.339180 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b981da1d2e4862824e933dc8babefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.342008 898 tablet_service.cc:1511] Processing CreateTablet for tablet d7b981da1d2e4862824e933dc8babefc (DEFAULT_TABLE table=default.Table_e90ad53742c6427a87f6e2dfad5f9e54 [id=30f9fa100b704eb9bbc9a42cd664a4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.342689 753 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4731f058ba4f70a6a3aa5802ab6ba0 (DEFAULT_TABLE table=default.Table_65df8fca2c7142f98705a6eb19589171 [id=45e15f5f463d4e7182c9d0ab8691323b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.343082 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4731f058ba4f70a6a3aa5802ab6ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.345862 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630e540a77374c11895ab5a0e394b3bb" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.346707 1172 tablet_bootstrap.cc:492] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:18.346864 1172 ts_tablet_manager.cc:1403] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.141s user 0.008s sys 0.010s
I20260617 07:53:18.347762 1172 raft_consensus.cc:359] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.347994 1172 raft_consensus.cc:385] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.348066 1172 raft_consensus.cc:740] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.348271 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 306742b9da81497991d58947bf3c1ebb
I20260617 07:53:18.348291 1172 consensus_queue.cc:260] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.348793 455 catalog_manager.cc:6784] ReplaceTablet: tablet 306742b9da81497991d58947bf3c1ebb deleted and replaced by tablet c8848c0f52e34c118a9e1831b8c9a88e
I20260617 07:53:18.348845 1172 ts_tablet_manager.cc:1434] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:18.349165 1172 tablet_bootstrap.cc:492] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.350234 1027 tablet_service.cc:1511] Processing CreateTablet for tablet ea4c1033487a4dd2a73bd5148d5bb8f9 (DEFAULT_TABLE table=default.Table_5ea958c04885438e835ca06d85721a8f [id=c6c53ee6dd5d400489ff9572a891c050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.350805 1020 tablet_service.cc:1511] Processing CreateTablet for tablet d73460bcd4f648cc9f51e30a0a1b7342 (DEFAULT_TABLE table=default.Table_a179c86f21864fd984fcedd2be1154d1 [id=c028c09416d4445f90b0fe3cf1a20e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.352969 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c449d3e251aa4f06a9191114bff0e0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.353202 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 306742b9da81497991d58947bf3c1ebb with delete_type TABLET_DATA_DELETED (replaced by tablet c8848c0f52e34c118a9e1831b8c9a88e) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.356597 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 306742b9da81497991d58947bf3c1ebb with delete_type TABLET_DATA_DELETED (replaced by tablet c8848c0f52e34c118a9e1831b8c9a88e) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.357770 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 285) took 2753 ms. Trace:
I20260617 07:53:18.357808 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4731f058ba4f70a6a3aa5802ab6ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.357872 1170 rpcz_store.cc:276] 0617 07:53:15.604227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.604265 (+ 38us) service_pool.cc:224] Handling call
0617 07:53:18.111122 (+2506857us) ts_tablet_manager.cc:1151] Deleting tablet 3fcf87953dc14bf190ac74101547e52f
0617 07:53:18.111135 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.265894 (+154759us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.268827 (+ 2933us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.357752 (+ 88925us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2506724}
I20260617 07:53:18.358214 1170 tablet_replica.cc:333] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:18.358443 1170 raft_consensus.cc:2243] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:18.358593 1170 raft_consensus.cc:2272] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:18.359038 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c76a4fc523c44a44a7a0c9b6ed1c1734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.359498 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12727ad13f0747ce8d9710a71ba2c075. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:18.359695 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 306742b9da81497991d58947bf3c1ebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 306742b9da81497991d58947bf3c1ebb already in progress: creating tablet
I20260617 07:53:18.360036 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8bf9876afc48bf81bf3020701a2939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.360080 755 tablet_service.cc:1511] Processing CreateTablet for tablet 4f95a13b909c4ef9be6c56a317b42c9b (DEFAULT_TABLE table=default.Table_360fa4c3327249579a54f68d3a81e327 [id=991ca120d90a4775a9c19d8a63092120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.360471 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f95a13b909c4ef9be6c56a317b42c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.360491 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6343f3d909ac4438b882283ab2b25a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.360795 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b981da1d2e4862824e933dc8babefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.360982 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca7f2c98a6a14243a201af5cf49f6cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.361224 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c449d3e251aa4f06a9191114bff0e0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.361405 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73460bcd4f648cc9f51e30a0a1b7342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.361838 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea4c1033487a4dd2a73bd5148d5bb8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.368520 1898 raft_consensus.cc:515] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:18.370071 852 leader_election.cc:343] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.370218 852 leader_election.cc:304] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.371119 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 306742b9da81497991d58947bf3c1ebb with delete_type TABLET_DATA_DELETED (replaced by tablet c8848c0f52e34c118a9e1831b8c9a88e) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.371331 880 tablet_service.cc:1511] Processing CreateTablet for tablet c39b4f54b47a4e40943899251c1874cd (DEFAULT_TABLE table=default.Table_4564c55b79844903a7e9dfffd3c69096 [id=82633a6773d64cc9be1f1dff622f3009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.371356 883 tablet_service.cc:1511] Processing CreateTablet for tablet 4f95a13b909c4ef9be6c56a317b42c9b (DEFAULT_TABLE table=default.Table_360fa4c3327249579a54f68d3a81e327 [id=991ca120d90a4775a9c19d8a63092120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.372586 1170 ts_tablet_manager.cc:1916] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:18.377207 1172 tablet_bootstrap.cc:654] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.378062 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6343f3d909ac4438b882283ab2b25a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.378348 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c76a4fc523c44a44a7a0c9b6ed1c1734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.378629 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b981da1d2e4862824e933dc8babefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.378821 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c449d3e251aa4f06a9191114bff0e0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.379289 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4731f058ba4f70a6a3aa5802ab6ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.379763 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea4c1033487a4dd2a73bd5148d5bb8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.380210 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73460bcd4f648cc9f51e30a0a1b7342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.381210 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8bf9876afc48bf81bf3020701a2939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.381976 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12727ad13f0747ce8d9710a71ba2c075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.382468 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f95a13b909c4ef9be6c56a317b42c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.382907 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b4f54b47a4e40943899251c1874cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.383435 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca7f2c98a6a14243a201af5cf49f6cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.393327 1030 tablet_service.cc:1511] Processing CreateTablet for tablet c39b4f54b47a4e40943899251c1874cd (DEFAULT_TABLE table=default.Table_4564c55b79844903a7e9dfffd3c69096 [id=82633a6773d64cc9be1f1dff622f3009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.393504 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 4f95a13b909c4ef9be6c56a317b42c9b (DEFAULT_TABLE table=default.Table_360fa4c3327249579a54f68d3a81e327 [id=991ca120d90a4775a9c19d8a63092120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:18.399531 2436 raft_consensus.cc:2749] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.401500 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 3fcf87953dc14bf190ac74101547e52f (table default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]) successfully deleted
I20260617 07:53:18.405236 2436 raft_consensus.cc:493] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.405396 2436 raft_consensus.cc:515] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.405937 1047 raft_consensus.cc:2468] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:18.406303 2436 leader_election.cc:290] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.408463 851 leader_election.cc:304] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.409183 2437 raft_consensus.cc:2804] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:18.409293 2437 raft_consensus.cc:697] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:18.409534 2437 consensus_queue.cc:237] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.412071 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596ef68705c84791b54f07e03b219b4c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.414606 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596ef68705c84791b54f07e03b219b4c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.414788 1047 raft_consensus.cc:2468] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.415151 851 leader_election.cc:304] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:18.415752 2436 raft_consensus.cc:2804] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.415848 2436 raft_consensus.cc:493] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.415921 2436 raft_consensus.cc:3060] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.427968 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3
W20260617 07:53:18.427699 852 leader_election.cc:343] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.429302 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 61510f9812e849e388c6c163e9af5f4f) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.430747 460 catalog_manager.cc:6784] ReplaceTablet: tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 deleted and replaced by tablet 61510f9812e849e388c6c163e9af5f4f
I20260617 07:53:18.430903 460 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:33390 (request call id 262) took 1113 ms. Trace:
I20260617 07:53:18.431142 460 rpcz_store.cc:276] 0617 07:53:17.317378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.170843 (+853465us) service_pool.cc:224] Handling call
0617 07:53:18.430865 (+260022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:18.316254 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:18.316341 (+ 87us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:18.316345 (+ 4us) write_op.cc:435] Acquired schema lock
0617 07:53:18.316347 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:18.316415 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:18.316421 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:18.316425 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:18.316476 (+ 51us) tablet.cc:701] Row locks acquired
0617 07:53:18.316478 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:18.316515 (+ 37us) write_op.cc:270] Start()
0617 07:53:18.316537 (+ 22us) write_op.cc:276] Timestamp: P: 1781682798316438 usec, L: 0
0617 07:53:18.316540 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:18.316665 (+ 125us) log.cc:844] Serialized 628 byte log entry
0617 07:53:18.426844 (+110179us) op_driver.cc:464] REPLICATION: finished
0617 07:53:18.426965 (+ 121us) write_op.cc:301] APPLY: starting
0617 07:53:18.426996 (+ 31us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:18.427062 (+ 66us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:18.427261 (+ 199us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:18.427386 (+ 125us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:18.427478 (+ 92us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:18.427488 (+ 10us) write_op.cc:312] APPLY: finished
0617 07:53:18.427597 (+ 109us) log.cc:844] Serialized 29 byte log entry
0617 07:53:18.427665 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.427701 (+ 36us) write_op.cc:454] Released schema lock
0617 07:53:18.427708 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:18.427791 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.427794 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":54,"apply.run_cpu_time_us":732,"apply.run_wall_time_us":822,"num_ops":2,"prepare.queue_time_us":1729,"prepare.run_cpu_time_us":466,"prepare.run_wall_time_us":465,"replication_time_us":110267}]]}
I20260617 07:53:18.437988 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e69b3e0b162d4abba8bc3e39e9799f56" } new_table_name: "default.Table_d8de6c8b38ea464081b555e61b43423e" modify_external_catalogs: true
I20260617 07:53:18.440662 2201 raft_consensus.cc:493] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.440825 2201 raft_consensus.cc:515] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.441468 2201 leader_election.cc:290] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.441614 2201 raft_consensus.cc:493] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.441752 2201 raft_consensus.cc:515] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.442265 2201 leader_election.cc:290] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.443069 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca402543247461aa5384abb65fff364" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.443248 1050 raft_consensus.cc:2468] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.443755 851 leader_election.cc:304] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:18.444571 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de8df5e15cb43c0b95ec5af3110db66" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.444912 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca402543247461aa5384abb65fff364" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:18.445287 852 leader_election.cc:343] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:18.445509 852 leader_election.cc:343] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.445915 2435 raft_consensus.cc:2804] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.446018 2435 raft_consensus.cc:493] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.446080 2435 raft_consensus.cc:3060] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.446744 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2ef5d5b6d55d4cd0adc070cfdf8209a7" } new_table_name: "default.Table_e80b82e221bb421691ddece5b6db63a0" modify_external_catalogs: true
I20260617 07:53:18.448698 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de8df5e15cb43c0b95ec5af3110db66" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.448915 1047 raft_consensus.cc:2468] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.449832 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 61510f9812e849e388c6c163e9af5f4f) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.450063 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 61510f9812e849e388c6c163e9af5f4f) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.451129 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 already in progress: creating tablet
I20260617 07:53:18.452072 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:18.453622 2087 raft_consensus.cc:515] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.454285 2087 leader_election.cc:290] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.455798 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 44b06e32039e4ad28924f5173035820a
I20260617 07:53:18.456321 456 catalog_manager.cc:6784] ReplaceTablet: tablet 44b06e32039e4ad28924f5173035820a deleted and replaced by tablet 8d27dcd5af04496b8e231115a88b4aeb
I20260617 07:53:18.456465 456 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:33390 (request call id 260) took 1166 ms. Trace:
I20260617 07:53:18.456765 851 leader_election.cc:304] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.456804 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 44b06e32039e4ad28924f5173035820a with delete_type TABLET_DATA_DELETED (replaced by tablet 8d27dcd5af04496b8e231115a88b4aeb) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.456557 456 rpcz_store.cc:276] 0617 07:53:17.290201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.158591 (+868390us) service_pool.cc:224] Handling call
0617 07:53:18.456413 (+297822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:18.316760 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:18.316843 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:18.316849 (+ 6us) write_op.cc:435] Acquired schema lock
0617 07:53:18.316851 (+ 2us) tablet.cc:662] Decoding operations
0617 07:53:18.316934 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:18.316941 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:18.316945 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:18.316999 (+ 54us) tablet.cc:701] Row locks acquired
0617 07:53:18.317001 (+ 2us) write_op.cc:260] PREPARE: finished
0617 07:53:18.317027 (+ 26us) write_op.cc:270] Start()
0617 07:53:18.317071 (+ 44us) write_op.cc:276] Timestamp: P: 1781682798316962 usec, L: 0
0617 07:53:18.317074 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:18.317219 (+ 145us) log.cc:844] Serialized 628 byte log entry
0617 07:53:18.437379 (+120160us) op_driver.cc:464] REPLICATION: finished
0617 07:53:18.450303 (+ 12924us) write_op.cc:301] APPLY: starting
0617 07:53:18.450406 (+ 103us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:18.450545 (+ 139us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:18.451170 (+ 625us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:18.451613 (+ 443us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:18.451729 (+ 116us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 07:53:18.451736 (+ 7us) write_op.cc:312] APPLY: finished
0617 07:53:18.451875 (+ 139us) log.cc:844] Serialized 29 byte log entry
0617 07:53:18.451940 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.451985 (+ 45us) write_op.cc:454] Released schema lock
0617 07:53:18.451995 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:18.452194 (+ 199us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.452226 (+ 32us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":10190,"apply.run_cpu_time_us":796,"apply.run_wall_time_us":1895,"num_ops":2,"prepare.queue_time_us":1470,"prepare.run_cpu_time_us":507,"prepare.run_wall_time_us":506,"replication_time_us":110048}]]}
W20260617 07:53:18.457726 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 44b06e32039e4ad28924f5173035820a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44b06e32039e4ad28924f5173035820a already in progress: creating tablet
I20260617 07:53:18.458030 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f7a4ea634f429794b402439d19bbfe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.458218 1050 raft_consensus.cc:3060] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.458422 1178 tablet_bootstrap.cc:492] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:18.459120 1178 ts_tablet_manager.cc:1403] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.194s user 0.002s sys 0.002s
I20260617 07:53:18.460650 2087 raft_consensus.cc:2804] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.460742 2087 raft_consensus.cc:493] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.460798 2087 raft_consensus.cc:3060] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.462361 1178 raft_consensus.cc:359] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.462738 1178 raft_consensus.cc:385] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.462929 1178 raft_consensus.cc:740] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.463490 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 44b06e32039e4ad28924f5173035820a with delete_type TABLET_DATA_DELETED (replaced by tablet 8d27dcd5af04496b8e231115a88b4aeb) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.463357 1178 consensus_queue.cc:260] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.464625 1178 ts_tablet_manager.cc:1434] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:18.465255 1178 tablet_bootstrap.cc:492] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:18.469297 1178 tablet_bootstrap.cc:654] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.477275 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_90eee67c1b8d48cfac17fa339cb10a2b" } new_table_name: "default.Table_b8df6bf2a67d44598b3472dd0031e570" modify_external_catalogs: true
I20260617 07:53:18.478581 1898 leader_election.cc:290] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.481357 1178 tablet_bootstrap.cc:492] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:18.481652 1178 ts_tablet_manager.cc:1403] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.005s
I20260617 07:53:18.482980 1178 raft_consensus.cc:359] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.483321 1178 raft_consensus.cc:385] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.483477 1178 raft_consensus.cc:740] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.483886 1178 consensus_queue.cc:260] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.487931 1178 ts_tablet_manager.cc:1434] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 07:53:18.488329 1044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28538804fd254dc8b4a341debf508a85" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.488556 1044 raft_consensus.cc:3060] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.488801 1862 ts_tablet_manager.cc:1929] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:18.488941 1862 log.cc:1199] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/7f7611958cf143438497c93f5f2bc098
I20260617 07:53:18.489277 1862 ts_tablet_manager.cc:1950] T 7f7611958cf143438497c93f5f2bc098 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:18.489354 1178 tablet_bootstrap.cc:492] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:18.490636 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f7a4ea634f429794b402439d19bbfe" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:18.493949 1178 tablet_bootstrap.cc:654] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:18.494766 852 leader_election.cc:343] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.496011 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28538804fd254dc8b4a341debf508a85" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:18.497188 827 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:18.498608 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 44b06e32039e4ad28924f5173035820a with delete_type TABLET_DATA_DELETED (replaced by tablet 8d27dcd5af04496b8e231115a88b4aeb) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:18.500288 852 leader_election.cc:343] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.502704 1172 tablet_bootstrap.cc:492] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:18.503237 1172 ts_tablet_manager.cc:1403] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.154s user 0.005s sys 0.000s
I20260617 07:53:18.504889 1172 raft_consensus.cc:359] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.505244 1172 raft_consensus.cc:385] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.505393 1172 raft_consensus.cc:740] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.505882 1172 consensus_queue.cc:260] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.506340 1171 tablet_bootstrap.cc:492] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.506500 1171 ts_tablet_manager.cc:1403] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.248s user 0.011s sys 0.006s
I20260617 07:53:18.507177 1171 raft_consensus.cc:359] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.507633 772 raft_consensus.cc:3060] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.510180 1171 raft_consensus.cc:385] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.510303 1171 raft_consensus.cc:740] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.510530 1171 consensus_queue.cc:260] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.511073 1171 ts_tablet_manager.cc:1434] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 07:53:18.511375 1171 tablet_bootstrap.cc:492] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.512853 1171 tablet_bootstrap.cc:654] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.515026 1172 ts_tablet_manager.cc:1434] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260617 07:53:18.523542 1172 tablet_bootstrap.cc:492] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.526387 1171 tablet_bootstrap.cc:492] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.526576 1171 ts_tablet_manager.cc:1403] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260617 07:53:18.527022 1172 tablet_bootstrap.cc:654] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.527251 1171 raft_consensus.cc:359] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.527457 1171 raft_consensus.cc:385] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.527539 1171 raft_consensus.cc:740] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.527814 1171 consensus_queue.cc:260] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.528326 1171 ts_tablet_manager.cc:1434] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:18.532449 770 raft_consensus.cc:3060] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.532546 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:18.532924 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:18.534842 1171 tablet_bootstrap.cc:492] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.535683 1178 tablet_bootstrap.cc:492] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:18.535952 1178 ts_tablet_manager.cc:1403] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.008s
I20260617 07:53:18.537211 1178 raft_consensus.cc:359] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.537500 1178 raft_consensus.cc:385] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.537629 1178 raft_consensus.cc:740] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.537899 1171 tablet_bootstrap.cc:654] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.538049 1178 consensus_queue.cc:260] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.539237 1178 ts_tablet_manager.cc:1434] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:18.539696 1178 tablet_bootstrap.cc:492] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:18.543390 1172 tablet_bootstrap.cc:492] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:18.543684 1172 ts_tablet_manager.cc:1403] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.000s
I20260617 07:53:18.545151 1172 raft_consensus.cc:359] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.545490 1172 raft_consensus.cc:385] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.545626 1172 raft_consensus.cc:740] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.546126 1172 consensus_queue.cc:260] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.547401 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 359) took 1355 ms. Trace:
I20260617 07:53:18.550488 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:18.550675 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
I20260617 07:53:18.550951 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_cf59fff4b93345819e95a268c92f8c64 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 2 got 0
I20260617 07:53:18.551132 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:18.551352 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf]). Expected version 1 got 0
I20260617 07:53:18.551520 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:18.551795 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:18.552119 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 7a4a3aea221f46d3a7265bd757616bfe (table default.Table_4567ec36d77142efb3f907152dc94596 [id=f96c8d7d0be24aa4958290874ff844b5]). Expected version 1 got 0
I20260617 07:53:18.552306 1050 raft_consensus.cc:2468] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:18.552449 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:18.552654 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:18.552817 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:18.553187 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:18.553442 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]). Expected version 3 got 0
I20260617 07:53:18.553418 2435 raft_consensus.cc:515] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.553602 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_a18dfbacf2d34929b9fd021add13fd7e [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 2 got 0
I20260617 07:53:18.553998 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ca400838f5214d1a8f57e72c5068f0f9 (table default.Table_1a37fbbe9740440a8c245559a94b7f5f [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]). Expected version 1 got 0
I20260617 07:53:18.554060 2435 leader_election.cc:290] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.554580 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]). Expected version 1 got 0
I20260617 07:53:18.554793 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:18.555395 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:18.555992 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
I20260617 07:53:18.556658 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet fe42e90971464554b1a029b401568938 (table default.Table_e69b3e0b162d4abba8bc3e39e9799f56 [id=ff169992bdbf4f10ae9d6de79eddeb38]). Expected version 1 got 0
I20260617 07:53:18.556941 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a7c7083dff434fddbad7f2dcf2a6b6e6 (table default.Table_cab8bc4d921c47a2a986f4c3187d34c9 [id=23be61f7550c4f97bfa3c271e2372721]). Expected version 1 got 0
I20260617 07:53:18.557106 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a84c7a425c4e4bc0acd412f16cf2fa01 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:18.557410 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 (table default.Table_1557e8110d1340518c2f713297b804f6 [id=d079dbab725b43c0807868020b551ccb]). Expected version 1 got 0
I20260617 07:53:18.557621 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9ed59705e05148f991844d47882dc151 (table default.Table_02ab5db216a449ff8e508fcc459791ae [id=13962b79508f4053b5cb01cd5e6b8b27]). Expected version 1 got 0
I20260617 07:53:18.562137 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca402543247461aa5384abb65fff364" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:18.562592 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f95a13b909c4ef9be6c56a317b42c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.563463 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b4f54b47a4e40943899251c1874cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:18.568619 851 leader_election.cc:304] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.569409 1898 raft_consensus.cc:2804] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:18.569566 1898 raft_consensus.cc:697] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:18.569327 1178 tablet_bootstrap.cc:654] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.569869 1898 consensus_queue.cc:237] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.570327 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (table default.Table_d5600121c81049589ce932a199273324 [id=494c90461b61486ab6dad26bbd3acab5]). Expected version 2 got 0
I20260617 07:53:18.570572 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:18.571203 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9687dbd2616749f4bef7d9444bd89ddf (table default.Table_c1a736945bdc4725b14eb4db56fa777d [id=cff5df610d05436da1e53a7d7383b35a]). Expected version 1 got 0
I20260617 07:53:18.571321 1172 ts_tablet_manager.cc:1434] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.027s user 0.000s sys 0.003s
I20260617 07:53:18.571591 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet b62ae096bfd347029ef8d7f0462dd111 (table default.Table_832c0052f588434faa10b821b4d09514 [id=4336b6e42a2b4c2d86fc98c56990bc8e]). Expected version 1 got 0
I20260617 07:53:18.572074 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a4a35e3b7bb74667aa498c58a856cacc (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 2 got 0
I20260617 07:53:18.572412 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 531ccdf479814053b468a7d5802f5dde (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
W20260617 07:53:18.572804 852 leader_election.cc:343] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.572865 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet cdb1b67f4cb7463b98a63ec75d38890f (table default.Table_254698a40b82484f8ed8c47e68fb0b68 [id=a7b56d13c4944469995d657261551a5a]). Expected version 1 got 0
I20260617 07:53:18.573243 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
I20260617 07:53:18.573266 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca402543247461aa5384abb65fff364" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.573431 1050 raft_consensus.cc:3060] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.573764 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_0e7fa8cb8a9b49cb8ec27a4eef4a7d39 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 1 got 0
I20260617 07:53:18.547504 1862 rpcz_store.cc:276] 0617 07:53:17.192426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.192494 (+ 68us) service_pool.cc:224] Handling call
0617 07:53:18.294183 (+1101689us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:18.294192 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.377972 (+ 83780us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.488734 (+110762us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.547382 (+ 58648us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1101510}
I20260617 07:53:18.574245 1862 tablet_replica.cc:333] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:18.574340 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:18.574422 1862 raft_consensus.cc:2243] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:18.574560 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 2 got 0
I20260617 07:53:18.574589 1862 raft_consensus.cc:2272] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:18.575002 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]). Expected version 1 got 0
I20260617 07:53:18.575119 1862 ts_tablet_manager.cc:1916] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:18.575346 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:18.575521 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:18.575721 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:18.576293 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 979087485af94e159d3d0f2cb873899e (table default.Table_5238d7f8a8b649df9298e622257465f5 [id=7a23152402da4e608156935807a7b61b]). Expected version 1 got 0
I20260617 07:53:18.576511 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:18.576673 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:18.577116 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e5544753b3144c1989f2ed99bffc2246 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:18.578681 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 7f7611958cf143438497c93f5f2bc098 (table default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]) successfully deleted
I20260617 07:53:18.580179 1172 tablet_bootstrap.cc:492] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.586433 1172 tablet_bootstrap.cc:654] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.595227 2435 raft_consensus.cc:493] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.595410 2435 raft_consensus.cc:515] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.596161 2435 leader_election.cc:290] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.596877 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d1b4975077493eb6919b23d6523d3d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.597101 1052 raft_consensus.cc:2468] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.597612 851 leader_election.cc:304] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:18.598377 2435 raft_consensus.cc:2804] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.598466 2435 raft_consensus.cc:493] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.598443 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d1b4975077493eb6919b23d6523d3d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.598543 2435 raft_consensus.cc:3060] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:18.599071 852 leader_election.cc:343] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.602804 1172 tablet_bootstrap.cc:492] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:18.603559 1172 ts_tablet_manager.cc:1403] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.001s
I20260617 07:53:18.607679 1172 raft_consensus.cc:359] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.608887 1172 raft_consensus.cc:385] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.609251 1172 raft_consensus.cc:740] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.610594 1172 consensus_queue.cc:260] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.614003 1171 tablet_bootstrap.cc:492] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.614189 1171 ts_tablet_manager.cc:1403] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.005s
I20260617 07:53:18.614832 1171 raft_consensus.cc:359] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.615054 1171 raft_consensus.cc:385] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.615147 1171 raft_consensus.cc:740] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.615375 1171 consensus_queue.cc:260] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.617246 1171 ts_tablet_manager.cc:1434] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:18.620286 1172 ts_tablet_manager.cc:1434] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260617 07:53:18.620836 1178 tablet_bootstrap.cc:492] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:18.620975 1178 ts_tablet_manager.cc:1403] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.081s user 0.007s sys 0.006s
I20260617 07:53:18.622344 1178 raft_consensus.cc:359] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.622493 1178 raft_consensus.cc:385] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.622465 1898 raft_consensus.cc:493] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.622538 1178 raft_consensus.cc:740] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.622593 1898 raft_consensus.cc:515] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.622714 1178 consensus_queue.cc:260] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.623172 1898 leader_election.cc:290] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.623503 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b448c65e684f49bf142ce2b5084d33" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.623521 1178 ts_tablet_manager.cc:1434] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260617 07:53:18.624001 852 leader_election.cc:343] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.623993 1171 tablet_bootstrap.cc:492] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.624311 1178 tablet_bootstrap.cc:492] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:18.627832 1178 tablet_bootstrap.cc:654] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.628350 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b448c65e684f49bf142ce2b5084d33" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.628556 1052 raft_consensus.cc:2468] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.629387 851 leader_election.cc:304] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.630716 1172 tablet_bootstrap.cc:492] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.631611 1898 raft_consensus.cc:2804] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.631698 1898 raft_consensus.cc:493] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.631762 1898 raft_consensus.cc:3060] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.633304 1171 tablet_bootstrap.cc:654] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.643788 1044 raft_consensus.cc:2468] T 28538804fd254dc8b4a341debf508a85 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:18.648043 2086 raft_consensus.cc:515] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.648473 851 leader_election.cc:304] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.648737 2086 leader_election.cc:290] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.648765 2201 raft_consensus.cc:2804] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:18.649099 1170 ts_tablet_manager.cc:1929] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:18.649235 1170 log.cc:1199] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/1f6264adc3994c22864ea73106ba2320
I20260617 07:53:18.649551 1044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d94915d96694d6f9a86063640e5fe18" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.649778 1044 raft_consensus.cc:3060] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.651441 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:18.651693 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:18.652068 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet b62ae096bfd347029ef8d7f0462dd111 (table default.Table_832c0052f588434faa10b821b4d09514 [id=4336b6e42a2b4c2d86fc98c56990bc8e]). Expected version 1 got 0
I20260617 07:53:18.652498 2440 raft_consensus.cc:493] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.652572 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:18.652611 2440 raft_consensus.cc:515] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.652743 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
I20260617 07:53:18.652904 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_cf59fff4b93345819e95a268c92f8c64 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 2 got 0
I20260617 07:53:18.653111 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:18.653218 2440 leader_election.cc:290] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:18.653359 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf]). Expected version 1 got 0
I20260617 07:53:18.653601 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:18.653916 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb75a965740344c2bd0b68a8dda28be5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.654356 2474 tablet.cc:1724] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260617 07:53:18.654551 986 leader_election.cc:343] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.656441 1172 tablet_bootstrap.cc:654] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.658293 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d94915d96694d6f9a86063640e5fe18" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:18.659410 2475 tablet.cc:1724] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:18.660053 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:18.660737 1178 tablet_bootstrap.cc:492] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:18.660861 1178 ts_tablet_manager.cc:1403] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.003s
I20260617 07:53:18.661648 1178 raft_consensus.cc:359] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.661818 1178 raft_consensus.cc:385] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.661878 1178 raft_consensus.cc:740] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.662118 1178 consensus_queue.cc:260] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.662740 1178 ts_tablet_manager.cc:1434] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:18.663172 1178 tablet_bootstrap.cc:492] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:18.667062 2430 raft_consensus.cc:493] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.667187 2430 raft_consensus.cc:515] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.667806 2430 leader_election.cc:290] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:18.668658 713 leader_election.cc:343] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: de030009192748118b388eec555d90da
W20260617 07:53:18.669226 716 leader_election.cc:343] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: de030009192748118b388eec555d90da
I20260617 07:53:18.669328 716 leader_election.cc:304] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.669548 2430 raft_consensus.cc:2749] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.670087 2201 raft_consensus.cc:697] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:18.670303 1178 tablet_bootstrap.cc:654] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.670339 2201 consensus_queue.cc:237] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.671296 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:18.671684 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2a61124fa6f846a6be1a208f2eaa7c20 (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]). Expected version 1 got 0
I20260617 07:53:18.671842 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 7a4a3aea221f46d3a7265bd757616bfe (table default.Table_4567ec36d77142efb3f907152dc94596 [id=f96c8d7d0be24aa4958290874ff844b5]). Expected version 1 got 0
I20260617 07:53:18.672528 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ca400838f5214d1a8f57e72c5068f0f9 (table default.Table_1a37fbbe9740440a8c245559a94b7f5f [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]). Expected version 1 got 0
I20260617 07:53:18.672946 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb75a965740344c2bd0b68a8dda28be5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:18.673308 852 leader_election.cc:343] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.673316 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 979087485af94e159d3d0f2cb873899e (table default.Table_5238d7f8a8b649df9298e622257465f5 [id=7a23152402da4e608156935807a7b61b]). Expected version 1 got 0
I20260617 07:53:18.673671 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]). Expected version 5 got 0
I20260617 07:53:18.674019 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 (table default.Table_8e323273bd9943bbb9f3492e85db62e7 [id=e05602ae03794f46894742cd275d8777]). Expected version 1 got 0
W20260617 07:53:18.674008 988 leader_election.cc:343] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.674230 988 leader_election.cc:304] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:18.674624 2440 raft_consensus.cc:2749] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.649577 1170 ts_tablet_manager.cc:1950] T 1f6264adc3994c22864ea73106ba2320 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:18.675021 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a7c7083dff434fddbad7f2dcf2a6b6e6 (table default.Table_cab8bc4d921c47a2a986f4c3187d34c9 [id=23be61f7550c4f97bfa3c271e2372721]). Expected version 1 got 0
I20260617 07:53:18.675325 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet fe42e90971464554b1a029b401568938 (table default.Table_e69b3e0b162d4abba8bc3e39e9799f56 [id=ff169992bdbf4f10ae9d6de79eddeb38]). Expected version 1 got 0
I20260617 07:53:18.675582 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a84c7a425c4e4bc0acd412f16cf2fa01 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]). Expected version 1 got 0
I20260617 07:53:18.675998 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 (table default.Table_1557e8110d1340518c2f713297b804f6 [id=d079dbab725b43c0807868020b551ccb]). Expected version 1 got 0
I20260617 07:53:18.676276 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9ed59705e05148f991844d47882dc151 (table default.Table_02ab5db216a449ff8e508fcc459791ae [id=13962b79508f4053b5cb01cd5e6b8b27]). Expected version 1 got 0
I20260617 07:53:18.676537 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 6c2bae0d7dfe4512b1674796e5dacf27 (table default.Table_d5600121c81049589ce932a199273324 [id=494c90461b61486ab6dad26bbd3acab5]). Expected version 2 got 0
I20260617 07:53:18.677698 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9687dbd2616749f4bef7d9444bd89ddf (table default.Table_c1a736945bdc4725b14eb4db56fa777d [id=cff5df610d05436da1e53a7d7383b35a]). Expected version 1 got 0
I20260617 07:53:18.678331 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a4a35e3b7bb74667aa498c58a856cacc (table default.Table_ec9f51e614dd4d61ab97ab2bcaec742f [id=e2e28ecbf16446ae9e53e20ff4537b7d]). Expected version 2 got 0
I20260617 07:53:18.678695 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet cdb1b67f4cb7463b98a63ec75d38890f (table default.Table_254698a40b82484f8ed8c47e68fb0b68 [id=a7b56d13c4944469995d657261551a5a]). Expected version 1 got 0
I20260617 07:53:18.679365 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 531ccdf479814053b468a7d5802f5dde (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]). Expected version 1 got 0
I20260617 07:53:18.679563 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_7be7b293324744f4b216a6aaf234a5b1 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 1 got 0
I20260617 07:53:18.679786 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_a044383079644cf5bbb32311ac6520ec [id=965c116ab3dc4e32ad0febae905610e4]). Expected version 1 got 0
I20260617 07:53:18.680225 1172 tablet_bootstrap.cc:492] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:18.680199 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_0e7fa8cb8a9b49cb8ec27a4eef4a7d39 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 1 got 0
I20260617 07:53:18.680454 1172 ts_tablet_manager.cc:1403] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.006s
I20260617 07:53:18.680786 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 2 got 0
I20260617 07:53:18.681114 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:18.682446 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:18.682651 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_d4662c1ccdd2449f84a550db4c839b28 [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 2 got 0
I20260617 07:53:18.682864 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:18.683243 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:18.683847 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet e5544753b3144c1989f2ed99bffc2246 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]). Expected version 1 got 0
I20260617 07:53:18.681998 1172 raft_consensus.cc:359] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.684113 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]). Expected version 1 got 0
I20260617 07:53:18.684197 1172 raft_consensus.cc:385] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.684319 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:18.684363 1172 raft_consensus.cc:740] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.684818 1172 consensus_queue.cc:260] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.685396 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 752b6cf345384750bf9b62158ae50f26
I20260617 07:53:18.685894 458 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 253) took 1531 ms. Trace:
I20260617 07:53:18.686007 458 rpcz_store.cc:276] 0617 07:53:17.154094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.126521 (+972427us) service_pool.cc:224] Handling call
0617 07:53:18.126940 (+ 419us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:18.127107 (+ 167us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:18.127167 (+ 60us) catalog_manager.cc:2849] Locking tablets
0617 07:53:18.315443 (+188276us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:18.452557 (+137114us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:18.454664 (+ 2107us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:18.685350 (+230686us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:18.685837 (+ 487us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:18.317298 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:18.326793 (+ 9495us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:18.326798 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:18.326801 (+ 3us) tablet.cc:662] Decoding operations
0617 07:53:18.326985 (+ 184us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:18.326994 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:18.326998 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:18.327206 (+ 208us) tablet.cc:701] Row locks acquired
0617 07:53:18.327209 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:18.327269 (+ 60us) write_op.cc:270] Start()
0617 07:53:18.327407 (+ 138us) write_op.cc:276] Timestamp: P: 1781682798327199 usec, L: 0
0617 07:53:18.327413 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 07:53:18.346223 (+ 18810us) log.cc:844] Serialized 731 byte log entry
0617 07:53:18.450459 (+104236us) op_driver.cc:464] REPLICATION: finished
0617 07:53:18.450758 (+ 299us) write_op.cc:301] APPLY: starting
0617 07:53:18.450769 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:18.450804 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:18.451345 (+ 541us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:18.451412 (+ 67us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:18.451468 (+ 56us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:18.451479 (+ 11us) write_op.cc:312] APPLY: finished
0617 07:53:18.451574 (+ 95us) log.cc:844] Serialized 29 byte log entry
0617 07:53:18.451636 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.451659 (+ 23us) write_op.cc:454] Released schema lock
0617 07:53:18.451667 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 07:53:18.451739 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.451742 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":236,"apply.run_cpu_time_us":479,"apply.run_wall_time_us":974,"num_ops":2,"prepare.queue_time_us":1265,"prepare.run_cpu_time_us":944,"prepare.run_wall_time_us":49297,"replication_time_us":122937}]]}
I20260617 07:53:18.686829 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d199dae87e49454e8a74b84f1e0e28df" } modify_external_catalogs: true
I20260617 07:53:18.686986 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d199dae87e49454e8a74b84f1e0e28df" } modify_external_catalogs: true
I20260617 07:53:18.687489 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d2304939c17648a6962f702524aa9b76
I20260617 07:53:18.687924 452 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:33390 (request call id 270) took 1125 ms. Trace:
I20260617 07:53:18.688026 452 rpcz_store.cc:276] 0617 07:53:17.562083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.283022 (+720939us) service_pool.cc:224] Handling call
0617 07:53:18.283443 (+ 421us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 07:53:18.283598 (+ 155us) catalog_manager.cc:2840] Modifying in-memory table state
0617 07:53:18.283671 (+ 73us) catalog_manager.cc:2849] Locking tablets
0617 07:53:18.312895 (+ 29224us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 07:53:18.347963 (+ 35068us) catalog_manager.cc:2881] Removing table from by-name map
0617 07:53:18.348040 (+ 77us) catalog_manager.cc:2897] Committing in-memory state
0617 07:53:18.687421 (+339381us) catalog_manager.cc:2901] Aborting table tasks
0617 07:53:18.687887 (+ 466us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:18.315658 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 07:53:18.315760 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0617 07:53:18.315765 (+ 5us) write_op.cc:435] Acquired schema lock
0617 07:53:18.315766 (+ 1us) tablet.cc:662] Decoding operations
0617 07:53:18.315852 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0617 07:53:18.315860 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 07:53:18.315865 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 07:53:18.315987 (+ 122us) tablet.cc:701] Row locks acquired
0617 07:53:18.315990 (+ 3us) write_op.cc:260] PREPARE: finished
0617 07:53:18.316017 (+ 27us) write_op.cc:270] Start()
0617 07:53:18.316042 (+ 25us) write_op.cc:276] Timestamp: P: 1781682798315952 usec, L: 0
0617 07:53:18.316045 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:18.316171 (+ 126us) log.cc:844] Serialized 731 byte log entry
0617 07:53:18.346855 (+ 30684us) op_driver.cc:464] REPLICATION: finished
0617 07:53:18.347606 (+ 751us) write_op.cc:301] APPLY: starting
0617 07:53:18.347615 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0617 07:53:18.347647 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0617 07:53:18.347668 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 07:53:18.347715 (+ 47us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 07:53:18.347740 (+ 25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 07:53:18.347746 (+ 6us) write_op.cc:312] APPLY: finished
0617 07:53:18.347793 (+ 47us) log.cc:844] Serialized 29 byte log entry
0617 07:53:18.347827 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:18.347839 (+ 12us) write_op.cc:454] Released schema lock
0617 07:53:18.347843 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":719,"apply.run_cpu_time_us":288,"apply.run_wall_time_us":287,"num_ops":2,"prepare.queue_time_us":2149,"prepare.run_cpu_time_us":559,"prepare.run_wall_time_us":558,"replication_time_us":30793,"thread_start_us":79778,"threads_started":1}]]}
I20260617 07:53:18.688724 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_25ce7515adee4a9bb9f50098d1fb2050" } modify_external_catalogs: true
I20260617 07:53:18.688897 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_25ce7515adee4a9bb9f50098d1fb2050" } modify_external_catalogs: true
W20260617 07:53:18.689906 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bbbea6fe52f04f298eeecdc119bebb65 consensus state has no leader
I20260617 07:53:18.690378 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f94dddebaece42fe99a7e74a77bbf420"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.691051 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f94dddebaece42fe99a7e74a77bbf420 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.693351 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 752b6cf345384750bf9b62158ae50f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.693553 881 tablet_service.cc:1558] Processing DeleteTablet for tablet d2304939c17648a6962f702524aa9b76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.699209 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 752b6cf345384750bf9b62158ae50f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.699451 741 tablet_service.cc:1558] Processing DeleteTablet for tablet d2304939c17648a6962f702524aa9b76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.700237 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 752b6cf345384750bf9b62158ae50f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 752b6cf345384750bf9b62158ae50f26 already in progress: creating tablet
W20260617 07:53:18.700544 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d2304939c17648a6962f702524aa9b76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2304939c17648a6962f702524aa9b76 already in progress: creating tablet
W20260617 07:53:18.702456 852 consensus_peers.cc:597] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:18.706668 2430 raft_consensus.cc:493] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.706833 2430 raft_consensus.cc:515] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.707540 2430 leader_election.cc:290] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:18.708772 716 leader_election.cc:343] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a82e4d6c09bb4414ad7f3b760f7ae681
I20260617 07:53:18.709223 741 tablet_service.cc:1558] Processing DeleteTablet for tablet adbbe7eb5181431290f57ed9128181a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.709465 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.709600 713 leader_election.cc:343] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a82e4d6c09bb4414ad7f3b760f7ae681
I20260617 07:53:18.709635 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.709693 713 leader_election.cc:304] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.710021 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_799b237a420c4cd8aed8a93f578d1ec0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.710630 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_799b237a420c4cd8aed8a93f578d1ec0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:18.712038 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet adbbe7eb5181431290f57ed9128181a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbbe7eb5181431290f57ed9128181a3 already in progress: creating tablet
W20260617 07:53:18.712328 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0be19ece3a0a4a51abad7b8e2f3b2420 already in progress: creating tablet
I20260617 07:53:18.712381 2430 raft_consensus.cc:2749] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:18.712518 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c9657e0dd2a8459cb728bdfe8a68b840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9657e0dd2a8459cb728bdfe8a68b840 already in progress: creating tablet
I20260617 07:53:18.712745 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad with delete_type TABLET_DATA_DELETED (replaced by tablet 01abd7aed0fd4d2b90db9f40029b5b37) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.713287 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.713469 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d with delete_type TABLET_DATA_DELETED (replaced by tablet c449d3e251aa4f06a9191114bff0e0e2) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.713666 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.713857 755 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95639e16ed423fbe60b15a1bcdf5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.714046 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.696398 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet d2304939c17648a6962f702524aa9b76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.696863 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 752b6cf345384750bf9b62158ae50f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:18.715790 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5578fd5cb3724ed5b92b313bd52889ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5578fd5cb3724ed5b92b313bd52889ad already in progress: creating tablet
W20260617 07:53:18.716024 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9618a5c0c9dd4c368f5763c434f70da5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9618a5c0c9dd4c368f5763c434f70da5 already in progress: creating tablet
W20260617 07:53:18.716248 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35120ce002f24f2bb1ea0fdc59fbfc9d already in progress: creating tablet
W20260617 07:53:18.716423 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 488cc3a082b14dee8f70153e6f2925a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 488cc3a082b14dee8f70153e6f2925a4 already in progress: creating tablet
W20260617 07:53:18.716614 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cb95639e16ed423fbe60b15a1bcdf5a6 because the tablet was not found. No further retry: Not found: Tablet not found: cb95639e16ed423fbe60b15a1bcdf5a6
W20260617 07:53:18.716800 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 63bf519b83c445798bddda3120b542ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63bf519b83c445798bddda3120b542ce already in progress: creating tablet
I20260617 07:53:18.720256 1171 tablet_bootstrap.cc:492] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:18.720431 1171 ts_tablet_manager.cc:1403] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.097s user 0.002s sys 0.006s
I20260617 07:53:18.723019 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 531ccdf479814053b468a7d5802f5dde) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.723109 1171 raft_consensus.cc:359] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.723259 1171 raft_consensus.cc:385] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.723305 1171 raft_consensus.cc:740] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:18.723671 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4681e8e3f1174b299d89ec541ca8e6b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4681e8e3f1174b299d89ec541ca8e6b3 already in progress: creating tablet
I20260617 07:53:18.724171 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 68b448c65e684f49bf142ce2b5084d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.724712 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 68b448c65e684f49bf142ce2b5084d33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68b448c65e684f49bf142ce2b5084d33 already in progress: creating tablet
I20260617 07:53:18.725203 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.725000 1172 ts_tablet_manager.cc:1434] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.044s user 0.003s sys 0.000s
W20260617 07:53:18.726027 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0fd8cedb539748dc917128511325bbcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fd8cedb539748dc917128511325bbcc already in progress: creating tablet
I20260617 07:53:18.726531 741 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.726526 1171 consensus_queue.cc:260] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:18.727451 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e9488e8a501e404f85540fb045d8916f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9488e8a501e404f85540fb045d8916f already in progress: creating tablet
I20260617 07:53:18.727483 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4b4c152f005d443b9db80fc5cafbf4ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.734557 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b4c152f005d443b9db80fc5cafbf4ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.738979 2448 tablet.cc:1724] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:18.739167 2430 raft_consensus.cc:493] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.739301 2430 raft_consensus.cc:515] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.739887 2430 leader_election.cc:290] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:18.740322 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2af44d9ab34e4bbea24d6c7d95748b" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:18.740411 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2af44d9ab34e4bbea24d6c7d95748b" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.740855 1044 raft_consensus.cc:2468] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:18.742450 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe42e90971464554b1a029b401568938 consensus state has no leader
I20260617 07:53:18.746217 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b258682fadd740239b48cefca07e7c9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.746598 2087 raft_consensus.cc:515] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:18.746912 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b258682fadd740239b48cefca07e7c9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.747195 2087 leader_election.cc:290] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.748348 1862 ts_tablet_manager.cc:1929] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:18.748435 1862 log.cc:1199] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d03d6dc473fc4be1a436fd71a06f403e
I20260617 07:53:18.748724 1862 ts_tablet_manager.cc:1950] T d03d6dc473fc4be1a436fd71a06f403e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:18.750106 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de8df5e15cb43c0b95ec5af3110db66" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:18.750262 851 leader_election.cc:304] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.750321 1044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4de8df5e15cb43c0b95ec5af3110db66" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.750519 1044 raft_consensus.cc:3060] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.750597 716 leader_election.cc:304] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.751420 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_02c5782d285546afa40f4361def24646"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.751767 2430 raft_consensus.cc:493] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.751880 2430 raft_consensus.cc:515] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:18.752049 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02c5782d285546afa40f4361def24646 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.752442 2430 leader_election.cc:290] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:18.752583 2430 raft_consensus.cc:2749] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:18.753177 852 leader_election.cc:343] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.753268 2475 tablet.cc:1724] T 8f5f6a0bf3624c8eaefee902a46b9d9f P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:18.753386 2087 raft_consensus.cc:2804] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:18.753479 2087 raft_consensus.cc:697] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
W20260617 07:53:18.753526 713 leader_election.cc:343] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: df4f9101deaa4e6ebddacbce14f32810
I20260617 07:53:18.753703 2087 consensus_queue.cc:237] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.764720 2452 tablet.cc:1724] T 8f5f6a0bf3624c8eaefee902a46b9d9f P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:18.769438 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 531ccdf479814053b468a7d5802f5dde
I20260617 07:53:18.770362 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 531ccdf479814053b468a7d5802f5dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.771193 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 531ccdf479814053b468a7d5802f5dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:18.771387 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 531ccdf479814053b468a7d5802f5dde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 531ccdf479814053b468a7d5802f5dde already in progress: creating tablet
I20260617 07:53:18.772555 2086 raft_consensus.cc:493] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.772621 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 531ccdf479814053b468a7d5802f5dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.772688 2086 raft_consensus.cc:515] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.772809 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]). Expected version 1 got 0
I20260617 07:53:18.773063 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f (table default.Table_b8df6bf2a67d44598b3472dd0031e570 [id=951e230ec1f84717b9ed7d19f4dfbc16]). Expected version 1 got 0
I20260617 07:53:18.773304 2086 leader_election.cc:290] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.773358 456 catalog_manager.cc:5696] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:18.773769 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:18.773788 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f0f68dcef34228a1b2a018e8aa329e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.774034 1052 raft_consensus.cc:2468] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.774181 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:18.774446 851 leader_election.cc:304] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:18.774406 456 catalog_manager.cc:5696] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:18.774760 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:18.775127 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_0e7fa8cb8a9b49cb8ec27a4eef4a7d39 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 1 got 0
I20260617 07:53:18.775239 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f0f68dcef34228a1b2a018e8aa329e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.774787 2485 raft_consensus.cc:2804] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.775919 2485 raft_consensus.cc:493] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260617 07:53:18.777029 716 leader_election.cc:343] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: df4f9101deaa4e6ebddacbce14f32810
I20260617 07:53:18.777173 716 leader_election.cc:304] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.778540 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf]). Expected version 1 got 0
I20260617 07:53:18.779001 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
I20260617 07:53:18.779361 456 catalog_manager.cc:5696] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:18.779912 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]). Expected version 1 got 0
W20260617 07:53:18.778329 852 leader_election.cc:343] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.780248 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 60d1b4975077493eb6919b23d6523d3d
I20260617 07:53:18.780566 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_cd851e8a141f42ac99c04a617f1b319c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.780648 2485 raft_consensus.cc:3060] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.780964 2484 raft_consensus.cc:2749] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.781016 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9b8de1903c2e4b32ae11268bcb7d6c49" } new_table_name: "default.Table_eaa315a1ff0a47b2847c9e698da128eb" modify_external_catalogs: true
W20260617 07:53:18.781103 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd851e8a141f42ac99c04a617f1b319c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.781745 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 60d1b4975077493eb6919b23d6523d3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:18.781898 1171 ts_tablet_manager.cc:1434] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.060s user 0.001s sys 0.001s
I20260617 07:53:18.782163 1171 tablet_bootstrap.cc:492] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:18.783450 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a18dfbacf2d34929b9fd021add13fd7e" } new_table_name: "default.Table_9815ff9400a3426e8f09edd618831938" modify_external_catalogs: true
I20260617 07:53:18.783661 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 60d1b4975077493eb6919b23d6523d3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.784634 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.784695 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.784634 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.784873 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.786067 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 60d1b4975077493eb6919b23d6523d3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.786933 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 60d1b4975077493eb6919b23d6523d3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60d1b4975077493eb6919b23d6523d3d already in progress: creating tablet
I20260617 07:53:18.787819 1171 tablet_bootstrap.cc:654] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:18.794616 457 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet a84c7a425c4e4bc0acd412f16cf2fa01 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a84c7a425c4e4bc0acd412f16cf2fa01 consensus state has no leader
I20260617 07:53:18.797370 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet eb75a965740344c2bd0b68a8dda28be5 with delete_type TABLET_DATA_DELETED (replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.797591 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.797796 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.798061 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 with delete_type TABLET_DATA_DELETED (replaced by tablet f395f963a5a5400a966a8d4cc62aadf1) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.798256 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.798467 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.798641 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.798713 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 706373f1f5d44edf81ed04183a8bdf89 with delete_type TABLET_DATA_DELETED (replaced by tablet e5544753b3144c1989f2ed99bffc2246) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.798873 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet b7c5ff28367b42d3a3922d2b789bc7ec with delete_type TABLET_DATA_DELETED (replaced by tablet 3bd63a5d7e8342d9b919aa0862f8cfc7) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.799122 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet adbbe7eb5181431290f57ed9128181a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.800879 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.801041 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 5942eea42c7541349ad7b6560e6777c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffa87a4304b43a89be0faa3c5ce0b2c) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.801081 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db4fdde370e4d30bbf14285923644a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.801250 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.801396 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 52af94bd46c941b8a27136ca0506e744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.801050 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.801646 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b with delete_type TABLET_DATA_DELETED (replaced by tablet 0b85d49f255940eeaf343bfcf71e00e9) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:18.802076 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6b85e7ed0a64c128de5cc48c4d4435f consensus state has no leader
I20260617 07:53:18.802336 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1557e8110d1340518c2f713297b804f6" } modify_external_catalogs: true
I20260617 07:53:18.802520 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1557e8110d1340518c2f713297b804f6" } modify_external_catalogs: true
I20260617 07:53:18.802575 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3d0944f4a80441b19a193cf8f179fc48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.803138 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_da921136077749c8bf90acd3f0394183"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.803275 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d0944f4a80441b19a193cf8f179fc48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:18.803647 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da921136077749c8bf90acd3f0394183 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.804472 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet df5224716de249e9be9d7239407579a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.806573 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa with delete_type TABLET_DATA_DELETED (replaced by tablet 52af94bd46c941b8a27136ca0506e744) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.806810 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.807204 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 7934f5fa0287427cb45fe568f0de8758 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a35e3b7bb74667aa498c58a856cacc) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.807544 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e8e9692227147d6a8c6854133941b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.808168 1172 tablet_bootstrap.cc:492] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.808823 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b5dd820c6a314f5485eca5465c792124"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.814388 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 121339ab4842432e9fb7bc357750f8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.814811 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet f15dcc10552d4747bad436538662bb66 with delete_type TABLET_DATA_DELETED (replaced by tablet 262732996d6d47749830529ac025f42f) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.815776 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.816044 755 tablet_service.cc:1558] Processing DeleteTablet for tablet eb75a965740344c2bd0b68a8dda28be5 with delete_type TABLET_DATA_DELETED (replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.816236 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.819010 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 18f9bace06e34602acc7fcd7501b3671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18f9bace06e34602acc7fcd7501b3671 already in progress: creating tablet
W20260617 07:53:18.819232 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet eb75a965740344c2bd0b68a8dda28be5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb75a965740344c2bd0b68a8dda28be5 already in progress: creating tablet
I20260617 07:53:18.819751 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.819449 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
W20260617 07:53:18.819404 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5dd820c6a314f5485eca5465c792124 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.820245 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet adbbe7eb5181431290f57ed9128181a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.820616 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:18.821159 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 49f0f68dcef34228a1b2a018e8aa329e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49f0f68dcef34228a1b2a018e8aa329e already in progress: creating tablet
I20260617 07:53:18.821158 750 tablet_service.cc:1558] Processing DeleteTablet for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.826848 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 739cadc7ad124e229441333de949f2c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f95a13b909c4ef9be6c56a317b42c9b) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.827087 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.827210 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.827248 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 because the tablet was not found. No further retry: Not found: Tablet not found: f2ce51c155c04897a4cf8f7b4ac9a5c6
I20260617 07:53:18.827689 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3d05dcda274f288aebc279aba3e10a with delete_type TABLET_DATA_DELETED (replaced by tablet bc57a1e3bc8b434da43f484705476b9b) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.828104 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:18.828329 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 739cadc7ad124e229441333de949f2c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 739cadc7ad124e229441333de949f2c6 already in progress: creating tablet
W20260617 07:53:18.828554 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 596ef68705c84791b54f07e03b219b4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596ef68705c84791b54f07e03b219b4c already in progress: creating tablet
I20260617 07:53:18.828876 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:18.829154 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4de8df5e15cb43c0b95ec5af3110db66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4de8df5e15cb43c0b95ec5af3110db66 already in progress: creating tablet
I20260617 07:53:18.829238 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.829543 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f8602b87a20455884c16196a901d335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.829826 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet e897b111e65c497591c7daaa81d783c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.830142 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.830209 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.830438 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:18.830667 454 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 531ccdf479814053b468a7d5802f5dde (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 531ccdf479814053b468a7d5802f5dde consensus state has no leader
W20260617 07:53:18.831125 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
I20260617 07:53:18.833068 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.833561 454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:57237 (request call id 195) took 1637 ms (client timeout 1000 ms). Trace:
W20260617 07:53:18.833739 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4d9ace137c4e496fafac4e729718577f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9ace137c4e496fafac4e729718577f already in progress: creating tablet
I20260617 07:53:18.834491 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.834578 2087 raft_consensus.cc:493] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.834731 2087 raft_consensus.cc:515] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.835104 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.835386 2087 leader_election.cc:290] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:18.835923 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70610822c57e45c7add7e1f5ce96d889 already in progress: creating tablet
W20260617 07:53:18.836102 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 1f6264adc3994c22864ea73106ba2320 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6264adc3994c22864ea73106ba2320 already in progress: creating tablet
I20260617 07:53:18.836217 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc3d13d519843a9bc38e97dc85b67c8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:18.836679 852 leader_election.cc:343] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.837100 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.837775 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3fcf87953dc14bf190ac74101547e52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fcf87953dc14bf190ac74101547e52f already in progress: creating tablet
I20260617 07:53:18.838002 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ec78c123d448329b8442a0de0140d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.838605 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 99ec78c123d448329b8442a0de0140d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99ec78c123d448329b8442a0de0140d3 already in progress: creating tablet
I20260617 07:53:18.838914 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.839217 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc3d13d519843a9bc38e97dc85b67c8" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:18.839586 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3aa1c1fdede041d28570b85e63c401b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3aa1c1fdede041d28570b85e63c401b7 already in progress: creating tablet
W20260617 07:53:18.839818 851 leader_election.cc:343] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.839938 851 leader_election.cc:304] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:18.840042 741 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.840379 2087 raft_consensus.cc:2749] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:18.840606 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d03d6dc473fc4be1a436fd71a06f403e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d03d6dc473fc4be1a436fd71a06f403e already in progress: creating tablet
I20260617 07:53:18.840775 741 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.841325 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a02dbb70eec84932917ef282fdae0bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a02dbb70eec84932917ef282fdae0bd7 already in progress: creating tablet
W20260617 07:53:18.841980 457 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:57237 (request call id 194) took 2729 ms (client timeout 1000 ms). Trace:
I20260617 07:53:18.842047 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 with delete_type TABLET_DATA_DELETED (replaced by tablet f395f963a5a5400a966a8d4cc62aadf1) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.842043 1050 raft_consensus.cc:2468] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:18.842106 457 rpcz_store.cc:269] 0617 07:53:16.112788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.119189 (+ 6401us) service_pool.cc:224] Handling call
0617 07:53:16.147467 (+ 28278us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:18.841936 (+2694469us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25373,"reported_tablets":231,"spinlock_wait_cycles":2517760}
I20260617 07:53:18.842456 2436 raft_consensus.cc:515] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:18.842881 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 77c3bf1860c34ee3821bf273234cb0a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77c3bf1860c34ee3821bf273234cb0a4 already in progress: creating tablet
I20260617 07:53:18.843106 2436 leader_election.cc:290] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.843348 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 52af94bd46c941b8a27136ca0506e744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.843580 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_df8e6f336fd640d1aaf3d25d471ae455"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.844183 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 52af94bd46c941b8a27136ca0506e744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52af94bd46c941b8a27136ca0506e744 already in progress: creating tablet
W20260617 07:53:18.833763 454 rpcz_store.cc:269] 0617 07:53:17.196544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.210102 (+ 13558us) service_pool.cc:224] Handling call
0617 07:53:18.816464 (+1606362us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x615000013900. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f143ccd9c6c 00007f143ccdae73 00007f143cc83a8a 00007f143ccc54b2 00007f143ccc6089 00007f143f9f5ac9 00007f1449adb92a 00007f1449a31be5 00007f1449a48ded
0617 07:53:18.833511 (+ 17047us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57058,"reported_tablets":238,"spinlock_wait_cycles":50775424}
I20260617 07:53:18.844614 741 tablet_service.cc:1558] Processing DeleteTablet for tablet d657fbccb4af40558033a971aab7f3e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.847692 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0e12aa4c60457182201a94caecda45 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b6f85399f924f619dd09465bb74f689) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.848026 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.859779 1172 tablet_bootstrap.cc:654] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:18.862172 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d657fbccb4af40558033a971aab7f3e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d657fbccb4af40558033a971aab7f3e4 already in progress: creating tablet
I20260617 07:53:18.862409 851 leader_election.cc:304] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.863076 2087 raft_consensus.cc:2804] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:18.863198 2087 raft_consensus.cc:697] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:18.863423 2087 consensus_queue.cc:237] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.869447 2436 consensus_queue.cc:1048] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:18.869910 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596ef68705c84791b54f07e03b219b4c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.870077 1052 raft_consensus.cc:3060] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.870159 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 286) took 3265 ms. Trace:
I20260617 07:53:18.870244 1170 rpcz_store.cc:276] 0617 07:53:15.604513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.604550 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:18.358169 (+2753619us) ts_tablet_manager.cc:1151] Deleting tablet 1f6264adc3994c22864ea73106ba2320
0617 07:53:18.358180 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.464482 (+106302us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.649035 (+184553us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.870145 (+221110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2753497}
I20260617 07:53:18.870662 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 287) took 3265 ms. Trace:
I20260617 07:53:18.870728 1170 rpcz_store.cc:276] 0617 07:53:15.604779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.604817 (+ 38us) service_pool.cc:224] Handling call
0617 07:53:18.870553 (+3265736us) ts_tablet_manager.cc:1151] Deleting tablet 70610822c57e45c7add7e1f5ce96d889
0617 07:53:18.870561 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.870648 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3265581}
I20260617 07:53:18.871102 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 276) took 3269 ms. Trace:
I20260617 07:53:18.871167 1170 rpcz_store.cc:276] 0617 07:53:15.601295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.605102 (+ 3807us) service_pool.cc:224] Handling call
0617 07:53:18.870960 (+3265858us) ts_tablet_manager.cc:1151] Deleting tablet 0ebafc920ed34216be5fb115f9bc6f7f
0617 07:53:18.870968 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.871077 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3265731}
I20260617 07:53:18.871281 2436 raft_consensus.cc:493] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.871393 2436 raft_consensus.cc:515] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.871439 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 281) took 3268 ms. Trace:
I20260617 07:53:18.871510 1170 rpcz_store.cc:276] 0617 07:53:15.603063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.616744 (+ 13681us) service_pool.cc:224] Handling call
0617 07:53:18.871358 (+3254614us) ts_tablet_manager.cc:1151] Deleting tablet a82e4d6c09bb4414ad7f3b760f7ae681
0617 07:53:18.871370 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.871427 (+ 57us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3254244}
I20260617 07:53:18.871758 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 277) took 3270 ms. Trace:
I20260617 07:53:18.871827 1170 rpcz_store.cc:276] 0617 07:53:15.601892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.622428 (+ 20536us) service_pool.cc:224] Handling call
0617 07:53:18.871687 (+3249259us) ts_tablet_manager.cc:1151] Deleting tablet 570ae1e189a64da6bad10156b401ec46
0617 07:53:18.871695 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.871746 (+ 51us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3242917}
I20260617 07:53:18.872117 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 296) took 3236 ms. Trace:
I20260617 07:53:18.872203 1170 rpcz_store.cc:276] 0617 07:53:15.635590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.635643 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:18.872021 (+3236378us) ts_tablet_manager.cc:1151] Deleting tablet 630e540a77374c11895ab5a0e394b3bb
0617 07:53:18.872030 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.872104 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3236208}
I20260617 07:53:18.872435 1170 tablet_replica.cc:333] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:18.872792 2436 leader_election.cc:290] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.873997 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037539021d1743bb9a66403b8a01662f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.874933 2087 raft_consensus.cc:493] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.875043 2087 raft_consensus.cc:515] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.875560 2087 leader_election.cc:290] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.879745 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21]) successfully deleted
W20260617 07:53:18.881009 851 leader_election.cc:343] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.882068 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f7c3f6260c4db690de1a5081bb2493" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:18.882273 1047 raft_consensus.cc:2468] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:18.883431 851 leader_election.cc:304] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:18.883960 2086 raft_consensus.cc:2804] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:18.884035 2086 raft_consensus.cc:493] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:18.884095 2086 raft_consensus.cc:3060] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.889810 741 tablet_service.cc:1558] Processing DeleteTablet for tablet b7c5ff28367b42d3a3922d2b789bc7ec with delete_type TABLET_DATA_DELETED (replaced by tablet 3bd63a5d7e8342d9b919aa0862f8cfc7) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.890066 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.890376 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db4fdde370e4d30bbf14285923644a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.890764 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.890959 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 245cff69d83b43e98b1c72b8d3011347 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.891113 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 570ae1e189a64da6bad10156b401ec46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.891269 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.891294 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 53108a2d6c8b4398a568c14df8e0a23e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.891464 746 tablet_service.cc:1558] Processing DeleteTablet for tablet df4f9101deaa4e6ebddacbce14f32810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.891515 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 283c08c31718433e83f0cedd799215fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.891664 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e05a97a4ab4ed7bff523d1fb1c59ae with delete_type TABLET_DATA_DELETED (replaced by tablet 8cf4025a0f784cc6868950e51a45da2e) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.891757 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.891932 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 121339ab4842432e9fb7bc357750f8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.892108 2440 raft_consensus.cc:493] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.892278 1178 tablet_bootstrap.cc:492] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:18.892269 2440 raft_consensus.cc:515] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.892407 1178 ts_tablet_manager.cc:1403] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.229s user 0.007s sys 0.006s
I20260617 07:53:18.892930 2440 leader_election.cc:290] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:18.893435 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfb98aecc4546c88371436fcfbf8e86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.893620 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 59acdc64fe9247d28c4c277161b42f4f with delete_type TABLET_DATA_DELETED (replaced by tablet a632b42300d64471b516008ebca3312f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.893642 1178 raft_consensus.cc:359] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.893803 750 tablet_service.cc:1558] Processing DeleteTablet for tablet a82e4d6c09bb4414ad7f3b760f7ae681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.893836 1178 raft_consensus.cc:385] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.893894 1178 raft_consensus.cc:740] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.893942 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 706373f1f5d44edf81ed04183a8bdf89 with delete_type TABLET_DATA_DELETED (replaced by tablet e5544753b3144c1989f2ed99bffc2246) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.891932 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebafc920ed34216be5fb115f9bc6f7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.894104 1178 consensus_queue.cc:260] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:18.894608 1178 ts_tablet_manager.cc:1434] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:18.894577 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8f144d04af4ea18f99aee3b82f4a28" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:18.895047 986 leader_election.cc:343] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.896186 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8f144d04af4ea18f99aee3b82f4a28" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:18.898722 988 leader_election.cc:343] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.898849 988 leader_election.cc:304] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:18.897575 1846 tablet_replica.cc:333] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:18.899300 1846 raft_consensus.cc:2243] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:18.899423 2440 raft_consensus.cc:2749] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.899441 1846 raft_consensus.cc:2272] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:18.899994 1846 ts_tablet_manager.cc:1916] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:18.896728 1178 tablet_bootstrap.cc:492] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:18.913758 2436 consensus_queue.cc:1048] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:18.917866 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70610822c57e45c7add7e1f5ce96d889 already in progress: creating tablet
W20260617 07:53:18.918193 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0ebafc920ed34216be5fb115f9bc6f7f because the tablet was not found. No further retry: Not found: Tablet not found: 0ebafc920ed34216be5fb115f9bc6f7f
W20260617 07:53:18.918679 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a82e4d6c09bb4414ad7f3b760f7ae681 because the tablet was not found. No further retry: Not found: Tablet not found: a82e4d6c09bb4414ad7f3b760f7ae681
W20260617 07:53:18.918882 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 570ae1e189a64da6bad10156b401ec46 because the tablet was not found. No further retry: Not found: Tablet not found: 570ae1e189a64da6bad10156b401ec46
W20260617 07:53:18.919320 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
W20260617 07:53:18.920275 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df8e6f336fd640d1aaf3d25d471ae455 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.922479 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_724c24f5d49244fa91caa9fc9603eead" } new_table_name: "default.Table_162d3b6e1d5749068f166f820520acc0" modify_external_catalogs: true
I20260617 07:53:18.929247 2496 raft_consensus.cc:493] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.929404 2496 raft_consensus.cc:515] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.930056 2496 leader_election.cc:290] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:18.930703 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f9bace06e34602acc7fcd7501b3671" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:18.931156 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f9bace06e34602acc7fcd7501b3671" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:18.931422 986 leader_election.cc:343] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:18.934947 988 leader_election.cc:343] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.935068 988 leader_election.cc:304] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:18.936005 2496 raft_consensus.cc:2749] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:18.936736 1044 raft_consensus.cc:2468] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:18.939395 1052 raft_consensus.cc:2468] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:18.939595 1170 raft_consensus.cc:2243] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:18.939922 1170 raft_consensus.cc:2272] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:18.940423 1170 ts_tablet_manager.cc:1916] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:18.941223 2435 raft_consensus.cc:515] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.942137 2435 leader_election.cc:290] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:18.947098 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 360) took 1751 ms. Trace:
I20260617 07:53:18.947187 1862 rpcz_store.cc:276] 0617 07:53:17.195955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.196869 (+ 914us) service_pool.cc:224] Handling call
0617 07:53:18.574200 (+1377331us) ts_tablet_manager.cc:1151] Deleting tablet d03d6dc473fc4be1a436fd71a06f403e
0617 07:53:18.574210 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.649730 (+ 75520us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.748293 (+ 98563us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:18.947076 (+198783us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1377157}
I20260617 07:53:18.947491 1862 tablet_replica.cc:333] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:18.947701 1862 raft_consensus.cc:2243] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:18.947844 1862 raft_consensus.cc:2272] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:18.948351 1862 ts_tablet_manager.cc:1916] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:18.957878 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d03d6dc473fc4be1a436fd71a06f403e (table default.Table_ffd2c46b97334436a592c497f3a8fa2a [id=af6a6625d89c41feac726918675fcbf5]) successfully deleted
I20260617 07:53:18.959206 851 leader_election.cc:304] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.960054 851 leader_election.cc:304] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:18.960492 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d1b4975077493eb6919b23d6523d3d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:18.960688 1052 raft_consensus.cc:3060] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:18.964239 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 2684f3200e604bb6bf37a2f97a193eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.964486 741 tablet_service.cc:1558] Processing DeleteTablet for tablet df37ed81b17d4178adeb6057491b4cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.960286 2436 raft_consensus.cc:2804] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:18.966012 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 301bd4d6faec429ba71ce354c23d0f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.966722 2435 raft_consensus.cc:2804] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:18.966851 2435 raft_consensus.cc:697] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:18.967113 2435 consensus_queue.cc:237] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.970942 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8f6fcc4db43e45beb5146c43fcb3d19d" } modify_external_catalogs: true
I20260617 07:53:18.971154 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8f6fcc4db43e45beb5146c43fcb3d19d" } modify_external_catalogs: true
I20260617 07:53:18.972314 2436 raft_consensus.cc:697] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:18.972571 2436 consensus_queue.cc:237] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.972649 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_05a7c719161e4611a82fb48194a5fbc6" } modify_external_catalogs: true
I20260617 07:53:18.972819 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_05a7c719161e4611a82fb48194a5fbc6" } modify_external_catalogs: true
I20260617 07:53:18.974850 1172 tablet_bootstrap.cc:492] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:18.975044 1172 ts_tablet_manager.cc:1403] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.168s user 0.005s sys 0.000s
I20260617 07:53:18.975860 1172 raft_consensus.cc:359] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.975929 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e33a84b1d8554d62aebbf2f6ffb338d9" } new_table_name: "default.Table_f053926b27974d21a6d7db8a5867caf0" modify_external_catalogs: true
I20260617 07:53:18.976125 1172 raft_consensus.cc:385] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:18.976259 1172 raft_consensus.cc:740] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:18.976496 1172 consensus_queue.cc:260] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.977164 1172 ts_tablet_manager.cc:1434] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:18.977491 1172 tablet_bootstrap.cc:492] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:18.979133 1172 tablet_bootstrap.cc:654] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:18.979925 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 7934f5fa0287427cb45fe568f0de8758 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a35e3b7bb74667aa498c58a856cacc) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.980429 741 tablet_service.cc:1558] Processing DeleteTablet for tablet f15dcc10552d4747bad436538662bb66 with delete_type TABLET_DATA_DELETED (replaced by tablet 262732996d6d47749830529ac025f42f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.980849 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.981150 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 3bd63a5d7e8342d9b919aa0862f8cfc7
I20260617 07:53:18.981881 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3afd0e47dfc84e8f92c7684c766a3f99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:18.982200 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:18.982369 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3afd0e47dfc84e8f92c7684c766a3f99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:18.982939 453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:33527 (request call id 147) took 1917 ms (client timeout 1000 ms). Trace:
W20260617 07:53:18.983039 453 rpcz_store.cc:269] 0617 07:53:17.065048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.099092 (+ 34044us) service_pool.cc:224] Handling call
0617 07:53:18.295618 (+1196526us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x61b0002fdfe8. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f1449a52a48 00007f1449a4de01 00007f1449a48751 00007f1449bf6097 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:18.982880 (+687262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197938,"reported_tablets":275,"spinlock_wait_cycles":7301504}
I20260617 07:53:18.984745 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_263867c4fce84a18a43a51cf5e9cc83a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:18.985316 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_263867c4fce84a18a43a51cf5e9cc83a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:18.986776 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.987114 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 5942eea42c7541349ad7b6560e6777c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffa87a4304b43a89be0faa3c5ce0b2c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.987411 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:18.987485 741 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b with delete_type TABLET_DATA_DELETED (replaced by tablet 0b85d49f255940eeaf343bfcf71e00e9) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.987814 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa with delete_type TABLET_DATA_DELETED (replaced by tablet 52af94bd46c941b8a27136ca0506e744) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:18.988080 461 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:33527 (request call id 148) took 832 ms (client timeout 1000 ms). Trace:
W20260617 07:53:18.988229 461 rpcz_store.cc:269] 0617 07:53:18.155629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.156032 (+ 403us) service_pool.cc:224] Handling call
0617 07:53:18.987960 (+831928us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120790,"reported_tablets":271}
I20260617 07:53:18.988425 748 tablet_service.cc:1558] Processing DeleteTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.988596 750 tablet_service.cc:1558] Processing DeleteTablet for tablet a38bb8a140ef4bcab65aaa03bdb79040 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f7611958cf143438497c93f5f2bc098) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.988755 748 tablet_service.cc:1558] Processing DeleteTablet for tablet df5224716de249e9be9d7239407579a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.988931 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.989091 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.989238 755 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.989421 753 tablet_service.cc:1558] Processing DeleteTablet for tablet adbbe7eb5181431290f57ed9128181a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.989571 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.989708 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.989876 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e8e9692227147d6a8c6854133941b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.990024 749 tablet_service.cc:1558] Processing DeleteTablet for tablet bc57a1e3bc8b434da43f484705476b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.990199 753 tablet_service.cc:1558] Processing DeleteTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.990445 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 446114516f164dc0a956f2ccbf2e7c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.990615 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3d05dcda274f288aebc279aba3e10a with delete_type TABLET_DATA_DELETED (replaced by tablet bc57a1e3bc8b434da43f484705476b9b) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.990754 749 tablet_service.cc:1558] Processing DeleteTablet for tablet ed9a99cdcbb74a3fb74654a26716a1c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 57c83de284064dd4a14fcea5ce6b08ad) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.990916 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.990985 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 369442b72f754ee08dc6a484d51f2e99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:16 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.990921 743 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.991158 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e03a26e301e747febc4d5bafdc1a49c6 with delete_type TABLET_DATA_DELETED (replaced by tablet d7b981da1d2e4862824e933dc8babefc) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.991187 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.991334 743 tablet_service.cc:1558] Processing DeleteTablet for tablet be14a95f458d440e86133ef65c484571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:04 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.991473 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c76bfcbd22e4bfb97346a1b56f68dab with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5bd47736774ba9a05426b46a057e80) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.991482 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e897b111e65c497591c7daaa81d783c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.991739 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.991875 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0e12aa4c60457182201a94caecda45 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b6f85399f924f619dd09465bb74f689) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.992018 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f8602b87a20455884c16196a901d335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.992029 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.992337 753 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.992476 743 tablet_service.cc:1558] Processing DeleteTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.992616 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.992787 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 63bf519b83c445798bddda3120b542ce with delete_type TABLET_DATA_DELETED (replaced by tablet eb75a965740344c2bd0b68a8dda28be5) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.992916 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.993058 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.993211 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d with delete_type TABLET_DATA_DELETED (replaced by tablet c449d3e251aa4f06a9191114bff0e0e2) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.993497 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.993922 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.994086 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 531ccdf479814053b468a7d5802f5dde) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.994377 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.994457 2496 raft_consensus.cc:493] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:18.994556 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad with delete_type TABLET_DATA_DELETED (replaced by tablet 01abd7aed0fd4d2b90db9f40029b5b37) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.994599 2496 raft_consensus.cc:515] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:18.994711 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:18.995237 2496 leader_election.cc:290] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:18.995770 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5578fd5cb3724ed5b92b313bd52889ad" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:18.996573 986 leader_election.cc:343] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:18.998006 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5578fd5cb3724ed5b92b313bd52889ad" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:18.998203 915 raft_consensus.cc:2468] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:18.999615 988 leader_election.cc:304] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:18.999929 2496 raft_consensus.cc:2804] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:19.000023 2496 raft_consensus.cc:493] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:19.000097 2496 raft_consensus.cc:3060] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:19.000260 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275] alter complete (version 3)
W20260617 07:53:19.000845 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8cf4025a0f784cc6868950e51a45da2e consensus state has no leader
I20260617 07:53:19.001381 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_6defd798d4bd4e6f88986301755535ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.002168 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6defd798d4bd4e6f88986301755535ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.005578 2437 consensus_queue.cc:1048] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:19.009481 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8e323273bd9943bbb9f3492e85db62e7" } modify_external_catalogs: true
I20260617 07:53:19.011265 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8e323273bd9943bbb9f3492e85db62e7" } modify_external_catalogs: true
I20260617 07:53:19.017120 1171 tablet_bootstrap.cc:492] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:19.017277 1171 ts_tablet_manager.cc:1403] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.235s user 0.007s sys 0.007s
I20260617 07:53:19.023348 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772] alter complete (version 1)
I20260617 07:53:19.027878 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet adbb0c38ef9242a5bfbbcbe22faa5df9
I20260617 07:53:19.028666 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_732577db3896433fa1d09544bbf1ffb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.029320 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_732577db3896433fa1d09544bbf1ffb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.030375 1178 tablet_bootstrap.cc:654] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:19.030488 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43106674307b4610abea9a68590aecef consensus state has no leader
I20260617 07:53:19.030841 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e39af9602cd746f3995e8ccb1f0a95d4" } modify_external_catalogs: true
I20260617 07:53:19.031029 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e39af9602cd746f3995e8ccb1f0a95d4" } modify_external_catalogs: true
I20260617 07:53:19.031572 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ce7cc6cbd4a0474880ed62aebc035226
I20260617 07:53:19.032320 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_7d27b080b2054ad88ad8a0e7fcbb1c49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.032858 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d27b080b2054ad88ad8a0e7fcbb1c49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.036897 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet adbb0c38ef9242a5bfbbcbe22faa5df9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.038704 1170 ts_tablet_manager.cc:1929] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:19.038825 1170 log.cc:1199] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/596ef68705c84791b54f07e03b219b4c
I20260617 07:53:19.039151 1170 ts_tablet_manager.cc:1950] T 596ef68705c84791b54f07e03b219b4c P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:19.039467 2485 raft_consensus.cc:515] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.040205 2485 leader_election.cc:290] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.040405 881 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cc6cbd4a0474880ed62aebc035226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.040794 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5df0947db0104ef6bb9e41fdb647e50c" } new_table_name: "default.Table_6a6417c913804eefb21f395cd116a3e4" modify_external_catalogs: true
I20260617 07:53:19.042021 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0e7fa8cb8a9b49cb8ec27a4eef4a7d39" } new_table_name: "default.Table_de82b245aadc4b368d45f9fc52330c76" modify_external_catalogs: true
I20260617 07:53:19.043094 898 tablet_service.cc:1558] Processing DeleteTablet for tablet adbb0c38ef9242a5bfbbcbe22faa5df9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.043301 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cc6cbd4a0474880ed62aebc035226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.043411 1172 tablet_bootstrap.cc:492] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:19.043530 1172 ts_tablet_manager.cc:1403] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.000s
I20260617 07:53:19.044137 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a179c86f21864fd984fcedd2be1154d1" } new_table_name: "default.Table_5a2bb71696b14234b2c946c3f4adb2c5" modify_external_catalogs: true
I20260617 07:53:18.988180 741 tablet_service.cc:1558] Processing DeleteTablet for tablet de030009192748118b388eec555d90da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.055070 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.055562 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.055554 1172 raft_consensus.cc:359] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.055930 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 121339ab4842432e9fb7bc357750f8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.056296 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.061451 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 68b448c65e684f49bf142ce2b5084d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.061730 746 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.062012 1171 raft_consensus.cc:359] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.062193 1171 raft_consensus.cc:385] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.062258 1171 raft_consensus.cc:740] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.062462 1171 consensus_queue.cc:260] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.063020 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd8cedb539748dc917128511325bbcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.063094 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.063232 741 tablet_service.cc:1558] Processing DeleteTablet for tablet eb75a965740344c2bd0b68a8dda28be5 with delete_type TABLET_DATA_DELETED (replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.063338 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.063442 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.063645 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 739cadc7ad124e229441333de949f2c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f95a13b909c4ef9be6c56a317b42c9b) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.063719 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.063840 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:19.066944 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ffa87a4304b43a89be0faa3c5ce0b2c consensus state has no leader
I20260617 07:53:19.068893 1178 tablet_bootstrap.cc:492] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:19.069042 1178 ts_tablet_manager.cc:1403] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.172s user 0.003s sys 0.002s
I20260617 07:53:19.069854 1178 raft_consensus.cc:359] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.070402 1178 raft_consensus.cc:385] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.070469 1178 raft_consensus.cc:740] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.070679 1178 consensus_queue.cc:260] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.071216 1178 ts_tablet_manager.cc:1434] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:19.071650 1178 tablet_bootstrap.cc:492] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:19.073321 1178 tablet_bootstrap.cc:654] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.045989 1052 raft_consensus.cc:2468] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:19.057521 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f0f68dcef34228a1b2a018e8aa329e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:19.080871 1172 raft_consensus.cc:385] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.080967 1050 raft_consensus.cc:3060] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:19.083105 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d73460bcd4f648cc9f51e30a0a1b7342 consensus state has no leader
I20260617 07:53:19.083653 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_56afa8aee6ee42ec83d259b3cb92bcdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.084393 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56afa8aee6ee42ec83d259b3cb92bcdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.087508 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet fb74bb5046dc4bda98be3a9ba2f4a3c6
I20260617 07:53:19.080991 1172 raft_consensus.cc:740] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.090274 1172 consensus_queue.cc:260] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.091014 1172 ts_tablet_manager.cc:1434] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260617 07:53:19.091359 1172 tablet_bootstrap.cc:492] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:19.094427 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.095984 898 tablet_service.cc:1558] Processing DeleteTablet for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.098284 851 leader_election.cc:304] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:19.098673 2201 raft_consensus.cc:2804] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:19.098784 2201 raft_consensus.cc:697] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:19.098992 2201 consensus_queue.cc:237] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.099148 2448 tablet.cc:1724] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:19.100421 2435 consensus_queue.cc:1048] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:19.101956 2452 tablet.cc:1724] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:19.105276 1178 tablet_bootstrap.cc:492] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:19.105494 1178 ts_tablet_manager.cc:1403] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260617 07:53:19.106374 1178 raft_consensus.cc:359] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.106612 1178 raft_consensus.cc:385] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.106725 1178 raft_consensus.cc:740] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.107004 1178 consensus_queue.cc:260] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.107554 1178 ts_tablet_manager.cc:1434] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:19.108762 1178 tablet_bootstrap.cc:492] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:19.110649 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24066965db7141a6a970ec08f835a820 consensus state has no leader
I20260617 07:53:19.110782 1178 tablet_bootstrap.cc:654] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.111361 2484 raft_consensus.cc:493] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.111478 2484 raft_consensus.cc:515] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.112172 2484 leader_election.cc:290] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:19.113080 716 leader_election.cc:343] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a2f21861cb6f481eae968edc733e6e6f
I20260617 07:53:19.113615 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 290) took 3478 ms. Trace:
I20260617 07:53:19.113739 1170 rpcz_store.cc:276] 0617 07:53:15.635106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.635905 (+ 799us) service_pool.cc:224] Handling call
0617 07:53:18.872398 (+3236493us) ts_tablet_manager.cc:1151] Deleting tablet 596ef68705c84791b54f07e03b219b4c
0617 07:53:18.872406 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:18.939834 (+ 67428us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x6160001e2e54. stack: 00007f0ee639d086 00007f0ee639ce40 00007f0ee53563ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f0ef23d17e0 00007f0ef371d933 00007f0ef62e0ae7 00007f0ef6313bb4 00007f0ef62f45d0 00007f0ef62f435d 0000000000aa681c 00007f0ee63e2f6f 00007f0ee63e628b 00007f0ee63e6108
0617 07:53:19.033506 (+ 93672us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.038636 (+ 5130us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.113591 (+ 74955us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153963264,"tablet-delete.queue_time_us":3236326}
I20260617 07:53:19.114102 1170 tablet_replica.cc:333] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:19.114288 1170 raft_consensus.cc:2243] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:19.114437 1170 raft_consensus.cc:2272] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:19.115036 1170 ts_tablet_manager.cc:1916] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:19.115912 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 596ef68705c84791b54f07e03b219b4c (table default.Table_0a73e0c5eead4482b2f6747fec27846f [id=3cda30618acd40f08728b0ccb01bb973]) successfully deleted
I20260617 07:53:19.125779 1172 tablet_bootstrap.cc:654] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.132298 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 5fb489c72a7a4e3590b81c768eeb5c43
I20260617 07:53:19.133653 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fb489c72a7a4e3590b81c768eeb5c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.134091 1846 ts_tablet_manager.cc:1929] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:19.134217 1846 log.cc:1199] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/53108a2d6c8b4398a568c14df8e0a23e
I20260617 07:53:19.134519 1846 ts_tablet_manager.cc:1950] T 53108a2d6c8b4398a568c14df8e0a23e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:19.135056 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fb489c72a7a4e3590b81c768eeb5c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.135578 2086 raft_consensus.cc:515] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.136209 2086 leader_election.cc:290] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.141312 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 421ad54782ac4ea1bef756a0129b3f21 (DEFAULT_TABLE table=default.Table_28ed4c5efaf94cb498246499e67db6c3 [id=7a6205ddabd44e6f8e6af85e258e1508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.142282 2496 raft_consensus.cc:515] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.142940 2496 leader_election.cc:290] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:19.143424 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5578fd5cb3724ed5b92b313bd52889ad" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:19.143914 986 leader_election.cc:343] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:19.144177 1178 tablet_bootstrap.cc:492] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:19.144299 1178 ts_tablet_manager.cc:1403] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260617 07:53:19.145537 1178 raft_consensus.cc:359] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.145641 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2932085f7a48b69589b4a71182a81c (DEFAULT_TABLE table=default.Table_1aca1a9fa2a640cd8e74ee5d6f9fc169 [id=dcd38705a5fb45c2a797489ba7fa7b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.145795 1178 raft_consensus.cc:385] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.145854 1178 raft_consensus.cc:740] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.146037 1178 consensus_queue.cc:260] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.146597 1178 ts_tablet_manager.cc:1434] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:19.146733 895 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2932085f7a48b69589b4a71182a81c (DEFAULT_TABLE table=default.Table_1aca1a9fa2a640cd8e74ee5d6f9fc169 [id=dcd38705a5fb45c2a797489ba7fa7b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.147185 898 tablet_service.cc:1511] Processing CreateTablet for tablet 421ad54782ac4ea1bef756a0129b3f21 (DEFAULT_TABLE table=default.Table_28ed4c5efaf94cb498246499e67db6c3 [id=7a6205ddabd44e6f8e6af85e258e1508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.149286 1032 tablet_service.cc:1511] Processing CreateTablet for tablet e28f09dff8a547a993c98494ac9ee928 (DEFAULT_TABLE table=default.Table_93e8d29da1584b79abf1bd4823335929 [id=f5d9e6286ba942d6b337c551d9b9ed5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.149729 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28f09dff8a547a993c98494ac9ee928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.149911 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421ad54782ac4ea1bef756a0129b3f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.152262 881 tablet_service.cc:1511] Processing CreateTablet for tablet e28f09dff8a547a993c98494ac9ee928 (DEFAULT_TABLE table=default.Table_93e8d29da1584b79abf1bd4823335929 [id=f5d9e6286ba942d6b337c551d9b9ed5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.152781 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2932085f7a48b69589b4a71182a81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.155668 1019 tablet_service.cc:1511] Processing CreateTablet for tablet da1d2f5f9b0441e8bbfd6571570f4f88 (DEFAULT_TABLE table=default.Table_93379979809441178fa6c159c07f77ce [id=1ce585dfe5c64a0caed626f1f56a05f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.155990 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1d2f5f9b0441e8bbfd6571570f4f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.157985 879 tablet_service.cc:1511] Processing CreateTablet for tablet da1d2f5f9b0441e8bbfd6571570f4f88 (DEFAULT_TABLE table=default.Table_93379979809441178fa6c159c07f77ce [id=1ce585dfe5c64a0caed626f1f56a05f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.158572 1026 tablet_service.cc:1511] Processing CreateTablet for tablet a90472b619d644b7b01f5104872ecb64 (DEFAULT_TABLE table=default.Table_93a30efc9eaf4d88a07a973b6dd6c51a [id=82397ab1830f4809994d4facef032d9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.158900 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90472b619d644b7b01f5104872ecb64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.160512 882 tablet_service.cc:1511] Processing CreateTablet for tablet a90472b619d644b7b01f5104872ecb64 (DEFAULT_TABLE table=default.Table_93a30efc9eaf4d88a07a973b6dd6c51a [id=82397ab1830f4809994d4facef032d9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.163280 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 5c48a40032034f9c90df60b61d536222 (DEFAULT_TABLE table=default.Table_1077b4b7bbb44940ba86c9aa6b6d7ff4 [id=d121a3f896c5406b82de124c7233238a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.163646 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c48a40032034f9c90df60b61d536222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.164469 894 tablet_service.cc:1511] Processing CreateTablet for tablet 5c48a40032034f9c90df60b61d536222 (DEFAULT_TABLE table=default.Table_1077b4b7bbb44940ba86c9aa6b6d7ff4 [id=d121a3f896c5406b82de124c7233238a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.167147 1023 tablet_service.cc:1511] Processing CreateTablet for tablet a19e7645e3aa4b378f3f12df19cdec86 (DEFAULT_TABLE table=default.Table_4a4a4aa9eb5b41a797441b36757c7db8 [id=0ea232a84d5641a2bbbc73ad9cb9f781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.168272 886 tablet_service.cc:1511] Processing CreateTablet for tablet a19e7645e3aa4b378f3f12df19cdec86 (DEFAULT_TABLE table=default.Table_4a4a4aa9eb5b41a797441b36757c7db8 [id=0ea232a84d5641a2bbbc73ad9cb9f781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.170354 1862 ts_tablet_manager.cc:1929] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:19.170519 1862 log.cc:1199] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0fd8cedb539748dc917128511325bbcc
I20260617 07:53:19.170897 1862 ts_tablet_manager.cc:1950] T 0fd8cedb539748dc917128511325bbcc P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:19.171603 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5578fd5cb3724ed5b92b313bd52889ad" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:19.171775 915 raft_consensus.cc:3060] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:19.172755 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2bd01bab4840398d89c421a446dea7 (DEFAULT_TABLE table=default.Table_2a74749dc2164127b0c24e5e6fe5df46 [id=3c84b0551a464928964a4a9663c7bf44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.173915 880 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2bd01bab4840398d89c421a446dea7 (DEFAULT_TABLE table=default.Table_2a74749dc2164127b0c24e5e6fe5df46 [id=3c84b0551a464928964a4a9663c7bf44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.176649 1044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f7c3f6260c4db690de1a5081bb2493" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:19.176633 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f01d494fa8eb446bbd9e6765de851e35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:19.176823 1044 raft_consensus.cc:3060] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:19.177192 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f01d494fa8eb446bbd9e6765de851e35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.178323 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_20cf1c4fc2924e32b32db6a8bcac8b09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:19.178853 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f320a356edaa463dae9407cbd2263d6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.179292 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f320a356edaa463dae9407cbd2263d6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:19.178859 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20cf1c4fc2924e32b32db6a8bcac8b09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.183003 1171 ts_tablet_manager.cc:1434] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.166s user 0.001s sys 0.001s
I20260617 07:53:19.184027 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 6806000ebdc14d758404f01021ec2440 (DEFAULT_TABLE table=default.Table_379c9732503049fa8e201f6b86a96023 [id=f7614b475a8c419d984ea3189855ca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.184262 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.184527 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.184579 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.184719 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.184875 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.185081 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aa1c1fdede041d28570b85e63c401b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.185277 753 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.185482 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 52af94bd46c941b8a27136ca0506e744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.185691 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 61510f9812e849e388c6c163e9af5f4f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.185876 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ec78c123d448329b8442a0de0140d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.185969 750 tablet_service.cc:1558] Processing DeleteTablet for tablet dac3dc9d7da447cb8fdca84fdac0dc39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.186147 743 tablet_service.cc:1558] Processing DeleteTablet for tablet d2304939c17648a6962f702524aa9b76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.185897 753 tablet_service.cc:1558] Processing DeleteTablet for tablet d657fbccb4af40558033a971aab7f3e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.186306 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 with delete_type TABLET_DATA_DELETED (replaced by tablet f395f963a5a5400a966a8d4cc62aadf1) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.186489 742 tablet_service.cc:1558] Processing DeleteTablet for tablet d03d6dc473fc4be1a436fd71a06f403e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.186964 883 tablet_service.cc:1511] Processing CreateTablet for tablet 6806000ebdc14d758404f01021ec2440 (DEFAULT_TABLE table=default.Table_379c9732503049fa8e201f6b86a96023 [id=f7614b475a8c419d984ea3189855ca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.189337 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_7c3a47f37c184835aa2758f4f5f69c6d" } modify_external_catalogs: true
I20260617 07:53:19.189627 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_7c3a47f37c184835aa2758f4f5f69c6d" } modify_external_catalogs: true
I20260617 07:53:19.195824 887 tablet_service.cc:1511] Processing CreateTablet for tablet c8848c0f52e34c118a9e1831b8c9a88e (DEFAULT_TABLE table=default.Table_dd16c59e32e542048095a371aaddb95b [id=c12a3c4eaa2342e089d4b405c4d7c304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.197737 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet cbc79cfa11e342bd87da1aa03847c3cb
I20260617 07:53:19.198565 1031 tablet_service.cc:1511] Processing CreateTablet for tablet c8848c0f52e34c118a9e1831b8c9a88e (DEFAULT_TABLE table=default.Table_dd16c59e32e542048095a371aaddb95b [id=c12a3c4eaa2342e089d4b405c4d7c304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.198776 885 tablet_service.cc:1558] Processing DeleteTablet for tablet cbc79cfa11e342bd87da1aa03847c3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.199718 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet cbc79cfa11e342bd87da1aa03847c3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.202307 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.203310 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.203490 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.204622 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_71adaf9340434984a17d180f03ab2392"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.205191 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71adaf9340434984a17d180f03ab2392 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.206321 1178 tablet_bootstrap.cc:492] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:19.207794 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8ef09b6d20804caab974dc8388100817" } new_table_name: "default.Table_9c5fa2145a4b4a6bba8a236cd0573e66" modify_external_catalogs: true
I20260617 07:53:19.208158 1178 tablet_bootstrap.cc:654] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.209259 1171 tablet_bootstrap.cc:492] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:19.211229 1171 tablet_bootstrap.cc:654] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.213459 1172 tablet_bootstrap.cc:492] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:19.214728 1017 tablet_service.cc:1511] Processing CreateTablet for tablet 53ff0de05b8c4185aa6de2370d699617 (DEFAULT_TABLE table=default.Table_5b32814e8ada4019bbdf078311f1a5ee [id=bd0b7b2a287d42b6a0f68dfdf3425226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.216239 2484 raft_consensus.cc:493] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.216866 2484 raft_consensus.cc:515] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.217509 2484 leader_election.cc:290] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.217962 885 tablet_service.cc:1511] Processing CreateTablet for tablet 53ff0de05b8c4185aa6de2370d699617 (DEFAULT_TABLE table=default.Table_5b32814e8ada4019bbdf078311f1a5ee [id=bd0b7b2a287d42b6a0f68dfdf3425226]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:19.218812 716 leader_election.cc:343] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 706373f1f5d44edf81ed04183a8bdf89
I20260617 07:53:19.221133 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 61510f9812e849e388c6c163e9af5f4f (DEFAULT_TABLE table=default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb [id=964a0b6e388a4823bb124eef82b57431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.219587 884 tablet_service.cc:1511] Processing CreateTablet for tablet 61510f9812e849e388c6c163e9af5f4f (DEFAULT_TABLE table=default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb [id=964a0b6e388a4823bb124eef82b57431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.235405 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.237250 1050 raft_consensus.cc:2468] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
W20260617 07:53:19.237303 459 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:57237 (request call id 196) took 945 ms (client timeout 1000 ms). Trace:
I20260617 07:53:19.237752 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19e7645e3aa4b378f3f12df19cdec86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.238281 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2bd01bab4840398d89c421a446dea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.238454 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8848c0f52e34c118a9e1831b8c9a88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.238677 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ff0de05b8c4185aa6de2370d699617. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:19.238946 1898 consensus_meta.cc:287] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent flushing consensus metadata: real 0.607s user 0.003s sys 0.000s
I20260617 07:53:19.239059 1898 raft_consensus.cc:515] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.239207 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61510f9812e849e388c6c163e9af5f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.242604 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_77163a83bea3432b8b2ea745bef42ce8" } modify_external_catalogs: true
I20260617 07:53:19.243907 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90472b619d644b7b01f5104872ecb64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.244362 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c48a40032034f9c90df60b61d536222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.244513 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1d2f5f9b0441e8bbfd6571570f4f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.244551 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9cc33f29bdc74258b288fd41c7366da4" } modify_external_catalogs: true
I20260617 07:53:19.244874 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2bd01bab4840398d89c421a446dea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.245229 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6806000ebdc14d758404f01021ec2440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.245270 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_971d911bece54aee98e3b98f349f0aad" } new_table_name: "default.Table_74d1e24e8c594e52b77ec38499225bc1" modify_external_catalogs: true
W20260617 07:53:19.246953 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa6e25c657294fe2916fe1b121c1df9a consensus state has no leader
I20260617 07:53:19.247798 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_77163a83bea3432b8b2ea745bef42ce8" } modify_external_catalogs: true
I20260617 07:53:19.249097 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9cc33f29bdc74258b288fd41c7366da4" } modify_external_catalogs: true
I20260617 07:53:19.250180 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8848c0f52e34c118a9e1831b8c9a88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.250546 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421ad54782ac4ea1bef756a0129b3f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.250887 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28f09dff8a547a993c98494ac9ee928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.251259 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2932085f7a48b69589b4a71182a81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.252094 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_524a3b28dffc47f5bf32de043600d64b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.252640 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_524a3b28dffc47f5bf32de043600d64b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.254333 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ff0de05b8c4185aa6de2370d699617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.256735 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19e7645e3aa4b378f3f12df19cdec86. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:19.264892 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc1d9ce2ab5b428893719d9acd272d88 consensus state has no leader
I20260617 07:53:19.265262 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 9d94915d96694d6f9a86063640e5fe18
I20260617 07:53:19.266512 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d94915d96694d6f9a86063640e5fe18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.266744 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet e9f8492f127243eca07b2ffbabddded5
I20260617 07:53:19.267215 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d94915d96694d6f9a86063640e5fe18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.267607 897 tablet_service.cc:1558] Processing DeleteTablet for tablet e9f8492f127243eca07b2ffbabddded5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.270344 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet e9f8492f127243eca07b2ffbabddded5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.270985 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e80b82e221bb421691ddece5b6db63a0" } new_table_name: "default.Table_3f13f7de74554429bfd1df585b9fcc31" modify_external_catalogs: true
I20260617 07:53:19.277415 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61510f9812e849e388c6c163e9af5f4f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:19.282723 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bbbea6fe52f04f298eeecdc119bebb65 consensus state has no leader
I20260617 07:53:19.284686 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a044383079644cf5bbb32311ac6520ec" } new_table_name: "default.Table_2e4311968bfb4956bb02a8626f5d767f" modify_external_catalogs: true
I20260617 07:53:19.287595 1898 leader_election.cc:290] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.287982 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6806000ebdc14d758404f01021ec2440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.288292 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f36c303bfe55438fbf17a23b0a747152"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.237442 459 rpcz_store.cc:269] 0617 07:53:18.291774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.302342 (+ 10568us) service_pool.cc:224] Handling call
0617 07:53:18.439562 (+137220us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x616000043354. stack: 00007f1435cca086 00007f1435cc9e40 00007f1434c833ad 000000000099c914 000000000099c8dd 00007f14451396bd 00007f14451397b3 00007f1441d01b21 00007f1449a6695d 00007f1449bf3f08 00007f1440652ca6 00007f14406529d5 00007f143cd6288e 00007f143cd6176e 00007f143cd679a8 00007f143cd6830f
0617 07:53:19.237262 (+797700us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4488,"reported_tablets":243,"spinlock_wait_cycles":112817408}
W20260617 07:53:19.288905 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f36c303bfe55438fbf17a23b0a747152 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.300030 1846 tablet_replica.cc:333] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:19.300309 1846 raft_consensus.cc:2243] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:19.300536 1846 raft_consensus.cc:2272] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:19.301105 1846 ts_tablet_manager.cc:1916] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:19.302332 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:19.302603 461 catalog_manager.cc:5696] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } }
I20260617 07:53:19.303144 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
W20260617 07:53:19.303771 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1e064b5bc93442f83aeffa88861d818 consensus state has no leader
I20260617 07:53:19.304576 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4f46dc52ee0141efa08440414be77e91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:19.304656 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b6330dfd02194901ac18d158d95ee77e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:19.305156 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 361) took 2106 ms. Trace:
W20260617 07:53:19.305162 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f46dc52ee0141efa08440414be77e91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.305249 1862 rpcz_store.cc:276] 0617 07:53:17.198835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.198995 (+ 160us) service_pool.cc:224] Handling call
0617 07:53:18.947451 (+1748456us) ts_tablet_manager.cc:1151] Deleting tablet 0fd8cedb539748dc917128511325bbcc
0617 07:53:18.947459 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.044928 (+ 97469us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.170302 (+125374us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.305135 (+134833us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1748280}
I20260617 07:53:19.305627 1862 tablet_replica.cc:333] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:19.305831 1862 raft_consensus.cc:2243] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:19.305976 1862 raft_consensus.cc:2272] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:19.305161 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6330dfd02194901ac18d158d95ee77e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.306200 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0fd8cedb539748dc917128511325bbcc (table default.Table_1dc0449b6b954c8c9b7bb09011250560 [id=9edba52661f941a387f42fad199f9860]) successfully deleted
I20260617 07:53:19.306495 1862 ts_tablet_manager.cc:1916] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:19.307906 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c6fedca194ec4749b5cf314ab4952408" } modify_external_catalogs: true
I20260617 07:53:19.308197 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c6fedca194ec4749b5cf314ab4952408" } modify_external_catalogs: true
I20260617 07:53:19.309670 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1f8f6f44936841a1ab358a3ee70dffef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.310318 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f8f6f44936841a1ab358a3ee70dffef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.313164 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4d58dd10a2254fc383ba0cbde79c772b" } new_table_name: "default.Table_ea0a7d3276674e738ebb71d763218b05" modify_external_catalogs: true
I20260617 07:53:19.313491 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e3e48dd41d7142f3b6445fe78c01f8a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.314014 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3e48dd41d7142f3b6445fe78c01f8a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.317920 452 master_service.cc:960] ReplaceTablet: received request to replace tablet cc1d9ce2ab5b428893719d9acd272d88 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:19.320559 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 6cdcd3904a754939b9ae09cc3672bbc6 from {username='slave'} at 127.0.0.1:33390
W20260617 07:53:19.320708 2512 log.cc:927] Time spent T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
W20260617 07:53:19.323299 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet bbbea6fe52f04f298eeecdc119bebb65 (table default.Table_3f13f7de74554429bfd1df585b9fcc31 [id=c36b5242d93a41dda283989b3204f558], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet bbbea6fe52f04f298eeecdc119bebb65 consensus state has no leader
W20260617 07:53:19.327349 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 37406deefeeb4b9ea8ecb8656cf98832 consensus state has no leader
I20260617 07:53:19.334583 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_cd851e8a141f42ac99c04a617f1b319c" } modify_external_catalogs: true
I20260617 07:53:19.334708 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet cc1d9ce2ab5b428893719d9acd272d88
I20260617 07:53:19.334798 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_cd851e8a141f42ac99c04a617f1b319c" } modify_external_catalogs: true
I20260617 07:53:19.335220 452 catalog_manager.cc:6784] ReplaceTablet: tablet cc1d9ce2ab5b428893719d9acd272d88 deleted and replaced by tablet 20cfb1ae290f43cbadead54c8f692f21
I20260617 07:53:19.335654 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 6cdcd3904a754939b9ae09cc3672bbc6
I20260617 07:53:19.336089 457 catalog_manager.cc:6784] ReplaceTablet: tablet 6cdcd3904a754939b9ae09cc3672bbc6 deleted and replaced by tablet 24c31a34256748198b12a4503946179e
I20260617 07:53:19.337584 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cdcd3904a754939b9ae09cc3672bbc6 with delete_type TABLET_DATA_DELETED (replaced by tablet 24c31a34256748198b12a4503946179e) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.338104 1044 raft_consensus.cc:2468] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:19.338791 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cdcd3904a754939b9ae09cc3672bbc6 with delete_type TABLET_DATA_DELETED (replaced by tablet 24c31a34256748198b12a4503946179e) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.339553 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 63de833f7aa740b0b5bf2494b78aca5c
I20260617 07:53:19.340296 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 63de833f7aa740b0b5bf2494b78aca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.341075 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 63de833f7aa740b0b5bf2494b78aca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.342499 882 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1d9ce2ab5b428893719d9acd272d88 with delete_type TABLET_DATA_DELETED (replaced by tablet 20cfb1ae290f43cbadead54c8f692f21) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.346613 454 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 9823aa85070648929bdf26ef8c31903e
I20260617 07:53:19.353983 1170 ts_tablet_manager.cc:1929] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:19.354190 1170 log.cc:1199] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/6d8f144d04af4ea18f99aee3b82f4a28
I20260617 07:53:19.354598 1170 ts_tablet_manager.cc:1950] T 6d8f144d04af4ea18f99aee3b82f4a28 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:19.354591 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_b8df6bf2a67d44598b3472dd0031e570 [id=951e230ec1f84717b9ed7d19f4dfbc16] alter complete (version 1)
I20260617 07:53:19.354951 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1d9ce2ab5b428893719d9acd272d88 with delete_type TABLET_DATA_DELETED (replaced by tablet 20cfb1ae290f43cbadead54c8f692f21) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.360916 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_4567ec36d77142efb3f907152dc94596 [id=f96c8d7d0be24aa4958290874ff844b5] alter complete (version 1)
I20260617 07:53:19.367091 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_9815ff9400a3426e8f09edd618831938 [id=6a3de6cd076144ecabdfe3c5fe5498bb] alter complete (version 3)
I20260617 07:53:19.374991 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_cf59fff4b93345819e95a268c92f8c64 [id=303a8e07863a4dbe90a17c3c1aeae6c8] alter complete (version 2)
I20260617 07:53:19.376227 1898 raft_consensus.cc:493] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.376358 1898 raft_consensus.cc:515] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.376884 1898 leader_election.cc:290] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.380728 2086 raft_consensus.cc:493] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.380853 2086 raft_consensus.cc:515] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.381394 2086 leader_election.cc:290] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.382206 851 leader_election.cc:304] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:19.382508 2086 raft_consensus.cc:2804] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:19.382602 2086 raft_consensus.cc:697] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:19.382651 1044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b448c65e684f49bf142ce2b5084d33" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:19.382797 1044 raft_consensus.cc:3060] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:19.382805 2086 consensus_queue.cc:237] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.387523 851 leader_election.cc:304] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:19.388933 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e7f42d14021e493f8372ea9b69dbb845"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.389562 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7f42d14021e493f8372ea9b69dbb845 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.213673 1172 ts_tablet_manager.cc:1403] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.122s user 0.004s sys 0.000s
I20260617 07:53:19.393850 1172 raft_consensus.cc:359] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.394366 1172 raft_consensus.cc:385] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.394481 1172 raft_consensus.cc:740] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.394829 1172 consensus_queue.cc:260] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.397768 1172 ts_tablet_manager.cc:1434] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:19.398084 1172 tablet_bootstrap.cc:492] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:19.398144 2280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=529 overwritten=0 applied=526 ignored=0} inserts{seen=495 ignored=0} mutations{seen=619 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260617 07:53:19.398732 2460 raft_consensus.cc:2804] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:19.398875 2460 raft_consensus.cc:697] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:19.399132 2280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Bootstrap complete.
I20260617 07:53:19.399108 2460 consensus_queue.cc:237] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.398751 1898 consensus_queue.cc:1048] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260617 07:53:19.400978 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3e7568e9e053459ab5fa24e209310e3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.401507 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e7568e9e053459ab5fa24e209310e3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.403753 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_10dfdc64b49347fcaf5a117f196588ec" } modify_external_catalogs: true
I20260617 07:53:19.403910 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_10dfdc64b49347fcaf5a117f196588ec" } modify_external_catalogs: true
I20260617 07:53:19.408164 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ebcdc640e6034a69a9f5c70474fed5c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.408666 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebcdc640e6034a69a9f5c70474fed5c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.408376 2280 raft_consensus.cc:359] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 1 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
W20260617 07:53:19.411224 851 leader_election.cc:343] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 1f6264adc3994c22864ea73106ba2320
I20260617 07:53:19.414296 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2e04c81f964fe1895219311eebdee4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:19.416111 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet eafcf54494f244f1b978b4b5e39d93bd
W20260617 07:53:19.416702 851 leader_election.cc:343] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:19.418052 898 tablet_service.cc:1558] Processing DeleteTablet for tablet eafcf54494f244f1b978b4b5e39d93bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.422835 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e8431c1ec669439d8a2e5d4941c87229"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.423482 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8431c1ec669439d8a2e5d4941c87229 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.428812 915 raft_consensus.cc:2468] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:19.429328 1044 raft_consensus.cc:2468] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:19.429381 988 leader_election.cc:304] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:19.429633 2496 raft_consensus.cc:2804] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:19.429760 2496 raft_consensus.cc:697] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:19.429970 2496 consensus_queue.cc:237] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.433310 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet eafcf54494f244f1b978b4b5e39d93bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.433519 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 291) took 3798 ms. Trace:
I20260617 07:53:19.433681 1170 rpcz_store.cc:276] 0617 07:53:15.635205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.636106 (+ 901us) service_pool.cc:224] Handling call
0617 07:53:19.114054 (+3477948us) ts_tablet_manager.cc:1151] Deleting tablet 6d8f144d04af4ea18f99aee3b82f4a28
0617 07:53:19.114065 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.237670 (+123605us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.353919 (+116249us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.433496 (+ 79577us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3477817}
I20260617 07:53:19.434377 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 6d8f144d04af4ea18f99aee3b82f4a28 (table default.Table_119ecdf0aa5343da9cee836dd150a21a [id=ec04f28d4a6e4fa18078aacb6b6f0bb8]) successfully deleted
I20260617 07:53:19.434871 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 292) took 3799 ms. Trace:
I20260617 07:53:19.435020 1170 rpcz_store.cc:276] 0617 07:53:15.635280 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.636260 (+ 980us) service_pool.cc:224] Handling call
0617 07:53:19.434752 (+3798492us) ts_tablet_manager.cc:1151] Deleting tablet f2ce51c155c04897a4cf8f7b4ac9a5c6
0617 07:53:19.434765 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.434851 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3798363}
W20260617 07:53:19.435597 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet f2ce51c155c04897a4cf8f7b4ac9a5c6 because the tablet was not found. No further retry: Not found: Tablet not found: f2ce51c155c04897a4cf8f7b4ac9a5c6
I20260617 07:53:19.436203 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 293) took 3800 ms. Trace:
I20260617 07:53:19.436355 1170 rpcz_store.cc:276] 0617 07:53:15.635358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.636409 (+ 1051us) service_pool.cc:224] Handling call
0617 07:53:19.436075 (+3799666us) ts_tablet_manager.cc:1151] Deleting tablet 5364dfe28b8d4042941c8d8d4d1cf503
0617 07:53:19.436087 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.436185 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3799536}
W20260617 07:53:19.437449 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5364dfe28b8d4042941c8d8d4d1cf503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5364dfe28b8d4042941c8d8d4d1cf503 already in progress: creating tablet
I20260617 07:53:19.438305 1170 tablet_replica.cc:333] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:19.438555 1170 raft_consensus.cc:2243] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:19.438812 1170 raft_consensus.cc:2272] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:19.439661 1170 ts_tablet_manager.cc:1916] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:19.440214 851 leader_election.cc:304] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:19.440567 1898 raft_consensus.cc:2804] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:19.440681 1898 raft_consensus.cc:697] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:19.440899 1898 consensus_queue.cc:237] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.441517 2280 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29a94ff9f875443ab6aeac00922cda0d, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.449509 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c8087e83aff447a8884c16e5473ac750" } new_table_name: "default.Table_a1fb0f387de44393bfb99cdbce3007d4" modify_external_catalogs: true
I20260617 07:53:19.450237 2440 raft_consensus.cc:493] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.450374 2440 raft_consensus.cc:515] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.451013 2440 leader_election.cc:290] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:19.452371 2280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 526, Last appended: 1.529, Last appended by leader: 529, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:19.455436 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9488e8a501e404f85540fb045d8916f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:19.457473 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 306742b9da81497991d58947bf3c1ebb with delete_type TABLET_DATA_DELETED (replaced by tablet c8848c0f52e34c118a9e1831b8c9a88e) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:19.457983 988 leader_election.cc:343] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:19.458482 2484 raft_consensus.cc:493] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:19.459556 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f34a2ee6fa82482db979ab25bc284f8e consensus state has no leader
I20260617 07:53:19.460316 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9488e8a501e404f85540fb045d8916f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:19.460727 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 44b06e32039e4ad28924f5173035820a with delete_type TABLET_DATA_DELETED (replaced by tablet 8d27dcd5af04496b8e231115a88b4aeb) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.461058 1898 raft_consensus.cc:493] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:19.461153 986 leader_election.cc:343] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:19.461187 1898 raft_consensus.cc:515] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.461249 986 leader_election.cc:304] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:19.461834 2440 raft_consensus.cc:2749] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:19.461833 1898 leader_election.cc:290] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.462659 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb75a965740344c2bd0b68a8dda28be5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:19.462858 1048 raft_consensus.cc:2468] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:19.463955 851 leader_election.cc:304] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:19.464241 2086 raft_consensus.cc:2804] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:19.464331 2086 raft_consensus.cc:493] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:19.464414 2086 raft_consensus.cc:3060] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:19.464964 1178 tablet_bootstrap.cc:492] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:19.465669 1178 ts_tablet_manager.cc:1403] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.259s user 0.023s sys 0.013s
I20260617 07:53:19.466835 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_28ed4c5efaf94cb498246499e67db6c3" } new_table_name: "default.Table_6aab5d840c984238b6468381f10e3272" modify_external_catalogs: true
I20260617 07:53:19.472946 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_93a30efc9eaf4d88a07a973b6dd6c51a" } modify_external_catalogs: true
I20260617 07:53:19.473160 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_93a30efc9eaf4d88a07a973b6dd6c51a" } modify_external_catalogs: true
I20260617 07:53:19.472921 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8cb4ea8e1a39478fa0b788e049009950" } modify_external_catalogs: true
I20260617 07:53:19.474215 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8cb4ea8e1a39478fa0b788e049009950" } modify_external_catalogs: true
I20260617 07:53:19.475749 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_74f5825fca4f43fda3f8588f35919752"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.476267 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74f5825fca4f43fda3f8588f35919752 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.476905 2484 raft_consensus.cc:515] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.477824 2484 leader_election.cc:290] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.478029 2484 raft_consensus.cc:493] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:19.478195 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 421ad54782ac4ea1bef756a0129b3f21 consensus state has no leader
I20260617 07:53:19.478166 2484 raft_consensus.cc:515] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.478711 2484 leader_election.cc:290] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.478883 2484 raft_consensus.cc:493] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.479044 2484 raft_consensus.cc:515] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:19.479620 2484 leader_election.cc:290] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:19.481374 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 752b6cf345384750bf9b62158ae50f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.485798 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dcfb101cf51487692ef9a6a17f40804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.486728 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_cf8a1de2a6034fababf6dd4a1667f37b" } new_table_name: "default.Table_df35db29449746ce85c36e491a8a9384" modify_external_catalogs: true
I20260617 07:53:19.486797 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:19.487139 716 leader_election.cc:343] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 36ce60b466f7420992ef194d72b5718d
W20260617 07:53:19.487375 716 leader_election.cc:343] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 7e90ad3b80f24bc7aeb2e92ba5c84b63
W20260617 07:53:19.487736 716 leader_election.cc:343] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a38bb8a140ef4bcab65aaa03bdb79040
I20260617 07:53:19.488375 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.488557 753 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dcd837e1c54af696394e7a6c4d26f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:19.493355 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf0d92f849b844609763705df1615ae4 consensus state has no leader
I20260617 07:53:19.495249 1172 tablet_bootstrap.cc:654] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.495579 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 4f95a13b909c4ef9be6c56a317b42c9b from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:19.496141 1178 raft_consensus.cc:359] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.496470 1178 raft_consensus.cc:385] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.496713 1178 raft_consensus.cc:740] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.497045 1178 consensus_queue.cc:260] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.498052 1178 ts_tablet_manager.cc:1434] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260617 07:53:19.498404 1178 tablet_bootstrap.cc:492] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:19.498440 1171 tablet_bootstrap.cc:492] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:19.499069 2523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:19.500120 1178 tablet_bootstrap.cc:654] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.501286 2523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:53:19.501475 1171 ts_tablet_manager.cc:1403] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.292s user 0.004s sys 0.000s
I20260617 07:53:19.502206 1171 raft_consensus.cc:359] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.502380 1171 raft_consensus.cc:385] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.502440 1171 raft_consensus.cc:740] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.502595 965 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:19.504146 2280 sys_catalog.cc:565] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: configured and running, proceeding with master startup.
I20260617 07:53:19.504396 1171 consensus_queue.cc:260] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.505060 1171 ts_tablet_manager.cc:1434] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:19.508844 2201 consensus_queue.cc:1048] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:19.510082 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_008e34768d4f46ec8840e9d2af6a8d0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.510653 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_008e34768d4f46ec8840e9d2af6a8d0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.511032 827 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
I20260617 07:53:19.511849 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0276ca256ddc491e93325794b1ff6d2f" } new_table_name: "default.Table_734dcc01de2a48e19774ca36987db52c" modify_external_catalogs: true
I20260617 07:53:19.513439 454 catalog_manager.cc:5696] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } }
I20260617 07:53:19.513923 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_de82b245aadc4b368d45f9fc52330c76 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 2 got 0
I20260617 07:53:19.515551 895 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1345155f7448ca9be675d262cd00c1 (DEFAULT_TABLE table=default.Table_20cf1c4fc2924e32b32db6a8bcac8b09 [id=a23998bd42d846bc8d16b536d9f8a5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.517203 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae9261c0ac94defaecfc7d14ba1ae61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.517761 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ce60b466f7420992ef194d72b5718d with delete_type TABLET_DATA_DELETED (replaced by tablet 7ca402543247461aa5384abb65fff364) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.518146 753 tablet_service.cc:1558] Processing DeleteTablet for tablet beb8fbb44e6147be8c9605be886a8aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.518112 883 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8d94034beb4337b5f4e8567f395c00 (DEFAULT_TABLE table=default.Table_56afa8aee6ee42ec83d259b3cb92bcdb [id=20b98f0559064d74946803b7a84a0f43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.518591 753 tablet_service.cc:1558] Processing DeleteTablet for tablet eba5976fcadd4add9c671300b431617b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.518890 884 tablet_service.cc:1511] Processing CreateTablet for tablet a9f525ffe8cb430fb87941c019d40e62 (DEFAULT_TABLE table=default.Table_263867c4fce84a18a43a51cf5e9cc83a [id=ca2eca1a2b1f4c2eb8219b87a6bd6f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.518978 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.519374 753 tablet_service.cc:1558] Processing DeleteTablet for tablet adbb0c38ef9242a5bfbbcbe22faa5df9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.519742 753 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cc6cbd4a0474880ed62aebc035226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.520131 753 tablet_service.cc:1558] Processing DeleteTablet for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.520516 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fb489c72a7a4e3590b81c768eeb5c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.521274 753 tablet_service.cc:1511] Processing CreateTablet for tablet 421ad54782ac4ea1bef756a0129b3f21 (DEFAULT_TABLE table=default.Table_28ed4c5efaf94cb498246499e67db6c3 [id=7a6205ddabd44e6f8e6af85e258e1508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.522725 886 tablet_service.cc:1511] Processing CreateTablet for tablet a169ada5a5da477a82a533fd18a5ea5c (DEFAULT_TABLE table=default.Table_7d27b080b2054ad88ad8a0e7fcbb1c49 [id=9b149bca38a441538ff1af6fd23c0ede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.523092 1171 tablet_bootstrap.cc:492] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:19.523283 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8f25b118b9a24509b2a36db020170b88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.523815 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f25b118b9a24509b2a36db020170b88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.525450 2086 raft_consensus.cc:515] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.526695 2086 leader_election.cc:290] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:19.529134 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57c83de284064dd4a14fcea5ce6b08ad consensus state has no leader
I20260617 07:53:19.530443 459 catalog_manager.cc:5696] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:19.530995 459 catalog_manager.cc:5696] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:19.531337 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf]). Expected version 1 got 0
I20260617 07:53:19.531644 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8d94034beb4337b5f4e8567f395c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.531913 1044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb75a965740344c2bd0b68a8dda28be5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:19.532105 1044 raft_consensus.cc:3060] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:19.534334 1171 tablet_bootstrap.cc:654] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.534466 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_9815ff9400a3426e8f09edd618831938 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 3 got 2
I20260617 07:53:19.531651 1862 ts_tablet_manager.cc:1929] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:19.534631 1862 log.cc:1199] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/99ec78c123d448329b8442a0de0140d3
I20260617 07:53:19.534793 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_135d8e6c7f9a41ef809b7e98a6e02c97" } new_table_name: "default.Table_206a5e8a92c24c4ca0ea6cb0e4024589" modify_external_catalogs: true
I20260617 07:53:19.534965 1862 ts_tablet_manager.cc:1950] T 99ec78c123d448329b8442a0de0140d3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:19.535239 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1345155f7448ca9be675d262cd00c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.535285 459 catalog_manager.cc:5696] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:19.535629 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]). Expected version 2 got 0
I20260617 07:53:19.535740 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a169ada5a5da477a82a533fd18a5ea5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.535856 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:19.536103 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_bb7619faf537427aaff0f71f1963718b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:19.536401 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_de82b245aadc4b368d45f9fc52330c76 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 2 got 0
W20260617 07:53:19.536645 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb7619faf537427aaff0f71f1963718b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.536782 459 catalog_manager.cc:5696] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:19.537645 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
I20260617 07:53:19.538596 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4aca29909fcd4a02bcc1120e759db2c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:19.538954 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f525ffe8cb430fb87941c019d40e62. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:19.539134 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4aca29909fcd4a02bcc1120e759db2c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.542578 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_611568f3c8e3430381233e6f3ee4ac1f" } modify_external_catalogs: true
I20260617 07:53:19.542745 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_611568f3c8e3430381233e6f3ee4ac1f" } modify_external_catalogs: true
I20260617 07:53:19.544809 885 tablet_service.cc:1511] Processing CreateTablet for tablet e62175d5cc854d45838454043220954e (DEFAULT_TABLE table=default.Table_6defd798d4bd4e6f88986301755535ce [id=24df163731ea4ae7b5852a8b6c0c22f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.545176 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62175d5cc854d45838454043220954e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.545590 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet a90472b619d644b7b01f5104872ecb64
I20260617 07:53:19.548069 881 tablet_service.cc:1558] Processing DeleteTablet for tablet a90472b619d644b7b01f5104872ecb64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.548426 880 tablet_service.cc:1511] Processing CreateTablet for tablet 543fd8173b174946830d6228e47b2caa (DEFAULT_TABLE table=default.Table_3afd0e47dfc84e8f92c7684c766a3f99 [id=6eec41313c064a18b7ae230a359421fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.549260 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_21f38a23f6964cf1acdf47d110725c9a" } modify_external_catalogs: true
I20260617 07:53:19.549458 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_21f38a23f6964cf1acdf47d110725c9a" } modify_external_catalogs: true
I20260617 07:53:19.549759 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543fd8173b174946830d6228e47b2caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.550773 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c68bb2e70b93421c9e255fc79519b382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.551231 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c68bb2e70b93421c9e255fc79519b382 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.553643 883 tablet_service.cc:1511] Processing CreateTablet for tablet f30f0bbfdf404569a417662861b06f73 (DEFAULT_TABLE table=default.Table_df8e6f336fd640d1aaf3d25d471ae455 [id=d2d387734e9c423e98ce53ee2ee54483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.554011 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30f0bbfdf404569a417662861b06f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.554986 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1345155f7448ca9be675d262cd00c1 (DEFAULT_TABLE table=default.Table_20cf1c4fc2924e32b32db6a8bcac8b09 [id=a23998bd42d846bc8d16b536d9f8a5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.555106 1028 tablet_service.cc:1511] Processing CreateTablet for tablet a9f525ffe8cb430fb87941c019d40e62 (DEFAULT_TABLE table=default.Table_263867c4fce84a18a43a51cf5e9cc83a [id=ca2eca1a2b1f4c2eb8219b87a6bd6f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.555583 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8d94034beb4337b5f4e8567f395c00 (DEFAULT_TABLE table=default.Table_56afa8aee6ee42ec83d259b3cb92bcdb [id=20b98f0559064d74946803b7a84a0f43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.555974 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a169ada5a5da477a82a533fd18a5ea5c (DEFAULT_TABLE table=default.Table_7d27b080b2054ad88ad8a0e7fcbb1c49 [id=9b149bca38a441538ff1af6fd23c0ede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.559918 881 tablet_service.cc:1511] Processing CreateTablet for tablet 563443a5f2ab43daae3804d626c59daf (DEFAULT_TABLE table=default.Table_3d0944f4a80441b19a193cf8f179fc48 [id=5c7abf31ba524e36a413fa1556cfe80b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.560284 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563443a5f2ab43daae3804d626c59daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.560757 1846 ts_tablet_manager.cc:1929] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:19.560963 1846 log.cc:1199] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/df4f9101deaa4e6ebddacbce14f32810
I20260617 07:53:19.561409 1846 ts_tablet_manager.cc:1950] T df4f9101deaa4e6ebddacbce14f32810 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:19.561817 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421ad54782ac4ea1bef756a0129b3f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.564522 2217 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:19.566130 1021 tablet_service.cc:1511] Processing CreateTablet for tablet e62175d5cc854d45838454043220954e (DEFAULT_TABLE table=default.Table_6defd798d4bd4e6f88986301755535ce [id=24df163731ea4ae7b5852a8b6c0c22f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.566551 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet a90472b619d644b7b01f5104872ecb64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.566905 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 543fd8173b174946830d6228e47b2caa (DEFAULT_TABLE table=default.Table_3afd0e47dfc84e8f92c7684c766a3f99 [id=6eec41313c064a18b7ae230a359421fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.567418 1017 tablet_service.cc:1511] Processing CreateTablet for tablet f30f0bbfdf404569a417662861b06f73 (DEFAULT_TABLE table=default.Table_df8e6f336fd640d1aaf3d25d471ae455 [id=d2d387734e9c423e98ce53ee2ee54483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.568941 898 tablet_service.cc:1511] Processing CreateTablet for tablet a22d9bc2cbe2478e869e54878e52e0ed (DEFAULT_TABLE table=default.Table_02c5782d285546afa40f4361def24646 [id=8b62493c83bb4158a57a3f8a498bb405]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.569337 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22d9bc2cbe2478e869e54878e52e0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.574275 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet c449d3e251aa4f06a9191114bff0e0e2
I20260617 07:53:19.578146 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 4f95a13b909c4ef9be6c56a317b42c9b
I20260617 07:53:19.578961 456 catalog_manager.cc:6784] ReplaceTablet: tablet 4f95a13b909c4ef9be6c56a317b42c9b deleted and replaced by tablet 9c86376216db4788b38bd55248e03f73
I20260617 07:53:19.581956 897 tablet_service.cc:1511] Processing CreateTablet for tablet c31e808cf0604b3099230d8c2e0d609e (DEFAULT_TABLE table=default.Table_b5dd820c6a314f5485eca5465c792124 [id=53fccd2baba24a48875ea610f9093ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.582142 879 tablet_service.cc:1511] Processing CreateTablet for tablet 83878d63683d49a6836ed0f925397e61 (DEFAULT_TABLE table=default.Table_b258682fadd740239b48cefca07e7c9c [id=ab1a0ecfbeba4ab6a9d2e0a48f89c78c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.582494 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83878d63683d49a6836ed0f925397e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.582798 894 tablet_service.cc:1511] Processing CreateTablet for tablet 86ba708f127f40398ddf6fd846e4ff49 (DEFAULT_TABLE table=default.Table_4b4c152f005d443b9db80fc5cafbf4ae [id=4c14d2bb781e4eed86d140a88dc5e05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.583086 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ba708f127f40398ddf6fd846e4ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.583655 887 tablet_service.cc:1511] Processing CreateTablet for tablet 6ceed46b23984d57aa124e68e0b46693 (DEFAULT_TABLE table=default.Table_f94dddebaece42fe99a7e74a77bbf420 [id=b7112a7a634a4c0eafc88be590d28810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.583943 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ceed46b23984d57aa124e68e0b46693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.584451 882 tablet_service.cc:1558] Processing DeleteTablet for tablet c449d3e251aa4f06a9191114bff0e0e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.589788 753 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2932085f7a48b69589b4a71182a81c (DEFAULT_TABLE table=default.Table_1aca1a9fa2a640cd8e74ee5d6f9fc169 [id=dcd38705a5fb45c2a797489ba7fa7b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.590185 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2932085f7a48b69589b4a71182a81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.587810 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 563443a5f2ab43daae3804d626c59daf (DEFAULT_TABLE table=default.Table_3d0944f4a80441b19a193cf8f179fc48 [id=5c7abf31ba524e36a413fa1556cfe80b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.588212 1018 tablet_service.cc:1511] Processing CreateTablet for tablet a22d9bc2cbe2478e869e54878e52e0ed (DEFAULT_TABLE table=default.Table_02c5782d285546afa40f4361def24646 [id=8b62493c83bb4158a57a3f8a498bb405]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.588372 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 86ba708f127f40398ddf6fd846e4ff49 (DEFAULT_TABLE table=default.Table_4b4c152f005d443b9db80fc5cafbf4ae [id=4c14d2bb781e4eed86d140a88dc5e05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.588723 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 6ceed46b23984d57aa124e68e0b46693 (DEFAULT_TABLE table=default.Table_f94dddebaece42fe99a7e74a77bbf420 [id=b7112a7a634a4c0eafc88be590d28810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.589193 1020 tablet_service.cc:1511] Processing CreateTablet for tablet c31e808cf0604b3099230d8c2e0d609e (DEFAULT_TABLE table=default.Table_b5dd820c6a314f5485eca5465c792124 [id=53fccd2baba24a48875ea610f9093ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.589573 1029 tablet_service.cc:1511] Processing CreateTablet for tablet b0d04392768a43549e7c53f3a79c4319 (DEFAULT_TABLE table=default.Table_799b237a420c4cd8aed8a93f578d1ec0 [id=bc98c11f57bd4f5f9fdae3eda3b29002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.594736 882 tablet_service.cc:1511] Processing CreateTablet for tablet b7ce4223941643feabfb199c5f0de122 (DEFAULT_TABLE table=default.Table_71adaf9340434984a17d180f03ab2392 [id=d5c4053c843c4bb4ab49bfb937ba6dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.595095 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ce4223941643feabfb199c5f0de122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.595150 746 tablet_service.cc:1511] Processing CreateTablet for tablet e28f09dff8a547a993c98494ac9ee928 (DEFAULT_TABLE table=default.Table_93e8d29da1584b79abf1bd4823335929 [id=f5d9e6286ba942d6b337c551d9b9ed5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.592707 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 83878d63683d49a6836ed0f925397e61 (DEFAULT_TABLE table=default.Table_b258682fadd740239b48cefca07e7c9c [id=ab1a0ecfbeba4ab6a9d2e0a48f89c78c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.592778 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f95a13b909c4ef9be6c56a317b42c9b with delete_type TABLET_DATA_DELETED (replaced by tablet 9c86376216db4788b38bd55248e03f73) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.592958 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2dc449c88d4008a38c42eca25a283c (DEFAULT_TABLE table=default.Table_da921136077749c8bf90acd3f0394183 [id=a2eeebb42edc44c1a4c4a19f2affb67a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.588912 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet c449d3e251aa4f06a9191114bff0e0e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.592941 2496 raft_consensus.cc:493] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.596367 2496 raft_consensus.cc:515] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.596870 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28f09dff8a547a993c98494ac9ee928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.596990 2496 leader_election.cc:290] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:19.586527 2525 raft_consensus.cc:493] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.597357 2525 raft_consensus.cc:515] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.598392 2525 leader_election.cc:290] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:19.599491 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f95a13b909c4ef9be6c56a317b42c9b with delete_type TABLET_DATA_DELETED (replaced by tablet 9c86376216db4788b38bd55248e03f73) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.601513 889 tablet_service.cc:1511] Processing CreateTablet for tablet b0d04392768a43549e7c53f3a79c4319 (DEFAULT_TABLE table=default.Table_799b237a420c4cd8aed8a93f578d1ec0 [id=bc98c11f57bd4f5f9fdae3eda3b29002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.601866 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d04392768a43549e7c53f3a79c4319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.604840 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58bbdbf59c7426c8adbbbe3f0aafaed" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:19.598714 2086 consensus_queue.cc:1048] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:19.605587 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c3bf1860c34ee3821bf273234cb0a4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:19.606343 1026 tablet_service.cc:1511] Processing CreateTablet for tablet b7ce4223941643feabfb199c5f0de122 (DEFAULT_TABLE table=default.Table_71adaf9340434984a17d180f03ab2392 [id=d5c4053c843c4bb4ab49bfb937ba6dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.606667 742 tablet_service.cc:1511] Processing CreateTablet for tablet da1d2f5f9b0441e8bbfd6571570f4f88 (DEFAULT_TABLE table=default.Table_93379979809441178fa6c159c07f77ce [id=1ce585dfe5c64a0caed626f1f56a05f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.607139 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1d2f5f9b0441e8bbfd6571570f4f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.607100 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 04eea64f33344c31b75cd3f659812e7e (DEFAULT_TABLE table=default.Table_f01d494fa8eb446bbd9e6765de851e35 [id=a36bc2f132f448dba3a844a17379eeb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.607647 1015 tablet_service.cc:1511] Processing CreateTablet for tablet fdedb9a69a0744439fd2c804e180933b (DEFAULT_TABLE table=default.Table_f320a356edaa463dae9407cbd2263d6f [id=514c8a0447694ff987d75f8a2ac4fe27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.609395 1014 tablet_service.cc:1511] Processing CreateTablet for tablet f659b794a08745d2a111016332e604b8 (DEFAULT_TABLE table=default.Table_732577db3896433fa1d09544bbf1ffb7 [id=79ea96f126514fe4ae239d26cae2c51d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:19.609992 986 leader_election.cc:343] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:19.610337 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58bbdbf59c7426c8adbbbe3f0aafaed" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:19.612844 743 tablet_service.cc:1511] Processing CreateTablet for tablet a90472b619d644b7b01f5104872ecb64 (DEFAULT_TABLE table=default.Table_93a30efc9eaf4d88a07a973b6dd6c51a [id=82397ab1830f4809994d4facef032d9b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:19.613189 986 leader_election.cc:343] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:19.613278 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90472b619d644b7b01f5104872ecb64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.614006 750 tablet_service.cc:1511] Processing CreateTablet for tablet 5c48a40032034f9c90df60b61d536222 (DEFAULT_TABLE table=default.Table_1077b4b7bbb44940ba86c9aa6b6d7ff4 [id=d121a3f896c5406b82de124c7233238a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.614261 1178 tablet_bootstrap.cc:492] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:19.610179 1013 tablet_service.cc:1511] Processing CreateTablet for tablet 8d27dcd5af04496b8e231115a88b4aeb (DEFAULT_TABLE table=default.Table_9e0d150692fa47c5971861b6614f2b62 [id=30a4e0bd9937460582c5f9841fae2b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.616577 1178 ts_tablet_manager.cc:1403] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.118s user 0.004s sys 0.001s
I20260617 07:53:19.615911 741 tablet_service.cc:1511] Processing CreateTablet for tablet a19e7645e3aa4b378f3f12df19cdec86 (DEFAULT_TABLE table=default.Table_4a4a4aa9eb5b41a797441b36757c7db8 [id=0ea232a84d5641a2bbbc73ad9cb9f781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.616652 748 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2bd01bab4840398d89c421a446dea7 (DEFAULT_TABLE table=default.Table_2a74749dc2164127b0c24e5e6fe5df46 [id=3c84b0551a464928964a4a9663c7bf44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.614328 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c48a40032034f9c90df60b61d536222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.608546 893 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2dc449c88d4008a38c42eca25a283c (DEFAULT_TABLE table=default.Table_da921136077749c8bf90acd3f0394183 [id=a2eeebb42edc44c1a4c4a19f2affb67a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.621819 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2dc449c88d4008a38c42eca25a283c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.622448 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2bd01bab4840398d89c421a446dea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.622491 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_de82b245aadc4b368d45f9fc52330c76 [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 2 got 0
I20260617 07:53:19.622709 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
I20260617 07:53:19.625829 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19e7645e3aa4b378f3f12df19cdec86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.632737 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 362) took 2417 ms. Trace:
I20260617 07:53:19.632858 1862 rpcz_store.cc:276] 0617 07:53:17.215104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.215155 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:19.305584 (+2090429us) ts_tablet_manager.cc:1151] Deleting tablet 99ec78c123d448329b8442a0de0140d3
0617 07:53:19.305593 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.429738 (+124145us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.531593 (+101855us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.632710 (+101117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2090262}
I20260617 07:53:19.633104 1171 tablet_bootstrap.cc:492] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:19.633211 1171 ts_tablet_manager.cc:1403] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.113s user 0.002s sys 0.004s
I20260617 07:53:19.633224 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 367) took 2274 ms. Trace:
I20260617 07:53:19.633283 1862 rpcz_store.cc:276] 0617 07:53:17.358838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.359636 (+ 798us) service_pool.cc:224] Handling call
0617 07:53:19.633110 (+2273474us) ts_tablet_manager.cc:1151] Deleting tablet 283c08c31718433e83f0cedd799215fe
0617 07:53:19.633119 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.633211 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2273304}
I20260617 07:53:19.633549 1862 tablet_replica.cc:333] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:19.633777 1862 raft_consensus.cc:2243] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:19.633971 1862 pending_rounds.cc:70] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:19.634016 1862 pending_rounds.cc:77] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772746274099200 op_type: NO_OP noop_request { }
I20260617 07:53:19.634094 1862 raft_consensus.cc:2889] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:19.634158 1862 raft_consensus.cc:2272] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:19.634781 1862 ts_tablet_manager.cc:1916] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:19.635087 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31e808cf0604b3099230d8c2e0d609e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.637168 2201 consensus_queue.cc:1048] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:19.642369 1044 raft_consensus.cc:2468] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:19.643116 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1345155f7448ca9be675d262cd00c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.643287 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2dc449c88d4008a38c42eca25a283c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.643452 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543fd8173b174946830d6228e47b2caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.643633 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f659b794a08745d2a111016332e604b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.643885 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83878d63683d49a6836ed0f925397e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.644152 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a169ada5a5da477a82a533fd18a5ea5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.644307 1013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d27dcd5af04496b8e231115a88b4aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.644447 1017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30f0bbfdf404569a417662861b06f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.644614 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ce4223941643feabfb199c5f0de122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.644779 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdedb9a69a0744439fd2c804e180933b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.644935 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62175d5cc854d45838454043220954e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.645169 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31e808cf0604b3099230d8c2e0d609e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.645426 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8d94034beb4337b5f4e8567f395c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.645742 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f525ffe8cb430fb87941c019d40e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.649386 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 17c8a945eca643f3b3f4807406e9a24e
I20260617 07:53:19.649807 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ceed46b23984d57aa124e68e0b46693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.651856 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c0ae1553e2aa43cf85c7584f5fff935e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.652438 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0ae1553e2aa43cf85c7584f5fff935e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.653623 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb" } modify_external_catalogs: true
I20260617 07:53:19.653808 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb" } modify_external_catalogs: true
I20260617 07:53:19.654620 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d04392768a43549e7c53f3a79c4319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.654963 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_19bcaae67f924039b2fcfdfda462c8e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.655475 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19bcaae67f924039b2fcfdfda462c8e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.655787 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_42699429d869420995a9231757782531"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.656198 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42699429d869420995a9231757782531 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.656683 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b9d65c1bfb2444369b6830f1264a52ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.657089 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9d65c1bfb2444369b6830f1264a52ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.657809 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ba708f127f40398ddf6fd846e4ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.658522 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 17c8a945eca643f3b3f4807406e9a24e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.661827 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563443a5f2ab43daae3804d626c59daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.661973 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_41ef34e21782488da51b458e095e7bcc" } new_table_name: "default.Table_a5cdd598297a4c71917c34f4e77c68fb" modify_external_catalogs: true
I20260617 07:53:19.662300 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
I20260617 07:53:19.644647 1170 ts_tablet_manager.cc:1929] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:19.668327 1170 log.cc:1199] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/68b448c65e684f49bf142ce2b5084d33
I20260617 07:53:19.668548 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 37b36c91191445478055b78830be9450
I20260617 07:53:19.668633 1170 ts_tablet_manager.cc:1950] T 68b448c65e684f49bf142ce2b5084d33 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:19.669386 886 tablet_service.cc:1511] Processing CreateTablet for tablet f659b794a08745d2a111016332e604b8 (DEFAULT_TABLE table=default.Table_732577db3896433fa1d09544bbf1ffb7 [id=79ea96f126514fe4ae239d26cae2c51d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.669787 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f659b794a08745d2a111016332e604b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.669811 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04eea64f33344c31b75cd3f659812e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.670946 1846 tablet_replica.cc:333] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:19.671165 1846 raft_consensus.cc:2243] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:19.671315 1846 raft_consensus.cc:2272] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:19.671808 1846 ts_tablet_manager.cc:1916] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:19.673832 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22d9bc2cbe2478e869e54878e52e0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.673882 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 37b36c91191445478055b78830be9450 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.621235 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c3bf1860c34ee3821bf273234cb0a4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:19.675462 892 tablet_service.cc:1511] Processing CreateTablet for tablet 04eea64f33344c31b75cd3f659812e7e (DEFAULT_TABLE table=default.Table_f01d494fa8eb446bbd9e6765de851e35 [id=a36bc2f132f448dba3a844a17379eeb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.678923 880 tablet_service.cc:1511] Processing CreateTablet for tablet fdedb9a69a0744439fd2c804e180933b (DEFAULT_TABLE table=default.Table_f320a356edaa463dae9407cbd2263d6f [id=514c8a0447694ff987d75f8a2ac4fe27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.679900 1178 raft_consensus.cc:359] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:19.680107 1178 raft_consensus.cc:385] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.680184 1178 raft_consensus.cc:740] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.680605 758 tablet_service.cc:1511] Processing CreateTablet for tablet 6806000ebdc14d758404f01021ec2440 (DEFAULT_TABLE table=default.Table_379c9732503049fa8e201f6b86a96023 [id=f7614b475a8c419d984ea3189855ca2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.681320 759 tablet_service.cc:1511] Processing CreateTablet for tablet c8848c0f52e34c118a9e1831b8c9a88e (DEFAULT_TABLE table=default.Table_dd16c59e32e542048095a371aaddb95b [id=c12a3c4eaa2342e089d4b405c4d7c304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.681680 749 tablet_service.cc:1558] Processing DeleteTablet for tablet cbc79cfa11e342bd87da1aa03847c3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.682085 755 tablet_service.cc:1511] Processing CreateTablet for tablet 53ff0de05b8c4185aa6de2370d699617 (DEFAULT_TABLE table=default.Table_5b32814e8ada4019bbdf078311f1a5ee [id=bd0b7b2a287d42b6a0f68dfdf3425226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.682498 745 tablet_service.cc:1511] Processing CreateTablet for tablet 61510f9812e849e388c6c163e9af5f4f (DEFAULT_TABLE table=default.Table_ba0bea034f4a49e88ecbdec5d9b3c6cb [id=964a0b6e388a4823bb124eef82b57431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.683876 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d94915d96694d6f9a86063640e5fe18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.684299 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 5ec425bb523a449d9fe16d3ea3a0d7ae from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:19.684716 751 tablet_service.cc:1558] Processing DeleteTablet for tablet e9f8492f127243eca07b2ffbabddded5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.685185 751 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1d9ce2ab5b428893719d9acd272d88 with delete_type TABLET_DATA_DELETED (replaced by tablet 20cfb1ae290f43cbadead54c8f692f21) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.685803 1178 consensus_queue.cc:260] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:19.686134 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cdcd3904a754939b9ae09cc3672bbc6 with delete_type TABLET_DATA_DELETED (replaced by tablet 24c31a34256748198b12a4503946179e) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.687758 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 63de833f7aa740b0b5bf2494b78aca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.688339 751 tablet_service.cc:1558] Processing DeleteTablet for tablet eafcf54494f244f1b978b4b5e39d93bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.690564 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_f01d494fa8eb446bbd9e6765de851e35" } new_table_name: "default.Table_727da69fbad147f5a1962b8552b06325" modify_external_catalogs: true
I20260617 07:53:19.691944 751 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1345155f7448ca9be675d262cd00c1 (DEFAULT_TABLE table=default.Table_20cf1c4fc2924e32b32db6a8bcac8b09 [id=a23998bd42d846bc8d16b536d9f8a5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.692672 749 tablet_service.cc:1511] Processing CreateTablet for tablet a9f525ffe8cb430fb87941c019d40e62 (DEFAULT_TABLE table=default.Table_263867c4fce84a18a43a51cf5e9cc83a [id=ca2eca1a2b1f4c2eb8219b87a6bd6f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.692761 1178 ts_tablet_manager.cc:1434] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260617 07:53:19.693075 1178 tablet_bootstrap.cc:492] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:19.694263 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 61510f9812e849e388c6c163e9af5f4f
I20260617 07:53:19.694631 1178 tablet_bootstrap.cc:654] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.696313 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d5600121c81049589ce932a199273324" } new_table_name: "default.Table_fe8411e8dafb47529b9c43928203b95a" modify_external_catalogs: true
I20260617 07:53:19.695686 754 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8d94034beb4337b5f4e8567f395c00 (DEFAULT_TABLE table=default.Table_56afa8aee6ee42ec83d259b3cb92bcdb [id=20b98f0559064d74946803b7a84a0f43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.697494 760 tablet_service.cc:1511] Processing CreateTablet for tablet a169ada5a5da477a82a533fd18a5ea5c (DEFAULT_TABLE table=default.Table_7d27b080b2054ad88ad8a0e7fcbb1c49 [id=9b149bca38a441538ff1af6fd23c0ede]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.698182 757 tablet_service.cc:1511] Processing CreateTablet for tablet e62175d5cc854d45838454043220954e (DEFAULT_TABLE table=default.Table_6defd798d4bd4e6f88986301755535ce [id=24df163731ea4ae7b5852a8b6c0c22f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.698792 756 tablet_service.cc:1511] Processing CreateTablet for tablet 543fd8173b174946830d6228e47b2caa (DEFAULT_TABLE table=default.Table_3afd0e47dfc84e8f92c7684c766a3f99 [id=6eec41313c064a18b7ae230a359421fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.698789 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_d6a4062d8d074e97924f88fee63c1e86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.699440 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6a4062d8d074e97924f88fee63c1e86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.700805 752 tablet_service.cc:1558] Processing DeleteTablet for tablet a90472b619d644b7b01f5104872ecb64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:19.711390 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 07431acc9208489aaea2f8c4205e46a5 consensus state has no leader
W20260617 07:53:19.717231 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04eea64f33344c31b75cd3f659812e7e consensus state has no leader
I20260617 07:53:19.718405 747 tablet_service.cc:1511] Processing CreateTablet for tablet f30f0bbfdf404569a417662861b06f73 (DEFAULT_TABLE table=default.Table_df8e6f336fd640d1aaf3d25d471ae455 [id=d2d387734e9c423e98ce53ee2ee54483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.719624 748 tablet_service.cc:1511] Processing CreateTablet for tablet 563443a5f2ab43daae3804d626c59daf (DEFAULT_TABLE table=default.Table_3d0944f4a80441b19a193cf8f179fc48 [id=5c7abf31ba524e36a413fa1556cfe80b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.721459 741 tablet_service.cc:1511] Processing CreateTablet for tablet a22d9bc2cbe2478e869e54878e52e0ed (DEFAULT_TABLE table=default.Table_02c5782d285546afa40f4361def24646 [id=8b62493c83bb4158a57a3f8a498bb405]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.722410 742 tablet_service.cc:1511] Processing CreateTablet for tablet 83878d63683d49a6836ed0f925397e61 (DEFAULT_TABLE table=default.Table_b258682fadd740239b48cefca07e7c9c [id=ab1a0ecfbeba4ab6a9d2e0a48f89c78c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.726049 750 tablet_service.cc:1511] Processing CreateTablet for tablet 86ba708f127f40398ddf6fd846e4ff49 (DEFAULT_TABLE table=default.Table_4b4c152f005d443b9db80fc5cafbf4ae [id=4c14d2bb781e4eed86d140a88dc5e05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.726433 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 5ec425bb523a449d9fe16d3ea3a0d7ae
I20260617 07:53:19.726883 461 catalog_manager.cc:6784] ReplaceTablet: tablet 5ec425bb523a449d9fe16d3ea3a0d7ae deleted and replaced by tablet 9c73a9d54fed46d9a4e71acf3caf7285
I20260617 07:53:19.727135 746 tablet_service.cc:1511] Processing CreateTablet for tablet c31e808cf0604b3099230d8c2e0d609e (DEFAULT_TABLE table=default.Table_b5dd820c6a314f5485eca5465c792124 [id=53fccd2baba24a48875ea610f9093ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.727706 743 tablet_service.cc:1558] Processing DeleteTablet for tablet c449d3e251aa4f06a9191114bff0e0e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.728257 2496 raft_consensus.cc:493] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.728293 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f95a13b909c4ef9be6c56a317b42c9b with delete_type TABLET_DATA_DELETED (replaced by tablet 9c86376216db4788b38bd55248e03f73) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:19.728380 2496 raft_consensus.cc:515] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.728896 743 tablet_service.cc:1511] Processing CreateTablet for tablet b0d04392768a43549e7c53f3a79c4319 (DEFAULT_TABLE table=default.Table_799b237a420c4cd8aed8a93f578d1ec0 [id=bc98c11f57bd4f5f9fdae3eda3b29002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.729013 2496 leader_election.cc:290] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:19.729578 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc3d13d519843a9bc38e97dc85b67c8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:19.729750 744 tablet_service.cc:1511] Processing CreateTablet for tablet b7ce4223941643feabfb199c5f0de122 (DEFAULT_TABLE table=default.Table_71adaf9340434984a17d180f03ab2392 [id=d5c4053c843c4bb4ab49bfb937ba6dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.730020 752 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2dc449c88d4008a38c42eca25a283c (DEFAULT_TABLE table=default.Table_da921136077749c8bf90acd3f0394183 [id=a2eeebb42edc44c1a4c4a19f2affb67a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.730202 2217 pending_rounds.cc:85] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Aborting all ops after (but not including) 526
W20260617 07:53:19.730363 986 leader_election.cc:343] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:19.730387 2217 pending_rounds.cc:107] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Aborting uncommitted WRITE_OP operation due to leader change: 1.527
I20260617 07:53:19.731125 2217 pending_rounds.cc:107] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Aborting uncommitted WRITE_OP operation due to leader change: 1.528
I20260617 07:53:19.731395 2217 pending_rounds.cc:107] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Aborting uncommitted WRITE_OP operation due to leader change: 1.529
I20260617 07:53:19.729750 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 294) took 4094 ms. Trace:
I20260617 07:53:19.734066 1170 rpcz_store.cc:276] 0617 07:53:15.635438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.636570 (+ 1132us) service_pool.cc:224] Handling call
0617 07:53:19.438254 (+3801684us) ts_tablet_manager.cc:1151] Deleting tablet 68b448c65e684f49bf142ce2b5084d33
0617 07:53:19.438266 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.536198 (+ 97932us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.643963 (+107765us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.729693 (+ 85730us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3801566}
I20260617 07:53:19.734452 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 295) took 4098 ms. Trace:
I20260617 07:53:19.734407 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c2504ce95816485aa56a2ae775555496"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:19.734517 1170 rpcz_store.cc:276] 0617 07:53:15.635516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.636710 (+ 1194us) service_pool.cc:224] Handling call
0617 07:53:19.734373 (+4097663us) ts_tablet_manager.cc:1151] Deleting tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
0617 07:53:19.734380 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.734438 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4097557}
I20260617 07:53:19.734817 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 297) took 4099 ms. Trace:
I20260617 07:53:19.734872 1170 rpcz_store.cc:276] 0617 07:53:15.635679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.636839 (+ 1160us) service_pool.cc:224] Handling call
0617 07:53:19.734730 (+4097891us) ts_tablet_manager.cc:1151] Deleting tablet 8a4f81daf583464e988521e189ca39b6
0617 07:53:19.734738 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.734804 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4097786}
I20260617 07:53:19.734879 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e714f3a59eb94e1ab0847a4bbb95f4aa" } new_table_name: "default.Table_539fd5773b6749b7aa922ab7ba5250ad" modify_external_catalogs: true
W20260617 07:53:19.735014 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2504ce95816485aa56a2ae775555496 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.735074 1170 tablet_replica.cc:333] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:19.735235 1170 raft_consensus.cc:2243] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:19.735435 1170 pending_rounds.cc:70] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:19.735476 1170 pending_rounds.cc:77] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772746467512320 op_type: NO_OP noop_request { }
I20260617 07:53:19.735566 1170 raft_consensus.cc:2889] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:19.735632 1170 raft_consensus.cc:2272] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:19.736227 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]) successfully deleted
W20260617 07:53:19.736605 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 because the tablet was not found. No further retry: Not found: Tablet not found: 3bee4c9cd9f2415ca54b8e85dbd326a7
W20260617 07:53:19.736800 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
W20260617 07:53:19.738052 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c2bae0d7dfe4512b1674796e5dacf27 consensus state has no leader
I20260617 07:53:19.738230 1170 ts_tablet_manager.cc:1916] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:19.744767 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6806000ebdc14d758404f01021ec2440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.744966 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2dc449c88d4008a38c42eca25a283c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.745221 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ce4223941643feabfb199c5f0de122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.745457 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62175d5cc854d45838454043220954e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.745811 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f525ffe8cb430fb87941c019d40e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.746016 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30f0bbfdf404569a417662861b06f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.746372 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1345155f7448ca9be675d262cd00c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.746709 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a169ada5a5da477a82a533fd18a5ea5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.747089 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8d94034beb4337b5f4e8567f395c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.747515 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543fd8173b174946830d6228e47b2caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.747902 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ff0de05b8c4185aa6de2370d699617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.748379 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61510f9812e849e388c6c163e9af5f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.748809 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8848c0f52e34c118a9e1831b8c9a88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.749547 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ba708f127f40398ddf6fd846e4ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.750046 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563443a5f2ab43daae3804d626c59daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.750036 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4eb17dccfecb4f6b87322057782dd4f6" } modify_external_catalogs: true
I20260617 07:53:19.750200 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4eb17dccfecb4f6b87322057782dd4f6" } modify_external_catalogs: true
I20260617 07:53:19.750524 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83878d63683d49a6836ed0f925397e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.751075 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31e808cf0604b3099230d8c2e0d609e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.751506 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22d9bc2cbe2478e869e54878e52e0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.752545 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae with delete_type TABLET_DATA_DELETED (replaced by tablet 9c73a9d54fed46d9a4e71acf3caf7285) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.752740 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 61510f9812e849e388c6c163e9af5f4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.766450 1172 tablet_bootstrap.cc:492] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:19.766578 1172 ts_tablet_manager.cc:1403] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.369s user 0.003s sys 0.000s
I20260617 07:53:19.767318 1172 raft_consensus.cc:359] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.767464 1172 raft_consensus.cc:385] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.767508 1172 raft_consensus.cc:740] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.767724 1172 consensus_queue.cc:260] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.768111 454 master_service.cc:960] ReplaceTablet: received request to replace tablet f34a2ee6fa82482db979ab25bc284f8e from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:19.768669 1172 ts_tablet_manager.cc:1434] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:19.768923 1172 tablet_bootstrap.cc:492] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:19.770253 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf]). Expected version 1 got 0
I20260617 07:53:19.771116 1172 tablet_bootstrap.cc:654] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.718921 851 leader_election.cc:304] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
W20260617 07:53:19.775309 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 56412.1us
I20260617 07:53:19.776197 2435 raft_consensus.cc:2804] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:19.777362 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2f40c198682e49768bee2d6a87292d46" } modify_external_catalogs: true
I20260617 07:53:19.777549 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2f40c198682e49768bee2d6a87292d46" } modify_external_catalogs: true
I20260617 07:53:19.780049 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04eea64f33344c31b75cd3f659812e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.789311 744 tablet_service.cc:1511] Processing CreateTablet for tablet 04eea64f33344c31b75cd3f659812e7e (DEFAULT_TABLE table=default.Table_f01d494fa8eb446bbd9e6765de851e35 [id=a36bc2f132f448dba3a844a17379eeb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.791867 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 66bd830c11b4412ba5a88afec7c9384a (DEFAULT_TABLE table=default.Table_4aca29909fcd4a02bcc1120e759db2c4 [id=505c0711091b48c8a02c54f5e4cb2f33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.792383 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb613ba734549b3bb21ebd27f364ad3 (DEFAULT_TABLE table=default.Table_008e34768d4f46ec8840e9d2af6a8d0a [id=ae426b54a7ce4da795ffac1321fb5331]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.792814 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 40900f4b7a604abd9b020c2b396fb942 (DEFAULT_TABLE table=default.Table_74f5825fca4f43fda3f8588f35919752 [id=ce1af3b747ab4f6a852b7dfe56c821d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.793212 1013 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 (DEFAULT_TABLE table=default.Table_e8431c1ec669439d8a2e5d4941c87229 [id=82e3b8ffa5114e59a20d7aaa93aca993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.793610 1014 tablet_service.cc:1511] Processing CreateTablet for tablet c1edc8311d4140d98dfe98a1e99746c6 (DEFAULT_TABLE table=default.Table_ebcdc640e6034a69a9f5c70474fed5c4 [id=9ce8ab0896fe4a0fb8a1649218a7983e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.794052 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 3f15151bd3d542dea6d5565c7e94c68f (DEFAULT_TABLE table=default.Table_3e7568e9e053459ab5fa24e209310e3c [id=8b380f1faf41458b9870086d72a1bcc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.794813 1024 tablet_service.cc:1511] Processing CreateTablet for tablet e793cbccf5774e95a8316d6298d4646f (DEFAULT_TABLE table=default.Table_4f46dc52ee0141efa08440414be77e91 [id=b1a87e7409874e73865039a2c7c36f1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.795966 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 3910709fabea44fcb2902fba6957bd57 (DEFAULT_TABLE table=default.Table_f36c303bfe55438fbf17a23b0a747152 [id=b8cf3aff4d5247669f6c873686328185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.796367 885 tablet_service.cc:1511] Processing CreateTablet for tablet 8d27dcd5af04496b8e231115a88b4aeb (DEFAULT_TABLE table=default.Table_9e0d150692fa47c5971861b6614f2b62 [id=30a4e0bd9937460582c5f9841fae2b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.797154 1018 tablet_service.cc:1511] Processing CreateTablet for tablet eb2f0680609849828fd5a368aac4ba92 (DEFAULT_TABLE table=default.Table_524a3b28dffc47f5bf32de043600d64b [id=aa8cd77b2d264cf2825b01ba42b57cef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.798319 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 501c69ae3c884a9b8982fa0e8d45f54f (DEFAULT_TABLE table=default.Table_1f8f6f44936841a1ab358a3ee70dffef [id=deaf56ec423a4145a8fee134886d4584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.799536 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 20cfb1ae290f43cbadead54c8f692f21 (DEFAULT_TABLE table=default.Table_74d1e24e8c594e52b77ec38499225bc1 [id=912e818e8697427a8ce7dc146b9a428f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:19.799672 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f395f963a5a5400a966a8d4cc62aadf1 consensus state has no leader
I20260617 07:53:19.803906 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdedb9a69a0744439fd2c804e180933b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.804100 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 92d1398b4b604f75be1a3b46e5ac9b77 (DEFAULT_TABLE table=default.Table_e3e48dd41d7142f3b6445fe78c01f8a4 [id=91e1bc076d9742fcadca8e0b3451cffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.804682 1022 tablet_service.cc:1511] Processing CreateTablet for tablet bbdd18c3c7994cc29c87313554f0f92c (DEFAULT_TABLE table=default.Table_8f25b118b9a24509b2a36db020170b88 [id=b07ec5d2900f448ab01920dba30314db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.807960 1020 tablet_service.cc:1511] Processing CreateTablet for tablet f6204d6e031544418b651320c69ca427 (DEFAULT_TABLE table=default.Table_b6330dfd02194901ac18d158d95ee77e [id=2c06ed2064084e6da498af5d318ff2ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.808719 1172 tablet_bootstrap.cc:492] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:19.808831 1172 ts_tablet_manager.cc:1403] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.000s
I20260617 07:53:19.809981 1172 raft_consensus.cc:359] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.810289 1172 raft_consensus.cc:385] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.810386 1172 raft_consensus.cc:740] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.810639 1172 consensus_queue.cc:260] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.813478 1172 ts_tablet_manager.cc:1434] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:19.813817 1172 tablet_bootstrap.cc:492] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:19.815449 1172 tablet_bootstrap.cc:654] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:19.817880 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9e13fefa0bed48e588fc1d7c49e2c342 (DEFAULT_TABLE table=default.Table_bb7619faf537427aaff0f71f1963718b [id=ffdd449109f44417b4dacbc3460de659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.822544 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ba887bd4ad9d4b51be3de7fe30eb7147"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.823745 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba887bd4ad9d4b51be3de7fe30eb7147 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.824642 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 66cb3060364d43bbb1571fb5243e57a9 (DEFAULT_TABLE table=default.Table_e7f42d14021e493f8372ea9b69dbb845 [id=0c9f07fca32c4c99b81a67ca94aef99c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.825045 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_7be7b293324744f4b216a6aaf234a5b1" } new_table_name: "default.Table_db0d2ffd1da141af81f7841dbe39b064" modify_external_catalogs: true
I20260617 07:53:19.825938 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 9c86376216db4788b38bd55248e03f73 (DEFAULT_TABLE table=default.Table_360fa4c3327249579a54f68d3a81e327 [id=991ca120d90a4775a9c19d8a63092120]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:19.828912 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 73446.2us
I20260617 07:53:19.829177 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_864d7fa9dccb4fd98be4356a0c0678f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.829818 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_864d7fa9dccb4fd98be4356a0c0678f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.835183 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 67cd66ea6ebc42bda00fbec82da73f16
I20260617 07:53:19.837977 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 24c31a34256748198b12a4503946179e (DEFAULT_TABLE table=default.Table_8ab7027f53c74106b61571eba9efc384 [id=e7267204e3404b1da00d3606b6819479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.842044 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet 67cd66ea6ebc42bda00fbec82da73f16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.842108 1172 tablet_bootstrap.cc:492] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:19.842276 1172 ts_tablet_manager.cc:1403] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260617 07:53:19.843123 1172 raft_consensus.cc:359] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.843331 1172 raft_consensus.cc:385] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.843426 1172 raft_consensus.cc:740] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.843688 1172 consensus_queue.cc:260] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.846293 1172 ts_tablet_manager.cc:1434] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:19.846851 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bd830c11b4412ba5a88afec7c9384a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.847054 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c86376216db4788b38bd55248e03f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.847219 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e13fefa0bed48e588fc1d7c49e2c342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.847395 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f15151bd3d542dea6d5565c7e94c68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.847759 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e793cbccf5774e95a8316d6298d4646f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.848171 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3910709fabea44fcb2902fba6957bd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.848589 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2f0680609849828fd5a368aac4ba92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.848992 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501c69ae3c884a9b8982fa0e8d45f54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.849385 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cfb1ae290f43cbadead54c8f692f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.849792 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d1398b4b604f75be1a3b46e5ac9b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.850155 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbdd18c3c7994cc29c87313554f0f92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.850492 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6204d6e031544418b651320c69ca427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.850893 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cb3060364d43bbb1571fb5243e57a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.853343 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet f34a2ee6fa82482db979ab25bc284f8e
I20260617 07:53:19.853518 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 05de71ea02df48ffacb369caa7f7d3de
I20260617 07:53:19.853893 454 catalog_manager.cc:6784] ReplaceTablet: tablet f34a2ee6fa82482db979ab25bc284f8e deleted and replaced by tablet 4d06c3ca75da4a06a8f965f409bbc4a2
I20260617 07:53:19.857822 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1edc8311d4140d98dfe98a1e99746c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.862046 1013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6e2bb6577648d2ab958cfaa6f4a948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.863067 1017 tablet_service.cc:1558] Processing DeleteTablet for tablet f34a2ee6fa82482db979ab25bc284f8e with delete_type TABLET_DATA_DELETED (replaced by tablet 4d06c3ca75da4a06a8f965f409bbc4a2) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.863241 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 05de71ea02df48ffacb369caa7f7d3de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:19.866081 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb613ba734549b3bb21ebd27f364ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.869822 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40900f4b7a604abd9b020c2b396fb942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.875231 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2e4311968bfb4956bb02a8626f5d767f" } modify_external_catalogs: true
I20260617 07:53:19.876049 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2e4311968bfb4956bb02a8626f5d767f" } modify_external_catalogs: true
I20260617 07:53:19.877166 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b672313e82be462e8bb8adaec42d9ee2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.878079 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b672313e82be462e8bb8adaec42d9ee2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.879204 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3fc8a58b75aa415993c1afd907d3c7d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.879981 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fc8a58b75aa415993c1afd907d3c7d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.881035 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_bfa59190ca144c4d9d0cbab7a39eef9c" } modify_external_catalogs: true
I20260617 07:53:19.881543 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_bfa59190ca144c4d9d0cbab7a39eef9c" } modify_external_catalogs: true
W20260617 07:53:19.898054 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b8ffe940130474ca09d3680e470918a consensus state has no leader
I20260617 07:53:19.900163 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_6a44bc16d9d44201b9858bcb02b82fb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:19.900589 2516 raft_consensus.cc:493] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.900774 2516 raft_consensus.cc:515] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:19.900954 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a44bc16d9d44201b9858bcb02b82fb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.901855 2516 leader_election.cc:290] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:19.902575 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad with delete_type TABLET_DATA_DELETED (replaced by tablet 01abd7aed0fd4d2b90db9f40029b5b37) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.902626 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5062aff937d2497d8947cb2c4f1c87bb" } modify_external_catalogs: true
I20260617 07:53:19.902786 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5062aff937d2497d8947cb2c4f1c87bb" } modify_external_catalogs: true
I20260617 07:53:19.903497 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.903955 1171 raft_consensus.cc:359] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.904157 1171 raft_consensus.cc:385] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:19.904242 1171 raft_consensus.cc:740] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:19.904512 1171 consensus_queue.cc:260] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.905027 1171 ts_tablet_manager.cc:1434] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.272s user 0.001s sys 0.001s
I20260617 07:53:19.905112 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e1af9d7bebc74f11a4b6a29e9f0ec21e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:19.905139 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_05211c75563a42548dc7c2184fac8e7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.905745 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1af9d7bebc74f11a4b6a29e9f0ec21e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.906144 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0a368d484ee648bba50a045dab04f192"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:19.906611 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a368d484ee648bba50a045dab04f192 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.907102 2538 consensus_queue.cc:1048] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:19.905751 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05211c75563a42548dc7c2184fac8e7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:19.903024 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5ddac997834e97a2d6c9b1855ee4e8" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:19.923676 891 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc3d13d519843a9bc38e97dc85b67c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.930589 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.930696 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 68b448c65e684f49bf142ce2b5084d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.930835 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 37b36c91191445478055b78830be9450 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.931701 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 61510f9812e849e388c6c163e9af5f4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.939867 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae with delete_type TABLET_DATA_DELETED (replaced by tablet 9c73a9d54fed46d9a4e71acf3caf7285) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.940168 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 17c8a945eca643f3b3f4807406e9a24e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:19.942430 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d27dcd5af04496b8e231115a88b4aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.943248 890 tablet_service.cc:1511] Processing CreateTablet for tablet 40900f4b7a604abd9b020c2b396fb942 (DEFAULT_TABLE table=default.Table_74f5825fca4f43fda3f8588f35919752 [id=ce1af3b747ab4f6a852b7dfe56c821d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.943604 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb613ba734549b3bb21ebd27f364ad3 (DEFAULT_TABLE table=default.Table_008e34768d4f46ec8840e9d2af6a8d0a [id=ae426b54a7ce4da795ffac1321fb5331]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.943799 2538 raft_consensus.cc:493] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.943919 2538 raft_consensus.cc:515] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.944455 2538 leader_election.cc:290] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.947043 894 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 (DEFAULT_TABLE table=default.Table_e8431c1ec669439d8a2e5d4941c87229 [id=82e3b8ffa5114e59a20d7aaa93aca993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.954458 895 tablet_service.cc:1511] Processing CreateTablet for tablet e793cbccf5774e95a8316d6298d4646f (DEFAULT_TABLE table=default.Table_4f46dc52ee0141efa08440414be77e91 [id=b1a87e7409874e73865039a2c7c36f1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.954669 888 tablet_service.cc:1511] Processing CreateTablet for tablet 66bd830c11b4412ba5a88afec7c9384a (DEFAULT_TABLE table=default.Table_4aca29909fcd4a02bcc1120e759db2c4 [id=505c0711091b48c8a02c54f5e4cb2f33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.954743 896 tablet_service.cc:1511] Processing CreateTablet for tablet c1edc8311d4140d98dfe98a1e99746c6 (DEFAULT_TABLE table=default.Table_ebcdc640e6034a69a9f5c70474fed5c4 [id=9ce8ab0896fe4a0fb8a1649218a7983e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.954458 897 tablet_service.cc:1511] Processing CreateTablet for tablet 3f15151bd3d542dea6d5565c7e94c68f (DEFAULT_TABLE table=default.Table_3e7568e9e053459ab5fa24e209310e3c [id=8b380f1faf41458b9870086d72a1bcc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.956802 884 tablet_service.cc:1511] Processing CreateTablet for tablet 3910709fabea44fcb2902fba6957bd57 (DEFAULT_TABLE table=default.Table_f36c303bfe55438fbf17a23b0a747152 [id=b8cf3aff4d5247669f6c873686328185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.957422 887 tablet_service.cc:1511] Processing CreateTablet for tablet eb2f0680609849828fd5a368aac4ba92 (DEFAULT_TABLE table=default.Table_524a3b28dffc47f5bf32de043600d64b [id=aa8cd77b2d264cf2825b01ba42b57cef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.958261 1170 ts_tablet_manager.cc:1929] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:19.959206 1170 log.cc:1199] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5578fd5cb3724ed5b92b313bd52889ad
I20260617 07:53:19.959767 1171 tablet_bootstrap.cc:492] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:19.960673 1170 ts_tablet_manager.cc:1950] T 5578fd5cb3724ed5b92b313bd52889ad P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:19.971570 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2735f7dd40e54aec9004b9b38702607c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:19.971774 1047 raft_consensus.cc:2468] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:19.974432 882 tablet_service.cc:1511] Processing CreateTablet for tablet 501c69ae3c884a9b8982fa0e8d45f54f (DEFAULT_TABLE table=default.Table_1f8f6f44936841a1ab358a3ee70dffef [id=deaf56ec423a4145a8fee134886d4584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.976161 883 tablet_service.cc:1511] Processing CreateTablet for tablet 20cfb1ae290f43cbadead54c8f692f21 (DEFAULT_TABLE table=default.Table_74d1e24e8c594e52b77ec38499225bc1 [id=912e818e8697427a8ce7dc146b9a428f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.984251 1172 tablet_bootstrap.cc:492] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:19.986948 2086 raft_consensus.cc:493] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:19.987648 2435 raft_consensus.cc:697] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:19.990806 881 tablet_service.cc:1511] Processing CreateTablet for tablet 92d1398b4b604f75be1a3b46e5ac9b77 (DEFAULT_TABLE table=default.Table_e3e48dd41d7142f3b6445fe78c01f8a4 [id=91e1bc076d9742fcadca8e0b3451cffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:19.993295 2086 raft_consensus.cc:515] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:19.994144 2086 leader_election.cc:290] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:19.994668 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04eea64f33344c31b75cd3f659812e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:19.987964 2435 consensus_queue.cc:237] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.000718 2544 tablet.cc:1724] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.002350 879 tablet_service.cc:1511] Processing CreateTablet for tablet bbdd18c3c7994cc29c87313554f0f92c (DEFAULT_TABLE table=default.Table_8f25b118b9a24509b2a36db020170b88 [id=b07ec5d2900f448ab01920dba30314db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.003926 753 tablet_service.cc:1511] Processing CreateTablet for tablet 6ceed46b23984d57aa124e68e0b46693 (DEFAULT_TABLE table=default.Table_f94dddebaece42fe99a7e74a77bbf420 [id=b7112a7a634a4c0eafc88be590d28810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.011312 892 tablet_service.cc:1511] Processing CreateTablet for tablet 66cb3060364d43bbb1571fb5243e57a9 (DEFAULT_TABLE table=default.Table_e7f42d14021e493f8372ea9b69dbb845 [id=0c9f07fca32c4c99b81a67ca94aef99c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.014689 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d04392768a43549e7c53f3a79c4319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.015137 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ceed46b23984d57aa124e68e0b46693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.018909 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf]). Expected version 1 got 0
W20260617 07:53:20.019014 988 leader_election.cc:343] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.019146 988 leader_election.cc:304] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:20.019490 2525 raft_consensus.cc:2749] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:20.020177 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 99ec78c123d448329b8442a0de0140d3 (table default.Table_fc5f3ba5ab8a45c7bab81747fe42b662 [id=e65c9a5f1a1f479ea1804dfe806a2926]) successfully deleted
W20260617 07:53:20.020443 988 leader_election.cc:343] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:20.020469 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 283c08c31718433e83f0cedd799215fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 283c08c31718433e83f0cedd799215fe already in progress: creating tablet
I20260617 07:53:20.020550 988 leader_election.cc:304] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:20.020856 2525 raft_consensus.cc:2749] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:20.021237 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ba887bd4ad9d4b51be3de7fe30eb7147" } new_table_name: "default.Table_ccca21d62d364154831f9ccd2cfd2c1d" modify_external_catalogs: true
I20260617 07:53:20.028738 1178 tablet_bootstrap.cc:492] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:20.030644 757 tablet_service.cc:1511] Processing CreateTablet for tablet fdedb9a69a0744439fd2c804e180933b (DEFAULT_TABLE table=default.Table_f320a356edaa463dae9407cbd2263d6f [id=514c8a0447694ff987d75f8a2ac4fe27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.031599 741 tablet_service.cc:1511] Processing CreateTablet for tablet 8d27dcd5af04496b8e231115a88b4aeb (DEFAULT_TABLE table=default.Table_9e0d150692fa47c5971861b6614f2b62 [id=30a4e0bd9937460582c5f9841fae2b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.032042 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d27dcd5af04496b8e231115a88b4aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.036180 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdedb9a69a0744439fd2c804e180933b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.037096 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc3d13d519843a9bc38e97dc85b67c8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:20.037320 915 raft_consensus.cc:2468] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:20.038735 1862 ts_tablet_manager.cc:1929] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:20.038807 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1edc8311d4140d98dfe98a1e99746c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.038842 1862 log.cc:1199] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/49f0f68dcef34228a1b2a018e8aa329e
I20260617 07:53:20.038975 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40900f4b7a604abd9b020c2b396fb942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.039115 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3910709fabea44fcb2902fba6957bd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.039207 1862 ts_tablet_manager.cc:1950] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:20.039500 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e793cbccf5774e95a8316d6298d4646f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.039722 760 tablet_service.cc:1511] Processing CreateTablet for tablet f659b794a08745d2a111016332e604b8 (DEFAULT_TABLE table=default.Table_732577db3896433fa1d09544bbf1ffb7 [id=79ea96f126514fe4ae239d26cae2c51d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.039906 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2f0680609849828fd5a368aac4ba92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.040076 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f659b794a08745d2a111016332e604b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.040161 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bd830c11b4412ba5a88afec7c9384a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.040184 1178 ts_tablet_manager.cc:1403] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.336s user 0.003s sys 0.000s
I20260617 07:53:20.040496 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f15151bd3d542dea6d5565c7e94c68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.040937 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb613ba734549b3bb21ebd27f364ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.045079 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c31a34256748198b12a4503946179e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.047163 1178 raft_consensus.cc:359] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:20.047364 1178 raft_consensus.cc:385] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.047418 1178 raft_consensus.cc:740] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:20.047624 1178 consensus_queue.cc:260] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:20.048060 1172 tablet_bootstrap.cc:654] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.048098 1178 ts_tablet_manager.cc:1434] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.008s user 0.000s sys 0.000s
I20260617 07:53:20.048396 1178 tablet_bootstrap.cc:492] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:20.050422 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 389) took 1923 ms. Trace:
I20260617 07:53:20.050513 1862 rpcz_store.cc:276] 0617 07:53:18.126689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.126764 (+ 75us) service_pool.cc:224] Handling call
0617 07:53:19.633504 (+1506740us) ts_tablet_manager.cc:1151] Deleting tablet 49f0f68dcef34228a1b2a018e8aa329e
0617 07:53:19.633513 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.942061 (+308548us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.038678 (+ 96617us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.050402 (+ 11724us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1506549}
I20260617 07:53:20.050822 1862 tablet_replica.cc:333] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:20.050994 1862 raft_consensus.cc:2243] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.050998 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6e2bb6577648d2ab958cfaa6f4a948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.051139 1862 raft_consensus.cc:2272] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.051641 1862 ts_tablet_manager.cc:1916] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.051726 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501c69ae3c884a9b8982fa0e8d45f54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.051865 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d1398b4b604f75be1a3b46e5ac9b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.055575 889 tablet_service.cc:1511] Processing CreateTablet for tablet f6204d6e031544418b651320c69ca427 (DEFAULT_TABLE table=default.Table_b6330dfd02194901ac18d158d95ee77e [id=2c06ed2064084e6da498af5d318ff2ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.055967 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cfb1ae290f43cbadead54c8f692f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.056612 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbdd18c3c7994cc29c87313554f0f92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.057386 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cb3060364d43bbb1571fb5243e57a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.058583 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 298) took 4422 ms. Trace:
I20260617 07:53:20.058779 1170 rpcz_store.cc:276] 0617 07:53:15.635796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.636979 (+ 1183us) service_pool.cc:224] Handling call
0617 07:53:19.735041 (+4098062us) ts_tablet_manager.cc:1151] Deleting tablet 5578fd5cb3724ed5b92b313bd52889ad
0617 07:53:19.735048 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.846882 (+111834us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:19.958194 (+111312us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.058553 (+100359us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4092500}
I20260617 07:53:20.059414 1170 tablet_replica.cc:333] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:20.059711 1170 raft_consensus.cc:2243] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.059916 1170 raft_consensus.cc:2272] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.060447 1170 ts_tablet_manager.cc:1916] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.062615 886 tablet_service.cc:1511] Processing CreateTablet for tablet 9e13fefa0bed48e588fc1d7c49e2c342 (DEFAULT_TABLE table=default.Table_bb7619faf537427aaff0f71f1963718b [id=ffdd449109f44417b4dacbc3460de659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.063030 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e13fefa0bed48e588fc1d7c49e2c342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.069941 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 5578fd5cb3724ed5b92b313bd52889ad (table default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0]) successfully deleted
I20260617 07:53:20.074076 745 tablet_service.cc:1511] Processing CreateTablet for tablet 66bd830c11b4412ba5a88afec7c9384a (DEFAULT_TABLE table=default.Table_4aca29909fcd4a02bcc1120e759db2c4 [id=505c0711091b48c8a02c54f5e4cb2f33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.074694 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bd830c11b4412ba5a88afec7c9384a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.079716 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ec425bb523a449d9fe16d3ea3a0d7ae with delete_type TABLET_DATA_DELETED (replaced by tablet 9c73a9d54fed46d9a4e71acf3caf7285) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.080993 759 tablet_service.cc:1511] Processing CreateTablet for tablet 40900f4b7a604abd9b020c2b396fb942 (DEFAULT_TABLE table=default.Table_74f5825fca4f43fda3f8588f35919752 [id=ce1af3b747ab4f6a852b7dfe56c821d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.081455 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40900f4b7a604abd9b020c2b396fb942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.082388 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9c86376216db4788b38bd55248e03f73 (DEFAULT_TABLE table=default.Table_360fa4c3327249579a54f68d3a81e327 [id=991ca120d90a4775a9c19d8a63092120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.082774 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c86376216db4788b38bd55248e03f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.087664 747 tablet_service.cc:1511] Processing CreateTablet for tablet c1edc8311d4140d98dfe98a1e99746c6 (DEFAULT_TABLE table=default.Table_ebcdc640e6034a69a9f5c70474fed5c4 [id=9ce8ab0896fe4a0fb8a1649218a7983e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.088019 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1edc8311d4140d98dfe98a1e99746c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.089898 749 tablet_service.cc:1511] Processing CreateTablet for tablet 3f15151bd3d542dea6d5565c7e94c68f (DEFAULT_TABLE table=default.Table_3e7568e9e053459ab5fa24e209310e3c [id=8b380f1faf41458b9870086d72a1bcc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.090368 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037539021d1743bb9a66403b8a01662f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.090369 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f15151bd3d542dea6d5565c7e94c68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.090682 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596ef68705c84791b54f07e03b219b4c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:20.091601 988 leader_election.cc:304] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:20.092252 2496 raft_consensus.cc:2804] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:20.092331 2496 raft_consensus.cc:493] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:20.092391 2496 raft_consensus.cc:3060] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.095221 2496 raft_consensus.cc:515] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.096271 2496 leader_election.cc:290] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:20.096258 749 tablet_service.cc:1511] Processing CreateTablet for tablet e793cbccf5774e95a8316d6298d4646f (DEFAULT_TABLE table=default.Table_4f46dc52ee0141efa08440414be77e91 [id=b1a87e7409874e73865039a2c7c36f1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.096604 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e793cbccf5774e95a8316d6298d4646f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.097028 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc3d13d519843a9bc38e97dc85b67c8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:20.097149 747 tablet_service.cc:1511] Processing CreateTablet for tablet 3910709fabea44fcb2902fba6957bd57 (DEFAULT_TABLE table=default.Table_f36c303bfe55438fbf17a23b0a747152 [id=b8cf3aff4d5247669f6c873686328185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.097471 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3910709fabea44fcb2902fba6957bd57. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:20.097595 986 leader_election.cc:343] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.098116 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_871f52a414934a248bcacbe3399ccee8 [id=7543297cccfb4a3d90a50fe63ba0742f]) successfully deleted
I20260617 07:53:20.099953 1099 heartbeater.cc:344] Connected to a master server at 127.0.105.189:36505
W20260617 07:53:20.102188 2543 log.cc:927] Time spent T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: Append to log took a long time: real 0.077s user 0.001s sys 0.000s
I20260617 07:53:20.113026 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6204d6e031544418b651320c69ca427. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:20.113405 2531 log.cc:927] Time spent T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260617 07:53:20.114289 1862 ts_tablet_manager.cc:1929] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:20.114464 1862 log.cc:1199] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/95865af94c04410386d23cb369180611
I20260617 07:53:20.114842 1862 ts_tablet_manager.cc:1950] T 95865af94c04410386d23cb369180611 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:20.115008 1178 tablet_bootstrap.cc:654] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.115237 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 391) took 1978 ms. Trace:
I20260617 07:53:20.115367 1862 rpcz_store.cc:276] 0617 07:53:18.137145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.137200 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:20.050775 (+1913575us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:20.050785 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.055074 (+ 4289us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.114243 (+ 59169us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.115220 (+ 977us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1913374}
I20260617 07:53:20.118358 885 tablet_service.cc:1511] Processing CreateTablet for tablet 24c31a34256748198b12a4503946179e (DEFAULT_TABLE table=default.Table_8ab7027f53c74106b61571eba9efc384 [id=e7267204e3404b1da00d3606b6819479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.120018 755 tablet_service.cc:1511] Processing CreateTablet for tablet 20cfb1ae290f43cbadead54c8f692f21 (DEFAULT_TABLE table=default.Table_74d1e24e8c594e52b77ec38499225bc1 [id=912e818e8697427a8ce7dc146b9a428f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.120457 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cfb1ae290f43cbadead54c8f692f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.121562 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 37b36c91191445478055b78830be9450 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.122027 750 tablet_service.cc:1511] Processing CreateTablet for tablet eb2f0680609849828fd5a368aac4ba92 (DEFAULT_TABLE table=default.Table_524a3b28dffc47f5bf32de043600d64b [id=aa8cd77b2d264cf2825b01ba42b57cef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.123809 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2f0680609849828fd5a368aac4ba92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.128712 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc3d13d519843a9bc38e97dc85b67c8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:20.128892 915 raft_consensus.cc:3060] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.129630 1846 ts_tablet_manager.cc:1929] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:20.129618 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_206a5e8a92c24c4ca0ea6cb0e4024589" } new_table_name: "default.Table_a760668e4e954d438ebe1331c429627f" modify_external_catalogs: true
I20260617 07:53:20.129889 1846 log.cc:1199] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/57e05a97a4ab4ed7bff523d1fb1c59ae
I20260617 07:53:20.130306 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 390) took 1993 ms. Trace:
I20260617 07:53:20.130432 1862 rpcz_store.cc:276] 0617 07:53:18.137046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.137466 (+ 420us) service_pool.cc:224] Handling call
0617 07:53:20.130205 (+1992739us) ts_tablet_manager.cc:1151] Deleting tablet 3aa1c1fdede041d28570b85e63c401b7
0617 07:53:20.130216 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.130288 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1992566}
I20260617 07:53:20.130867 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 392) took 1984 ms. Trace:
I20260617 07:53:20.130975 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 95865af94c04410386d23cb369180611 (table default.Table_a9de59c0e19946de8df23f1869eab317 [id=9b3274df0c184a92af3bc0f10185e41e]) successfully deleted
I20260617 07:53:20.131021 1862 rpcz_store.cc:276] 0617 07:53:18.145955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.146022 (+ 67us) service_pool.cc:224] Handling call
0617 07:53:20.130759 (+1984737us) ts_tablet_manager.cc:1151] Deleting tablet 446114516f164dc0a956f2ccbf2e7c35
0617 07:53:20.130768 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.130848 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1984528}
I20260617 07:53:20.131441 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 394) took 1940 ms. Trace:
I20260617 07:53:20.131735 1862 rpcz_store.cc:276] 0617 07:53:18.191467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.191529 (+ 62us) service_pool.cc:224] Handling call
0617 07:53:20.131311 (+1939782us) ts_tablet_manager.cc:1151] Deleting tablet a0dcd837e1c54af696394e7a6c4d26f0
0617 07:53:20.131322 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.131396 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1939608}
I20260617 07:53:20.132398 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 405) took 1761 ms. Trace:
I20260617 07:53:20.132553 1862 rpcz_store.cc:276] 0617 07:53:18.370724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.371025 (+ 301us) service_pool.cc:224] Handling call
0617 07:53:20.132291 (+1761266us) ts_tablet_manager.cc:1151] Deleting tablet 306742b9da81497991d58947bf3c1ebb
0617 07:53:20.132301 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.132381 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1761057}
I20260617 07:53:20.133260 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 408) took 1704 ms. Trace:
I20260617 07:53:20.133375 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet a1e064b5bc93442f83aeffa88861d818
I20260617 07:53:20.133410 1862 rpcz_store.cc:276] 0617 07:53:18.429195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.429247 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:20.133140 (+1703893us) ts_tablet_manager.cc:1151] Deleting tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3
0617 07:53:20.133152 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.133242 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1703692}
I20260617 07:53:20.133971 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 409) took 1639 ms. Trace:
I20260617 07:53:20.134057 1862 rpcz_store.cc:276] 0617 07:53:18.494625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.498555 (+ 3930us) service_pool.cc:224] Handling call
0617 07:53:20.133802 (+1635247us) ts_tablet_manager.cc:1151] Deleting tablet 44b06e32039e4ad28924f5173035820a
0617 07:53:20.133815 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.133955 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1635053}
I20260617 07:53:20.134589 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 411) took 1445 ms. Trace:
I20260617 07:53:20.134670 1862 rpcz_store.cc:276] 0617 07:53:18.689345 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.693298 (+ 3953us) service_pool.cc:224] Handling call
0617 07:53:20.134475 (+1441177us) ts_tablet_manager.cc:1151] Deleting tablet 752b6cf345384750bf9b62158ae50f26
0617 07:53:20.134486 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.134572 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1441000}
I20260617 07:53:20.137014 1846 ts_tablet_manager.cc:1950] T 57e05a97a4ab4ed7bff523d1fb1c59ae P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:20.137154 752 tablet_service.cc:1511] Processing CreateTablet for tablet 92d1398b4b604f75be1a3b46e5ac9b77 (DEFAULT_TABLE table=default.Table_e3e48dd41d7142f3b6445fe78c01f8a4 [id=91e1bc076d9742fcadca8e0b3451cffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.138309 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 509) took 1247 ms. Trace:
I20260617 07:53:20.138424 1846 rpcz_store.cc:276] 0617 07:53:18.890371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.891585 (+ 1214us) service_pool.cc:224] Handling call
0617 07:53:19.670886 (+779301us) ts_tablet_manager.cc:1151] Deleting tablet 57e05a97a4ab4ed7bff523d1fb1c59ae
0617 07:53:19.670892 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:19.798975 (+128083us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.039494 (+240519us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.138283 (+ 98789us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":779133}
I20260617 07:53:20.139557 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_dd74772ec6d14ec8a1c24d892c381b69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.140079 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd74772ec6d14ec8a1c24d892c381b69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.139701 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c31a34256748198b12a4503946179e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.141873 2496 raft_consensus.cc:493] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:20.142024 2496 raft_consensus.cc:515] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.142586 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_94f094992132448fa01aa6eebc25e2f6" } new_table_name: "default.Table_dfde2dae154b4df6bb65f9a583a971aa" modify_external_catalogs: true
I20260617 07:53:20.118438 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 67cd66ea6ebc42bda00fbec82da73f16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:20.142767 2496 leader_election.cc:290] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:20.142880 886 tablet_service.cc:1558] Processing DeleteTablet for tablet f34a2ee6fa82482db979ab25bc284f8e with delete_type TABLET_DATA_DELETED (replaced by tablet 4d06c3ca75da4a06a8f965f409bbc4a2) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:20.143033 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 05de71ea02df48ffacb369caa7f7d3de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:20.143858 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3aa1c1fdede041d28570b85e63c401b7 because the tablet was not found. No further retry: Not found: Tablet not found: 3aa1c1fdede041d28570b85e63c401b7
W20260617 07:53:20.144182 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 446114516f164dc0a956f2ccbf2e7c35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 446114516f164dc0a956f2ccbf2e7c35 already in progress: creating tablet
W20260617 07:53:20.144484 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a0dcd837e1c54af696394e7a6c4d26f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0dcd837e1c54af696394e7a6c4d26f0 already in progress: creating tablet
I20260617 07:53:20.144562 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630e540a77374c11895ab5a0e394b3bb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:20.144783 913 raft_consensus.cc:2468] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
W20260617 07:53:20.144819 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 306742b9da81497991d58947bf3c1ebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 306742b9da81497991d58947bf3c1ebb already in progress: creating tablet
I20260617 07:53:20.145118 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 17c8a945eca643f3b3f4807406e9a24e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.145174 988 leader_election.cc:304] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:20.145428 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb613ba734549b3bb21ebd27f364ad3 (DEFAULT_TABLE table=default.Table_008e34768d4f46ec8840e9d2af6a8d0a [id=ae426b54a7ce4da795ffac1321fb5331]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.145704 2496 raft_consensus.cc:2804] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:20.145807 2496 raft_consensus.cc:493] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:20.145871 2496 raft_consensus.cc:3060] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.145619 748 tablet_service.cc:1511] Processing CreateTablet for tablet bbdd18c3c7994cc29c87313554f0f92c (DEFAULT_TABLE table=default.Table_8f25b118b9a24509b2a36db020170b88 [id=b07ec5d2900f448ab01920dba30314db]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:20.145227 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 44b06e32039e4ad28924f5173035820a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44b06e32039e4ad28924f5173035820a already in progress: creating tablet
W20260617 07:53:20.146610 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 752b6cf345384750bf9b62158ae50f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 752b6cf345384750bf9b62158ae50f26 already in progress: creating tablet
I20260617 07:53:20.148627 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 412) took 1459 ms. Trace:
I20260617 07:53:20.148646 2496 raft_consensus.cc:515] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.148721 1862 rpcz_store.cc:276] 0617 07:53:18.689441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.693505 (+ 4064us) service_pool.cc:224] Handling call
0617 07:53:20.148485 (+1454980us) ts_tablet_manager.cc:1151] Deleting tablet d2304939c17648a6962f702524aa9b76
0617 07:53:20.148496 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.148608 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1454830}
I20260617 07:53:20.149057 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 413) took 1376 ms. Trace:
I20260617 07:53:20.149142 1862 rpcz_store.cc:276] 0617 07:53:18.772449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.772525 (+ 76us) service_pool.cc:224] Handling call
0617 07:53:20.148958 (+1376433us) ts_tablet_manager.cc:1151] Deleting tablet 531ccdf479814053b468a7d5802f5dde
0617 07:53:20.148967 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.149042 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1376217}
I20260617 07:53:20.149413 1862 tablet_replica.cc:333] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:20.149469 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e064b5bc93442f83aeffa88861d818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:20.149592 1862 raft_consensus.cc:2243] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:20.149883 1862 pending_rounds.cc:70] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:20.149986 1862 pending_rounds.cc:77] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772745111416832 op_type: NO_OP noop_request { }
I20260617 07:53:20.150156 1862 raft_consensus.cc:2889] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:20.150309 1862 raft_consensus.cc:2272] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.150342 2496 leader_election.cc:290] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:20.151070 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d2304939c17648a6962f702524aa9b76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2304939c17648a6962f702524aa9b76 already in progress: creating tablet
W20260617 07:53:20.151382 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 531ccdf479814053b468a7d5802f5dde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 531ccdf479814053b468a7d5802f5dde already in progress: creating tablet
I20260617 07:53:20.151961 1170 ts_tablet_manager.cc:1929] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:20.152179 1170 log.cc:1199] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/4de8df5e15cb43c0b95ec5af3110db66
I20260617 07:53:20.152698 1170 ts_tablet_manager.cc:1950] T 4de8df5e15cb43c0b95ec5af3110db66 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:20.153903 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 289) took 4518 ms. Trace:
I20260617 07:53:20.154206 1170 rpcz_store.cc:276] 0617 07:53:15.634998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.644530 (+ 9532us) service_pool.cc:224] Handling call
0617 07:53:20.059352 (+4414822us) ts_tablet_manager.cc:1151] Deleting tablet 4de8df5e15cb43c0b95ec5af3110db66
0617 07:53:20.059366 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.064272 (+ 4906us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.151903 (+ 87631us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.153881 (+ 1978us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4414661}
I20260617 07:53:20.154986 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 4de8df5e15cb43c0b95ec5af3110db66 (table default.Table_da5430a09e3e44e48bafd3678bf638a2 [id=27e37deb26df4bb28507736f1decf709]) successfully deleted
I20260617 07:53:20.157989 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630e540a77374c11895ab5a0e394b3bb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.158658 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d1398b4b604f75be1a3b46e5ac9b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.160038 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630e540a77374c11895ab5a0e394b3bb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:20.160248 913 raft_consensus.cc:3060] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.158254 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f7c3f6260c4db690de1a5081bb2493" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.145349 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 61510f9812e849e388c6c163e9af5f4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:20.161383 986 leader_election.cc:343] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.162012 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 518) took 1270 ms. Trace:
I20260617 07:53:20.162353 743 tablet_service.cc:1511] Processing CreateTablet for tablet f6204d6e031544418b651320c69ca427 (DEFAULT_TABLE table=default.Table_b6330dfd02194901ac18d158d95ee77e [id=2c06ed2064084e6da498af5d318ff2ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.163082 742 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 (DEFAULT_TABLE table=default.Table_e8431c1ec669439d8a2e5d4941c87229 [id=82e3b8ffa5114e59a20d7aaa93aca993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.163379 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9c86376216db4788b38bd55248e03f73 (DEFAULT_TABLE table=default.Table_360fa4c3327249579a54f68d3a81e327 [id=991ca120d90a4775a9c19d8a63092120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.163836 746 tablet_service.cc:1511] Processing CreateTablet for tablet 9e13fefa0bed48e588fc1d7c49e2c342 (DEFAULT_TABLE table=default.Table_bb7619faf537427aaff0f71f1963718b [id=ffdd449109f44417b4dacbc3460de659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.164196 758 tablet_service.cc:1511] Processing CreateTablet for tablet 501c69ae3c884a9b8982fa0e8d45f54f (DEFAULT_TABLE table=default.Table_1f8f6f44936841a1ab358a3ee70dffef [id=deaf56ec423a4145a8fee134886d4584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.162143 1846 rpcz_store.cc:276] 0617 07:53:18.891394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.891720 (+ 326us) service_pool.cc:224] Handling call
0617 07:53:20.138809 (+1247089us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:20.159324 (+ 20515us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.161992 (+ 2668us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246962}
I20260617 07:53:20.166330 744 tablet_service.cc:1511] Processing CreateTablet for tablet 66cb3060364d43bbb1571fb5243e57a9 (DEFAULT_TABLE table=default.Table_e7f42d14021e493f8372ea9b69dbb845 [id=0c9f07fca32c4c99b81a67ca94aef99c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.168195 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb613ba734549b3bb21ebd27f364ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.168576 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbdd18c3c7994cc29c87313554f0f92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.174851 1172 tablet_bootstrap.cc:492] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:20.175647 1172 ts_tablet_manager.cc:1403] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.191s user 0.022s sys 0.024s
I20260617 07:53:20.178344 1172 raft_consensus.cc:359] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.186096 1862 ts_tablet_manager.cc:1916] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.208256 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6204d6e031544418b651320c69ca427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.215142 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 7ca402543247461aa5384abb65fff364
I20260617 07:53:20.215934 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_442fbaeb953440b2a628c4c888990c9e" } new_table_name: "default.Table_749a56b8adef449597e2b94c7e1b30b9" modify_external_catalogs: true
I20260617 07:53:20.217407 1172 raft_consensus.cc:385] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.217617 1172 raft_consensus.cc:740] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:20.221829 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ca402543247461aa5384abb65fff364 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:20.223057 770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630e540a77374c11895ab5a0e394b3bb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:20.223443 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f7c3f6260c4db690de1a5081bb2493" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:20.223629 986 leader_election.cc:343] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.224198 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d1b4975077493eb6919b23d6523d3d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:20.225914 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f0f68dcef34228a1b2a018e8aa329e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:20.226498 766 raft_consensus.cc:3060] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.228915 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e13fefa0bed48e588fc1d7c49e2c342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.239599 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 67cd66ea6ebc42bda00fbec82da73f16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.239835 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f34a2ee6fa82482db979ab25bc284f8e with delete_type TABLET_DATA_DELETED (replaced by tablet 4d06c3ca75da4a06a8f965f409bbc4a2) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.239976 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 05de71ea02df48ffacb369caa7f7d3de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.209957 1170 tablet_replica.cc:333] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:20.240919 1170 raft_consensus.cc:2243] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.241125 1170 raft_consensus.cc:2272] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.241778 1170 ts_tablet_manager.cc:1916] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.247187 1172 consensus_queue.cc:260] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.248862 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 517) took 1357 ms. Trace:
I20260617 07:53:20.248961 1846 rpcz_store.cc:276] 0617 07:53:18.891298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.891894 (+ 596us) service_pool.cc:224] Handling call
0617 07:53:20.165607 (+1273713us) ts_tablet_manager.cc:1151] Deleting tablet 121339ab4842432e9fb7bc357750f8ad
0617 07:53:20.248692 (+ 83085us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x61800000ed18. stack: 00007f168e262086 00007f168e261e40 00007f168d21b3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f168e24a9bd 00007f168e24ba2e 00007f16a209b1ad 00007f16a201a1d3 00007f169e1a3e96 00007f169e1a5229 00007f169e1d8bb4 00007f169e1b95d0 00007f169e1b935d 0000000000aa681c
0617 07:53:20.248704 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.248837 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99255680,"tablet-delete.queue_time_us":1273566}
I20260617 07:53:20.249336 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 512) took 1358 ms. Trace:
I20260617 07:53:20.249415 1846 rpcz_store.cc:276] 0617 07:53:18.890734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.890918 (+ 184us) service_pool.cc:224] Handling call
0617 07:53:20.249251 (+1358333us) ts_tablet_manager.cc:1151] Deleting tablet 245cff69d83b43e98b1c72b8d3011347
0617 07:53:20.249261 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.249321 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2278,"tablet-delete.queue_time_us":1358190}
I20260617 07:53:20.266080 2546 tablet.cc:1724] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.267380 1171 tablet_bootstrap.cc:654] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.269040 897 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e064b5bc93442f83aeffa88861d818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:20.249675 1846 tablet_replica.cc:333] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:20.270540 1846 raft_consensus.cc:2243] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.270783 1846 raft_consensus.cc:2272] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.271215 2548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "becdd6b4fad846399c95f04697e01d0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:20.271500 1846 ts_tablet_manager.cc:1916] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.252206 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cb3060364d43bbb1571fb5243e57a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.271565 2548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:53:20.271744 2548 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader becdd6b4fad846399c95f04697e01d0f)
I20260617 07:53:20.271811 2516 raft_consensus.cc:493] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:20.271938 2516 raft_consensus.cc:515] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:20.271929 2548 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } }
I20260617 07:53:20.272540 2516 leader_election.cc:290] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:20.273123 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4a3aea221f46d3a7265bd757616bfe" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:20.273924 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501c69ae3c884a9b8982fa0e8d45f54f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.273941 2523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader becdd6b4fad846399c95f04697e01d0f. Latest consensus state: current_term: 2 leader_uuid: "becdd6b4fad846399c95f04697e01d0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:20.274124 2523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [sys.catalog]: This master's current role is: FOLLOWER
I20260617 07:53:20.278012 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c86376216db4788b38bd55248e03f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.282675 2548 leader_election.cc:290] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers becdd6b4fad846399c95f04697e01d0f (127.0.105.190:41615), 3b274c37ad4445ba8b41d6784b3cd336 (127.0.105.188:33087)
I20260617 07:53:20.282780 763 raft_consensus.cc:3060] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.284016 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6264adc3994c22864ea73106ba2320" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.288517 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6e2bb6577648d2ab958cfaa6f4a948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.291296 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b448c65e684f49bf142ce2b5084d33" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:20.294234 745 tablet_service.cc:1511] Processing CreateTablet for tablet 24c31a34256748198b12a4503946179e (DEFAULT_TABLE table=default.Table_8ab7027f53c74106b61571eba9efc384 [id=e7267204e3404b1da00d3606b6819479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.297242 1172 ts_tablet_manager.cc:1434] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.121s user 0.001s sys 0.001s
I20260617 07:53:20.295073 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2e04c81f964fe1895219311eebdee4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.299772 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c31a34256748198b12a4503946179e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:20.303059 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 298047us
I20260617 07:53:20.303289 2217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 0) took 4405 ms. Trace:
I20260617 07:53:20.303397 851 leader_election.cc:304] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:20.303911 1898 raft_consensus.cc:2804] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:20.303992 1898 raft_consensus.cc:493] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:20.304054 1898 raft_consensus.cc:3060] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:20.304586 851 consensus_peers.cc:597] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 596ef68705c84791b54f07e03b219b4c. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:20.305550 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_185b4f9af57a43a39db312f1884ff5c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.306165 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_185b4f9af57a43a39db312f1884ff5c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.308012 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_508fdaaadb52464f8c6c145656801fc3" } modify_external_catalogs: true
I20260617 07:53:20.308183 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_508fdaaadb52464f8c6c145656801fc3" } modify_external_catalogs: true
I20260617 07:53:20.309268 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35120ce002f24f2bb1ea0fdc59fbfc9d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:20.309448 1048 raft_consensus.cc:2468] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:20.311985 2544 tablet.cc:1724] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.316417 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5ea958c04885438e835ca06d85721a8f" } modify_external_catalogs: true
I20260617 07:53:20.316609 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5ea958c04885438e835ca06d85721a8f" } modify_external_catalogs: true
W20260617 07:53:20.323609 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0f7775846454e96a9f433e84e90a229 has no consensus state
I20260617 07:53:20.327278 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_98d79d950a7b4d938f69e1e678fa2846"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.328049 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98d79d950a7b4d938f69e1e678fa2846 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:20.330717 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 04eea64f33344c31b75cd3f659812e7e (table default.Table_727da69fbad147f5a1962b8552b06325 [id=a36bc2f132f448dba3a844a17379eeb5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 04eea64f33344c31b75cd3f659812e7e consensus state has no leader
I20260617 07:53:20.337117 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1077b4b7bbb44940ba86c9aa6b6d7ff4" } new_table_name: "default.Table_71dc29ea0d3041efb8d928c7701eef0c" modify_external_catalogs: true
I20260617 07:53:20.338558 1172 tablet_bootstrap.cc:492] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:20.339174 2541 tablet.cc:1724] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.350044 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f6a150c17a204e7eaffe9853d8a7e9d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:20.350142 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ca402543247461aa5384abb65fff364 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:20.350680 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6a150c17a204e7eaffe9853d8a7e9d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:20.364179 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 146d1b46891a416aafe55aa740e1569e consensus state has no leader
I20260617 07:53:20.366359 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_cbdb621b1fb848b4a04b402345b7d37b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.366948 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbdb621b1fb848b4a04b402345b7d37b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.373824 1172 tablet_bootstrap.cc:654] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.376765 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb75a965740344c2bd0b68a8dda28be5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.383131 768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb75a965740344c2bd0b68a8dda28be5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:20.384876 1028 tablet_service.cc:1511] Processing CreateTablet for tablet f34c259af8cc4825815a10604e24d84e (DEFAULT_TABLE table=default.Table_d6a4062d8d074e97924f88fee63c1e86 [id=b0c44ee1ed854b9ba81ac96cbfed7109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.385331 1019 tablet_service.cc:1511] Processing CreateTablet for tablet eb8857a2de7b42dcb5a7d2027732cd3e (DEFAULT_TABLE table=default.Table_c2504ce95816485aa56a2ae775555496 [id=4ce816902d4c4d0e99386c361100b94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.385754 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 71446fc29bd5413fbfe0f6ecc6c54ada (DEFAULT_TABLE table=default.Table_42699429d869420995a9231757782531 [id=0ed82dcd410c40438d37a0f9ee81e983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.387740 1022 tablet_service.cc:1511] Processing CreateTablet for tablet ea44bcaa28d24ca08da32710fb5a21b8 (DEFAULT_TABLE table=default.Table_c68bb2e70b93421c9e255fc79519b382 [id=74c566ccf3c643fca23a273467a3ffdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.388957 1025 tablet_service.cc:1511] Processing CreateTablet for tablet b9fcd745d95a4a11a05fc83d0975cdc6 (DEFAULT_TABLE table=default.Table_b9d65c1bfb2444369b6830f1264a52ab [id=bec94841530b4d0d8598fe9ee7a3f3ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.390398 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 9c73a9d54fed46d9a4e71acf3caf7285 (DEFAULT_TABLE table=default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.391726 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae1a8e0ad7744e0a43ee52962e77d85 (DEFAULT_TABLE table=default.Table_19bcaae67f924039b2fcfdfda462c8e3 [id=d103c6d9c09d4ca7a761af85dbcf6f9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.393287 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 047da1717bf545a9b3a23a9d9136f66f (DEFAULT_TABLE table=default.Table_c0ae1553e2aa43cf85c7584f5fff935e [id=c82ac451f0474a7a853f95fd60170100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.394411 1846 ts_tablet_manager.cc:1929] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:20.394598 1846 log.cc:1199] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/0cfb98aecc4546c88371436fcfbf8e86
I20260617 07:53:20.394510 2544 tablet.cc:1724] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:20.402056 460 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb] alter complete (version 1)
I20260617 07:53:20.408044 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c2fdf0867f834e1486a73ec4d9afcffe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.408598 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2fdf0867f834e1486a73ec4d9afcffe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:20.420899 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63459bf3ce6145d6a277d0348d13a63f consensus state has no leader
I20260617 07:53:20.427193 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a6f90a0d37cb483faa540451bf4dbe85 (table default.Table_a760668e4e954d438ebe1331c429627f [id=3d306a3bde784759bd8e3a45fa8cddec]). Expected version 2 got 1
I20260617 07:53:20.427947 880 tablet_service.cc:1511] Processing CreateTablet for tablet eb8857a2de7b42dcb5a7d2027732cd3e (DEFAULT_TABLE table=default.Table_c2504ce95816485aa56a2ae775555496 [id=4ce816902d4c4d0e99386c361100b94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.429021 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8857a2de7b42dcb5a7d2027732cd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.439764 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_67181344e3b04622865d4584952c600e" } modify_external_catalogs: true
I20260617 07:53:20.439968 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_67181344e3b04622865d4584952c600e" } modify_external_catalogs: true
I20260617 07:53:20.437006 886 tablet_service.cc:1511] Processing CreateTablet for tablet f34c259af8cc4825815a10604e24d84e (DEFAULT_TABLE table=default.Table_d6a4062d8d074e97924f88fee63c1e86 [id=b0c44ee1ed854b9ba81ac96cbfed7109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.450045 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 69f5b567da0e4baab53c00c55923e920
I20260617 07:53:20.451450 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 69f5b567da0e4baab53c00c55923e920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:20.451853 768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2735f7dd40e54aec9004b9b38702607c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.454661 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_42883661210443e59d1c013720d7d360"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.455286 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42883661210443e59d1c013720d7d360 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.457219 768 raft_consensus.cc:3060] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.458482 1452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29a94ff9f875443ab6aeac00922cda0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 735 } } ignore_live_leader: false dest_uuid: "3b274c37ad4445ba8b41d6784b3cd336" is_pre_election: true
I20260617 07:53:20.458710 884 tablet_service.cc:1511] Processing CreateTablet for tablet 71446fc29bd5413fbfe0f6ecc6c54ada (DEFAULT_TABLE table=default.Table_42699429d869420995a9231757782531 [id=0ed82dcd410c40438d37a0f9ee81e983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.459066 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71446fc29bd5413fbfe0f6ecc6c54ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.459491 881 tablet_service.cc:1511] Processing CreateTablet for tablet ea44bcaa28d24ca08da32710fb5a21b8 (DEFAULT_TABLE table=default.Table_c68bb2e70b93421c9e255fc79519b382 [id=74c566ccf3c643fca23a273467a3ffdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.459800 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea44bcaa28d24ca08da32710fb5a21b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.460279 469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29a94ff9f875443ab6aeac00922cda0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 735 } } ignore_live_leader: false dest_uuid: "becdd6b4fad846399c95f04697e01d0f" is_pre_election: true
I20260617 07:53:20.460656 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35120ce002f24f2bb1ea0fdc59fbfc9d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.461019 883 tablet_service.cc:1511] Processing CreateTablet for tablet b9fcd745d95a4a11a05fc83d0975cdc6 (DEFAULT_TABLE table=default.Table_b9d65c1bfb2444369b6830f1264a52ab [id=bec94841530b4d0d8598fe9ee7a3f3ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.461308 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fcd745d95a4a11a05fc83d0975cdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.462078 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34c259af8cc4825815a10604e24d84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.461971 2113 leader_election.cc:304] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29a94ff9f875443ab6aeac00922cda0d; no voters: 3b274c37ad4445ba8b41d6784b3cd336, becdd6b4fad846399c95f04697e01d0f
I20260617 07:53:20.462466 2548 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260617 07:53:20.471266 1172 tablet_bootstrap.cc:492] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:20.471534 1172 ts_tablet_manager.cc:1403] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.174s user 0.005s sys 0.001s
I20260617 07:53:20.472759 1172 raft_consensus.cc:359] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.473094 1172 raft_consensus.cc:385] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.473201 1172 raft_consensus.cc:740] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:20.473541 1172 consensus_queue.cc:260] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.474184 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b3c6dc341bb4497186428c46a5d6c0d2" } modify_external_catalogs: true
I20260617 07:53:20.474382 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b3c6dc341bb4497186428c46a5d6c0d2" } modify_external_catalogs: true
I20260617 07:53:20.474440 1172 ts_tablet_manager.cc:1434] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:20.476608 2496 raft_consensus.cc:493] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:20.476734 2496 raft_consensus.cc:515] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.477332 2496 leader_election.cc:290] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:20.477878 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4681e8e3f1174b299d89ec541ca8e6b3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.478370 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4681e8e3f1174b299d89ec541ca8e6b3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:20.478919 988 leader_election.cc:343] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:20.479095 986 leader_election.cc:343] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.479182 986 leader_election.cc:304] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:20.479665 2496 raft_consensus.cc:2749] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:20.480882 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5ddac997834e97a2d6c9b1855ee4e8" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:20.481544 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a2f21861cb6f481eae968edc733e6e6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2f21861cb6f481eae968edc733e6e6f already in progress: creating tablet
W20260617 07:53:20.481765 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8db4fdde370e4d30bbf14285923644a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8db4fdde370e4d30bbf14285923644a1 already in progress: creating tablet
W20260617 07:53:20.482002 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 84f498f551ff4767bd16628b03f55ae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84f498f551ff4767bd16628b03f55ae2 already in progress: creating tablet
W20260617 07:53:20.482213 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 74ab8e93e3fe475ba9c7b5fce390a8ab because the tablet was not found. No further retry: Not found: Tablet not found: 74ab8e93e3fe475ba9c7b5fce390a8ab
I20260617 07:53:20.482779 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 53108a2d6c8b4398a568c14df8e0a23e (table default.Table_c3ea195c67814080b1221735affcde43 [id=b5b61c6c229d40ac9e489d535a5b38f8]) successfully deleted
W20260617 07:53:20.483002 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c48a40032034f9c90df60b61d536222 consensus state has no leader
I20260617 07:53:20.483158 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34c259af8cc4825815a10604e24d84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.483197 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet df4f9101deaa4e6ebddacbce14f32810 (table default.Table_996d5685c9904502b299700425b29a1d [id=534b1a750b5a4b5db2ae4aaa7b47f379]) successfully deleted
W20260617 07:53:20.483418 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 283c08c31718433e83f0cedd799215fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 283c08c31718433e83f0cedd799215fe already in progress: creating tablet
W20260617 07:53:20.483649 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 570ae1e189a64da6bad10156b401ec46 because the tablet was not found. No further retry: Not found: Tablet not found: 570ae1e189a64da6bad10156b401ec46
I20260617 07:53:20.486045 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8857a2de7b42dcb5a7d2027732cd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.487020 1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4a3aea221f46d3a7265bd757616bfe" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:20.488610 713 connection.cc:256] RPC call timeout handler was delayed by -1.4189492799999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1s for a response
I20260617 07:53:20.489923 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71446fc29bd5413fbfe0f6ecc6c54ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.490669 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 57e05a97a4ab4ed7bff523d1fb1c59ae (table default.Table_162d3b6e1d5749068f166f820520acc0 [id=bf143b9baca647f0b25452d16dff2ae6]) successfully deleted
W20260617 07:53:20.491055 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 95865af94c04410386d23cb369180611 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95865af94c04410386d23cb369180611 already in progress: creating tablet
W20260617 07:53:20.491464 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 121339ab4842432e9fb7bc357750f8ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 121339ab4842432e9fb7bc357750f8ad already in progress: creating tablet
W20260617 07:53:20.491670 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 245cff69d83b43e98b1c72b8d3011347 because the tablet was not found. No further retry: Not found: Tablet not found: 245cff69d83b43e98b1c72b8d3011347
I20260617 07:53:20.495100 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea44bcaa28d24ca08da32710fb5a21b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.497921 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fcd745d95a4a11a05fc83d0975cdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.498786 1846 ts_tablet_manager.cc:1950] T 0cfb98aecc4546c88371436fcfbf8e86 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:20.499104 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 507) took 1608 ms. Trace:
I20260617 07:53:20.499176 1846 rpcz_store.cc:276] 0617 07:53:18.890200 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.893392 (+ 3192us) service_pool.cc:224] Handling call
0617 07:53:20.249633 (+1356241us) ts_tablet_manager.cc:1151] Deleting tablet 0cfb98aecc4546c88371436fcfbf8e86
0617 07:53:20.249641 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.354369 (+104728us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.394364 (+ 39995us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.499090 (+104726us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1356092}
I20260617 07:53:20.499878 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 519) took 1608 ms. Trace:
I20260617 07:53:20.499992 1846 rpcz_store.cc:276] 0617 07:53:18.891497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.893575 (+ 2078us) service_pool.cc:224] Handling call
0617 07:53:20.499420 (+1605845us) ts_tablet_manager.cc:1151] Deleting tablet 59acdc64fe9247d28c4c277161b42f4f
0617 07:53:20.499430 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.499860 (+ 430us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1605701}
I20260617 07:53:20.500577 1846 tablet_replica.cc:333] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:20.500892 1846 raft_consensus.cc:2243] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.501114 1846 raft_consensus.cc:2272] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.501870 1846 ts_tablet_manager.cc:1916] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.502034 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c73a9d54fed46d9a4e71acf3caf7285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.504853 1170 ts_tablet_manager.cc:1929] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:20.504943 1170 log.cc:1199] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/98f7c3f6260c4db690de1a5081bb2493
I20260617 07:53:20.505230 1170 ts_tablet_manager.cc:1950] T 98f7c3f6260c4db690de1a5081bb2493 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:20.505692 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae1a8e0ad7744e0a43ee52962e77d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.505916 1178 tablet_bootstrap.cc:492] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:20.506072 1178 ts_tablet_manager.cc:1403] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.458s user 0.006s sys 0.010s
I20260617 07:53:20.509536 2496 raft_consensus.cc:493] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:20.509641 2496 raft_consensus.cc:515] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.510123 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047da1717bf545a9b3a23a9d9136f66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.510305 2496 leader_election.cc:290] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:20.515496 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0e9b1e85ad604663ab3ccec9715a7f58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.516162 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e9b1e85ad604663ab3ccec9715a7f58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.516660 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_56effd53fa854253987f08623eb95332"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:20.516765 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2e04c81f964fe1895219311eebdee4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:20.517138 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56effd53fa854253987f08623eb95332 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:20.517325 986 leader_election.cc:343] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.517750 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_51413fc9aaa6421da86dd52735a48765"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.518196 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51413fc9aaa6421da86dd52735a48765 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:20.519179 754 consensus_meta.cc:287] T 4a8d94034beb4337b5f4e8567f395c00 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent flushing consensus metadata: real 0.727s user 0.023s sys 0.001s
I20260617 07:53:20.519596 742 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e064b5bc93442f83aeffa88861d818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.524220 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ca402543247461aa5384abb65fff364 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.526250 1178 raft_consensus.cc:359] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.526521 1178 raft_consensus.cc:385] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.526615 1178 raft_consensus.cc:740] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:20.526880 1178 consensus_queue.cc:260] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.527161 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 24ba13170e864dfa96cddfb1a76b8c40
I20260617 07:53:20.531136 2496 raft_consensus.cc:493] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:20.531268 2496 raft_consensus.cc:515] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.531903 2496 leader_election.cc:290] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:20.531908 742 tablet_service.cc:1511] Processing CreateTablet for tablet f34c259af8cc4825815a10604e24d84e (DEFAULT_TABLE table=default.Table_d6a4062d8d074e97924f88fee63c1e86 [id=b0c44ee1ed854b9ba81ac96cbfed7109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.532336 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34c259af8cc4825815a10604e24d84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.532729 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9ace137c4e496fafac4e729718577f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:20.533243 986 leader_election.cc:343] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.533219 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c74efd8727684d22be93a779848e0837" } new_table_name: "default.Table_c813206f83544ff98e3076dd51d314fc" modify_external_catalogs: true
I20260617 07:53:20.536092 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 24ba13170e864dfa96cddfb1a76b8c40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:20.537943 1171 tablet_bootstrap.cc:492] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:20.538085 1171 ts_tablet_manager.cc:1403] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.578s user 0.008s sys 0.008s
I20260617 07:53:20.539350 743 tablet_service.cc:1511] Processing CreateTablet for tablet eb8857a2de7b42dcb5a7d2027732cd3e (DEFAULT_TABLE table=default.Table_c2504ce95816485aa56a2ae775555496 [id=4ce816902d4c4d0e99386c361100b94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.539870 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8857a2de7b42dcb5a7d2027732cd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.540684 887 tablet_service.cc:1511] Processing CreateTablet for tablet 9c73a9d54fed46d9a4e71acf3caf7285 (DEFAULT_TABLE table=default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.543912 2496 raft_consensus.cc:493] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:20.544047 2496 raft_consensus.cc:515] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.544648 2496 leader_election.cc:290] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:20.545178 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2e04c81f964fe1895219311eebdee4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:20.545354 852 leader_election.cc:343] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.545403 912 raft_consensus.cc:2468] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:20.545463 852 leader_election.cc:304] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.546072 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c73a9d54fed46d9a4e71acf3caf7285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.546339 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d657fbccb4af40558033a971aab7f3e4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:20.546522 778 raft_consensus.cc:2468] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:20.547397 986 leader_election.cc:304] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:20.547688 2496 raft_consensus.cc:2804] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 07:53:20.547750 2496 raft_consensus.cc:493] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:20.547807 2496 raft_consensus.cc:3060] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:20.548897 2541 tablet.cc:1724] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:20.550522 2496 raft_consensus.cc:515] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.551196 892 tablet_service.cc:1511] Processing CreateTablet for tablet 047da1717bf545a9b3a23a9d9136f66f (DEFAULT_TABLE table=default.Table_c0ae1553e2aa43cf85c7584f5fff935e [id=c82ac451f0474a7a853f95fd60170100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.551445 2496 leader_election.cc:290] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:20.551973 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d657fbccb4af40558033a971aab7f3e4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:20.552148 778 raft_consensus.cc:3060] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 2
I20260617 07:53:20.552367 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ea4c1033487a4dd2a73bd5148d5bb8f9
I20260617 07:53:20.553912 896 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae1a8e0ad7744e0a43ee52962e77d85 (DEFAULT_TABLE table=default.Table_19bcaae67f924039b2fcfdfda462c8e3 [id=d103c6d9c09d4ca7a761af85dbcf6f9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.554275 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae1a8e0ad7744e0a43ee52962e77d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.556454 2436 raft_consensus.cc:2749] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:20.557075 851 leader_election.cc:304] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:20.557272 2435 raft_consensus.cc:2804] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:20.557337 2435 raft_consensus.cc:493] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:20.557408 2435 raft_consensus.cc:3060] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.554858 778 raft_consensus.cc:2468] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 2.
I20260617 07:53:20.560325 986 leader_election.cc:304] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:20.562570 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 69f5b567da0e4baab53c00c55923e920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:20.563001 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9ace137c4e496fafac4e729718577f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:20.563627 2496 raft_consensus.cc:2804] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Leader election won for term 2
I20260617 07:53:20.558936 2436 consensus_queue.cc:1048] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260617 07:53:20.563843 2496 raft_consensus.cc:697] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:20.564010 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_513f8c4d25114eb89041a6f10d07af8b" } new_table_name: "default.Table_c1da4f33f8394dbd9c74652813300630" modify_external_catalogs: true
I20260617 07:53:20.564080 2496 consensus_queue.cc:237] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:20.556509 852 leader_election.cc:343] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:20.564795 852 leader_election.cc:343] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.565253 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet ea4c1033487a4dd2a73bd5148d5bb8f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:20.565455 852 consensus_peers.cc:597] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.565608 852 leader_election.cc:343] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.569936 745 tablet_service.cc:1511] Processing CreateTablet for tablet ea44bcaa28d24ca08da32710fb5a21b8 (DEFAULT_TABLE table=default.Table_c68bb2e70b93421c9e255fc79519b382 [id=74c566ccf3c643fca23a273467a3ffdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.570380 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea44bcaa28d24ca08da32710fb5a21b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:20.570574 851 consensus_peers.cc:597] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4de8df5e15cb43c0b95ec5af3110db66. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.572417 851 consensus_peers.cc:597] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:20.574385 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_73897e868adb452cbbcedea7797a6352"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.574941 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73897e868adb452cbbcedea7797a6352 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:20.577456 851 consensus_peers.cc:597] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68b448c65e684f49bf142ce2b5084d33. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:20.577509 754 tablet_service.cc:1511] Processing CreateTablet for tablet 71446fc29bd5413fbfe0f6ecc6c54ada (DEFAULT_TABLE table=default.Table_42699429d869420995a9231757782531 [id=0ed82dcd410c40438d37a0f9ee81e983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.577943 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71446fc29bd5413fbfe0f6ecc6c54ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.581384 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_de82b245aadc4b368d45f9fc52330c76 [id=8193bedf37784197bebc39d711a8eb2b] alter complete (version 2)
I20260617 07:53:20.584798 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_734685dc77ad4399a96c6bf50408058d" } new_table_name: "default.Table_33ad6f8c7d1e46f1aa88a583c7479e28" modify_external_catalogs: true
I20260617 07:53:20.587337 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 288) took 4982 ms. Trace:
I20260617 07:53:20.587435 1170 rpcz_store.cc:276] 0617 07:53:15.634819 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.647828 (+ 13009us) service_pool.cc:224] Handling call
0617 07:53:20.209895 (+4562067us) ts_tablet_manager.cc:1151] Deleting tablet 98f7c3f6260c4db690de1a5081bb2493
0617 07:53:20.209909 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.391447 (+181538us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.504808 (+113361us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.587316 (+ 82508us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4561715}
I20260617 07:53:20.587818 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 98f7c3f6260c4db690de1a5081bb2493 (table default.Table_010f16ad25e74ae9a880163fe9e08de8 [id=94a23a9e1e434285acc94bced26578f6]) successfully deleted
I20260617 07:53:20.589617 2591 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260617 07:53:20.590018 750 tablet_service.cc:1511] Processing CreateTablet for tablet b9fcd745d95a4a11a05fc83d0975cdc6 (DEFAULT_TABLE table=default.Table_b9d65c1bfb2444369b6830f1264a52ab [id=bec94841530b4d0d8598fe9ee7a3f3ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.590443 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fcd745d95a4a11a05fc83d0975cdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.594859 913 raft_consensus.cc:2468] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:20.597466 915 raft_consensus.cc:2468] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:20.597807 1178 ts_tablet_manager.cc:1434] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.092s user 0.002s sys 0.000s
I20260617 07:53:20.598271 1178 tablet_bootstrap.cc:492] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:20.599061 2544 tablet.cc:1724] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.600221 744 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae1a8e0ad7744e0a43ee52962e77d85 (DEFAULT_TABLE table=default.Table_19bcaae67f924039b2fcfdfda462c8e3 [id=d103c6d9c09d4ca7a761af85dbcf6f9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.600682 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae1a8e0ad7744e0a43ee52962e77d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.608925 1172 tablet_bootstrap.cc:492] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:20.610702 1172 tablet_bootstrap.cc:654] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.614974 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 69f5b567da0e4baab53c00c55923e920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.615927 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 24ba13170e864dfa96cddfb1a76b8c40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.616330 747 tablet_service.cc:1558] Processing DeleteTablet for tablet ea4c1033487a4dd2a73bd5148d5bb8f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.614408 2546 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:37622 (request call id 480) took 1004 ms. Trace:
I20260617 07:53:20.616849 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 0cfb98aecc4546c88371436fcfbf8e86 (table default.Table_49b1276fd8f846b19cac293aa9f64723 [id=cd79fc14ef8c46309788c945c6267661]) successfully deleted
I20260617 07:53:20.617385 744 tablet_service.cc:1511] Processing CreateTablet for tablet 047da1717bf545a9b3a23a9d9136f66f (DEFAULT_TABLE table=default.Table_c0ae1553e2aa43cf85c7584f5fff935e [id=c82ac451f0474a7a853f95fd60170100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.617895 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047da1717bf545a9b3a23a9d9136f66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.632048 1178 tablet_bootstrap.cc:654] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.616942 2546 rpcz_store.cc:276] 0617 07:53:19.609835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.630959 (+ 21124us) service_pool.cc:224] Handling call
0617 07:53:20.614382 (+983423us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 07:53:19.677590 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0617 07:53:19.677672 (+ 82us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0617 07:53:19.677680 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0617 07:53:19.677687 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0617 07:53:19.677739 (+ 52us) alter_schema_op.cc:128] START. Timestamp: 1781682799677651
0617 07:53:19.677742 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 07:53:19.677893 (+ 151us) log.cc:844] Serialized 173 byte log entry
0617 07:53:19.855453 (+177560us) op_driver.cc:464] REPLICATION: finished
0617 07:53:20.266046 (+410593us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0617 07:53:20.266594 (+ 548us) log.cc:844] Serialized 5 byte log entry
0617 07:53:20.614020 (+347426us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.614281 (+ 261us) log.cc:844] Serialized 14 byte log entry
0617 07:53:20.614325 (+ 44us) alter_schema_op.cc:73] Released schema lock
0617 07:53:20.614332 (+ 7us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":410521,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":390,"prepare.run_wall_time_us":391,"raft.queue_time_us":376,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":224,"replication_time_us":177676,"thread_start_us":475587,"threads_started":1}]]}
I20260617 07:53:20.635370 2546 tablet.cc:1724] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 07:53:20.636744 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 59acdc64fe9247d28c4c277161b42f4f because the tablet was not found. No further retry: Not found: Tablet not found: 59acdc64fe9247d28c4c277161b42f4f
W20260617 07:53:20.638304 713 leader_election.cc:343] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 706373f1f5d44edf81ed04183a8bdf89
I20260617 07:53:20.638541 713 leader_election.cc:304] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.638844 2516 raft_consensus.cc:2749] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:20.639322 713 leader_election.cc:343] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a38bb8a140ef4bcab65aaa03bdb79040
I20260617 07:53:20.639492 713 leader_election.cc:304] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.639765 2516 raft_consensus.cc:2749] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:20.640131 713 leader_election.cc:343] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a2f21861cb6f481eae968edc733e6e6f
I20260617 07:53:20.640302 713 leader_election.cc:304] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.640676 2516 raft_consensus.cc:2749] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:20.641252 713 leader_election.cc:343] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 7e90ad3b80f24bc7aeb2e92ba5c84b63
I20260617 07:53:20.641624 713 leader_election.cc:304] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.641981 2516 raft_consensus.cc:2749] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:20.641259 2601 tablet.cc:1724] T 9b2af44d9ab34e4bbea24d6c7d95748b P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 07:53:20.642457 713 leader_election.cc:343] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 36ce60b466f7420992ef194d72b5718d
I20260617 07:53:20.645025 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047da1717bf545a9b3a23a9d9136f66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.648691 1171 raft_consensus.cc:359] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.648998 1171 raft_consensus.cc:385] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.649108 1171 raft_consensus.cc:740] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:20.649313 2595 tablet.cc:1724] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.652734 2577 tablet.cc:1724] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.657017 2185 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" instance_seqno: 1781682778784039) as {username='slave'} at 127.0.105.129:58595; Asking this server to re-register.
I20260617 07:53:20.658649 827 heartbeater.cc:461] Registering TS with master...
I20260617 07:53:20.661051 2599 tablet.cc:1724] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:20.668576 750 tablet_service.cc:1511] Processing CreateTablet for tablet 9c73a9d54fed46d9a4e71acf3caf7285 (DEFAULT_TABLE table=default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.669088 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c73a9d54fed46d9a4e71acf3caf7285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.315114 2217 rpcz_store.cc:276] 0617 07:53:15.897653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.897776 (+ 123us) service_pool.cc:224] Handling call
0617 07:53:19.540631 (+3642855us) raft_consensus.cc:1471] Updating replica for 209 ops
0617 07:53:19.730881 (+190250us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:19.730885 (+ 4us) write_op.cc:454] Released schema lock
0617 07:53:19.731302 (+ 417us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:19.731305 (+ 3us) write_op.cc:454] Released schema lock
0617 07:53:19.731543 (+ 238us) write_op.cc:489] Releasing partition, row and schema locks
0617 07:53:19.731549 (+ 6us) write_op.cc:454] Released schema lock
0617 07:53:19.731959 (+ 410us) raft_consensus.cc:1534] Early marking committed up to index 0
0617 07:53:19.731977 (+ 18us) raft_consensus.cc:1539] Triggering prepare for 209 ops
0617 07:53:19.732413 (+ 436us) write_op.cc:270] Start()
0617 07:53:19.732461 (+ 48us) write_op.cc:276] Timestamp: P: 1781682790120774 usec, L: 0
0617 07:53:19.732749 (+ 288us) write_op.cc:270] Start()
0617 07:53:19.732774 (+ 25us) write_op.cc:276] Timestamp: P: 1781682790121462 usec, L: 0
0617 07:53:19.732926 (+ 152us) write_op.cc:270] Start()
0617 07:53:19.732949 (+ 23us) write_op.cc:276] Timestamp: P: 1781682790214149 usec, L: 0
0617 07:53:19.736255 (+ 3306us) write_op.cc:270] Start()
0617 07:53:19.736294 (+ 39us) write_op.cc:276] Timestamp: P: 1781682790341885 usec, L: 0
0617 07:53:19.736499 (+ 205us) write_op.cc:270] Start()
0617 07:53:19.736521 (+ 22us) write_op.cc:276] Timestamp: P: 1781682790349496 usec, L: 0
0617 07:53:19.736658 (+ 137us) write_op.cc:270] Start()
0617 07:53:19.736677 (+ 19us) write_op.cc:276] Timestamp: P: 1781682790396501 usec, L: 0
0617 07:53:19.738714 (+ 2037us) write_op.cc:270] Start()
0617 07:53:19.738748 (+ 34us) write_op.cc:276] Timestamp: P: 1781682790403677 usec, L: 0
0617 07:53:19.738997 (+ 249us) write_op.cc:270] Start()
0617 07:53:19.739022 (+ 25us) write_op.cc:276] Timestamp: P: 1781682790407237 usec, L: 0
0617 07:53:19.739180 (+ 158us) write_op.cc:270] Start()
0617 07:53:19.739201 (+ 21us) write_op.cc:276] Timestamp: P: 1781682790453181 usec, L: 0
0617 07:53:19.739337 (+ 136us) write_op.cc:270] Start()
0617 07:53:19.739357 (+ 20us) write_op.cc:276] Timestamp: P: 1781682790482812 usec, L: 0
0617 07:53:19.739506 (+ 149us) write_op.cc:270] Start()
0617 07:53:19.739526 (+ 20us) write_op.cc:276] Timestamp: P: 1781682790484201 usec, L: 0
0617 07:53:19.739655 (+ 129us) write_op.cc:270] Start()
0617 07:53:19.739675 (+ 20us) write_op.cc:276] Timestamp: P: 1781682790485099 usec, L: 0
0617 07:53:19.739807 (+ 132us) write_op.cc:270] Start()
0617 07:53:19.739826 (+ 19us) write_op.cc:276] Timestamp: P: 1781682790526491 usec, L: 0
0617 07:53:19.741937 (+ 2111us) write_op.cc:270] Start()
0617 07:53:19.741963 (+ 26us) write_op.cc:276] Timestamp: P: 1781682790626854 usec, L: 0
0617 07:53:19.742137 (+ 174us) write_op.cc:270] Start()
0617 07:53:19.742161 (+ 24us) write_op.cc:276] Timestamp: P: 1781682790628859 usec, L: 0
0617 07:53:19.742306 (+ 145us) write_op.cc:270] Start()
0617 07:53:19.742326 (+ 20us) write_op.cc:276] Timestamp: P: 1781682790690573 usec, L: 0
0617 07:53:19.742500 (+ 174us) write_op.cc:270] Start()
0617 07:53:19.742529 (+ 29us) write_op.cc:276] Timestamp: P: 1781682790744074 usec, L: 0
0617 07:53:19.742675 (+ 146us) write_op.cc:270] Start()
0617 07:53:19.742694 (+ 19us) write_op.cc:276] Timestamp: P: 1781682790752978 usec, L: 0
0617 07:53:19.742827 (+ 133us) write_op.cc:270] Start()
0617 07:53:19.742850 (+ 23us) write_op.cc:276] Timestamp: P: 1781682790766206 usec, L: 0
0617 07:53:19.742987 (+ 137us) write_op.cc:270] Start()
0617 07:53:19.743005 (+ 18us) write_op.cc:276] Timestamp: P: 1781682790791622 usec, L: 0
0617 07:53:19.743133 (+ 128us) write_op.cc:270] Start()
0617 07:53:19.743187 (+ 54us) write_op.cc:276] Timestamp: P: 1781682791146940 usec, L: 0
0617 07:53:19.743333 (+ 146us) write_op.cc:270] Start()
0617 07:53:19.743353 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791153918 usec, L: 0
0617 07:53:19.743529 (+ 176us) write_op.cc:270] Start()
0617 07:53:19.743549 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791160044 usec, L: 0
0617 07:53:19.743684 (+ 135us) write_op.cc:270] Start()
0617 07:53:19.743702 (+ 18us) write_op.cc:276] Timestamp: P: 1781682791164088 usec, L: 0
0617 07:53:19.743837 (+ 135us) write_op.cc:270] Start()
0617 07:53:19.743855 (+ 18us) write_op.cc:276] Timestamp: P: 1781682791168041 usec, L: 0
0617 07:53:19.744012 (+ 157us) write_op.cc:270] Start()
0617 07:53:19.744035 (+ 23us) write_op.cc:276] Timestamp: P: 1781682791180380 usec, L: 0
0617 07:53:19.744190 (+ 155us) write_op.cc:270] Start()
0617 07:53:19.744210 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791181349 usec, L: 0
0617 07:53:19.744358 (+ 148us) write_op.cc:270] Start()
0617 07:53:19.744380 (+ 22us) write_op.cc:276] Timestamp: P: 1781682791181920 usec, L: 0
0617 07:53:19.744510 (+ 130us) write_op.cc:270] Start()
0617 07:53:19.744529 (+ 19us) write_op.cc:276] Timestamp: P: 1781682791188199 usec, L: 0
0617 07:53:19.744657 (+ 128us) write_op.cc:270] Start()
0617 07:53:19.744675 (+ 18us) write_op.cc:276] Timestamp: P: 1781682791213414 usec, L: 0
0617 07:53:19.744811 (+ 136us) write_op.cc:270] Start()
0617 07:53:19.744831 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791218256 usec, L: 0
0617 07:53:19.744952 (+ 121us) write_op.cc:270] Start()
0617 07:53:19.744983 (+ 31us) write_op.cc:276] Timestamp: P: 1781682791220818 usec, L: 0
0617 07:53:19.745145 (+ 162us) write_op.cc:270] Start()
0617 07:53:19.745165 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791278862 usec, L: 0
0617 07:53:19.745315 (+ 150us) write_op.cc:270] Start()
0617 07:53:19.745333 (+ 18us) write_op.cc:276] Timestamp: P: 1781682791292054 usec, L: 0
0617 07:53:19.745463 (+ 130us) write_op.cc:270] Start()
0617 07:53:19.745486 (+ 23us) write_op.cc:276] Timestamp: P: 1781682791293383 usec, L: 0
0617 07:53:19.745662 (+ 176us) write_op.cc:270] Start()
0617 07:53:19.745682 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791324366 usec, L: 0
0617 07:53:19.745876 (+ 194us) write_op.cc:270] Start()
0617 07:53:19.745904 (+ 28us) write_op.cc:276] Timestamp: P: 1781682791338350 usec, L: 0
0617 07:53:19.748178 (+ 2274us) write_op.cc:270] Start()
0617 07:53:19.748201 (+ 23us) write_op.cc:276] Timestamp: P: 1781682791363060 usec, L: 0
0617 07:53:19.748352 (+ 151us) write_op.cc:270] Start()
0617 07:53:19.748373 (+ 21us) write_op.cc:276] Timestamp: P: 1781682791365806 usec, L: 0
0617 07:53:19.748531 (+ 158us) write_op.cc:270] Start()
0617 07:53:19.748551 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791370674 usec, L: 0
0617 07:53:19.748701 (+ 150us) write_op.cc:270] Start()
0617 07:53:19.748721 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791372250 usec, L: 0
0617 07:53:19.748863 (+ 142us) write_op.cc:270] Start()
0617 07:53:19.748886 (+ 23us) write_op.cc:276] Timestamp: P: 1781682791373251 usec, L: 0
0617 07:53:19.749060 (+ 174us) write_op.cc:270] Start()
0617 07:53:19.749083 (+ 23us) write_op.cc:276] Timestamp: P: 1781682791466818 usec, L: 0
0617 07:53:19.749235 (+ 152us) write_op.cc:270] Start()
0617 07:53:19.749255 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791544448 usec, L: 0
0617 07:53:19.749400 (+ 145us) write_op.cc:270] Start()
0617 07:53:19.749422 (+ 22us) write_op.cc:276] Timestamp: P: 1781682791634579 usec, L: 0
0617 07:53:19.749549 (+ 127us) write_op.cc:270] Start()
0617 07:53:19.749565 (+ 16us) write_op.cc:276] Timestamp: P: 1781682791664104 usec, L: 0
0617 07:53:19.757852 (+ 8287us) write_op.cc:270] Start()
0617 07:53:19.757887 (+ 35us) write_op.cc:276] Timestamp: P: 1781682791699307 usec, L: 0
0617 07:53:19.758187 (+ 300us) write_op.cc:270] Start()
0617 07:53:19.758213 (+ 26us) write_op.cc:276] Timestamp: P: 1781682791731073 usec, L: 0
0617 07:53:19.758374 (+ 161us) write_op.cc:270] Start()
0617 07:53:19.758393 (+ 19us) write_op.cc:276] Timestamp: P: 1781682791750982 usec, L: 0
0617 07:53:19.758525 (+ 132us) write_op.cc:270] Start()
0617 07:53:19.758545 (+ 20us) write_op.cc:276] Timestamp: P: 1781682791756267 usec, L: 0
0617 07:53:19.758671 (+ 126us) write_op.cc:270] Start()
0617 07:53:19.758692 (+ 21us) write_op.cc:276] Timestamp: P: 1781682791785801 usec, L: 0
0617 07:53:19.758804 (+ 112us) write_op.cc:270] Start()
0617 07:53:19.758821 (+ 17us) write_op.cc:276] Timestamp: P: 1781682791787490 usec, L: 0
0617 07:53:19.759211 (+ 390us) write_op.cc:270] Start()
0617 07:53:19.759234 (+ 23us) write_op.cc:276] Timestamp: P: 1781682791792611 usec, L: 0
0617 07:53:19.759373 (+ 139us) write_op.cc:270] Start()
0617 07:53:19.759392 (+ 19us) write_op.cc:276] Timestamp: P: 1781682791795286 usec, L: 0
0617 07:53:19.759525 (+ 133us) write_op.cc:270] Start()
0617 07:53:19.759543 (+ 18us) write_op.cc:276] Timestamp: P: 1781682791801205 usec, L: 0
0617 07:53:19.759695 (+ 152us) write_op.cc:270] Start()
0617 07:53:19.759714 (+ 19us) write_op.cc:276] Timestamp: P: 1781682791866228 usec, L: 0
0617 07:53:19.759895 (+ 181us) write_op.cc:270] Start()
0617 07:53:19.759916 (+ 21us) write_op.cc:276] Timestamp: P: 1781682791893597 usec, L: 0
0617 07:53:19.760061 (+ 145us) write_op.cc:270] Start()
0617 07:53:19.760079 (+ 18us) write_op.cc:276] Timestamp: P: 1781682791894230 usec, L: 0
0617 07:53:19.760199 (+ 120us) write_op.cc:270] Start()
0617 07:53:19.760216 (+ 17us) write_op.cc:276] Timestamp: P: 1781682792015062 usec, L: 0
0617 07:53:19.760329 (+ 113us) write_op.cc:270] Start()
0617 07:53:19.760347 (+ 18us) write_op.cc:276] Timestamp: P: 1781682792023120 usec, L: 0
0617 07:53:19.760472 (+ 125us) write_op.cc:270] Start()
0617 07:53:19.760490 (+ 18us) write_op.cc:276] Timestamp: P: 1781682792138002 usec, L: 0
0617 07:53:19.760623 (+ 133us) write_op.cc:270] Start()
0617 07:53:19.760640 (+ 17us) write_op.cc:276] Timestamp: P: 1781682792188485 usec, L: 0
0617 07:53:19.760752 (+ 112us) write_op.cc:270] Start()
0617 07:53:19.760770 (+ 18us) write_op.cc:276] Timestamp: P: 1781682792198140 usec, L: 0
0617 07:53:19.760890 (+ 120us) write_op.cc:270] Start()
0617 07:53:19.760912 (+ 22us) write_op.cc:276] Timestamp: P: 1781682792605262 usec, L: 0
0617 07:53:19.761077 (+ 165us) write_op.cc:270] Start()
0617 07:53:19.761096 (+ 19us) write_op.cc:276] Timestamp: P: 1781682792641626 usec, L: 0
0617 07:53:19.761221 (+ 125us) write_op.cc:270] Start()
0617 07:53:19.761238 (+ 17us) write_op.cc:276] Timestamp: P: 1781682792642494 usec, L: 0
0617 07:53:19.761374 (+ 136us) write_op.cc:270] Start()
0617 07:53:19.761399 (+ 25us) write_op.cc:276] Timestamp: P: 1781682792652563 usec, L: 0
0617 07:53:19.761532 (+ 133us) write_op.cc:270] Start()
0617 07:53:19.761549 (+ 17us) write_op.cc:276] Timestamp: P: 1781682792663288 usec, L: 0
0617 07:53:19.761682 (+ 133us) write_op.cc:270] Start()
0617 07:53:19.761699 (+ 17us) write_op.cc:276] Timestamp: P: 1781682792664022 usec, L: 0
0617 07:53:19.761849 (+ 150us) write_op.cc:270] Start()
0617 07:53:19.761867 (+ 18us) write_op.cc:276] Timestamp: P: 1781682792664692 usec, L: 0
0617 07:53:19.762002 (+ 135us) write_op.cc:270] Start()
0617 07:53:19.762020 (+ 18us) write_op.cc:276] Timestamp: P: 1781682792665336 usec, L: 0
0617 07:53:19.762152 (+ 132us) write_op.cc:270] Start()
0617 07:53:19.762169 (+ 17us) write_op.cc:276] Timestamp: P: 1781682792667012 usec, L: 0
0617 07:53:19.762279 (+ 110us) write_op.cc:270] Start()
0617 07:53:19.762307 (+ 28us) write_op.cc:276] Timestamp: P: 1781682792670638 usec, L: 0
0617 07:53:19.762454 (+ 147us) write_op.cc:270] Start()
0617 07:53:19.762470 (+ 16us) write_op.cc:276] Timestamp: P: 1781682792709039 usec, L: 0
0617 07:53:19.762590 (+ 120us) write_op.cc:270] Start()
0617 07:53:19.762608 (+ 18us) write_op.cc:276] Timestamp: P: 1781682792709818 usec, L: 0
0617 07:53:19.762712 (+ 104us) write_op.cc:270] Start()
0617 07:53:19.762729 (+ 17us) write_op.cc:276] Timestamp: P: 1781682792719774 usec, L: 0
0617 07:53:19.762834 (+ 105us) write_op.cc:270] Start()
0617 07:53:19.762850 (+ 16us) write_op.cc:276] Timestamp: P: 1781682792743637 usec, L: 0
0617 07:53:19.762958 (+ 108us) write_op.cc:270] Start()
0617 07:53:19.762984 (+ 26us) write_op.cc:276] Timestamp: P: 1781682792806348 usec, L: 0
0617 07:53:19.763124 (+ 140us) write_op.cc:270] Start()
0617 07:53:19.763160 (+ 36us) write_op.cc:276] Timestamp: P: 1781682792833454 usec, L: 0
0617 07:53:19.763326 (+ 166us) write_op.cc:270] Start()
0617 07:53:19.763350 (+ 24us) write_op.cc:276] Timestamp: P: 1781682792841756 usec, L: 0
0617 07:53:19.763487 (+ 137us) write_op.cc:270] Start()
0617 07:53:19.763508 (+ 21us) write_op.cc:276] Timestamp: P: 1781682792861222 usec, L: 0
0617 07:53:19.763656 (+ 148us) write_op.cc:270] Start()
0617 07:53:19.763675 (+ 19us) write_op.cc:276] Timestamp: P: 1781682792873805 usec, L: 0
0617 07:53:19.763812 (+ 137us) write_op.cc:270] Start()
0617 07:53:19.763833 (+ 21us) write_op.cc:276] Timestamp: P: 1781682792886074 usec, L: 0
0617 07:53:19.763946 (+ 113us) write_op.cc:270] Start()
0617 07:53:19.763962 (+ 16us) write_op.cc:276] Timestamp: P: 1781682792902232 usec, L: 0
0617 07:53:19.764094 (+ 132us) write_op.cc:270] Start()
0617 07:53:19.764117 (+ 23us) write_op.cc:276] Timestamp: P: 1781682792915122 usec, L: 0
0617 07:53:19.764232 (+ 115us) write_op.cc:270] Start()
0617 07:53:19.764248 (+ 16us) write_op.cc:276] Timestamp: P: 1781682792927000 usec, L: 0
0617 07:53:19.764358 (+ 110us) write_op.cc:270] Start()
0617 07:53:19.764375 (+ 17us) write_op.cc:276] Timestamp: P: 1781682792941616 usec, L: 0
0617 07:53:19.764517 (+ 142us) write_op.cc:270] Start()
0617 07:53:19.764535 (+ 18us) write_op.cc:276] Timestamp: P: 1781682792986608 usec, L: 0
0617 07:53:19.764658 (+ 123us) write_op.cc:270] Start()
0617 07:53:19.764676 (+ 18us) write_op.cc:276] Timestamp: P: 1781682792998531 usec, L: 0
0617 07:53:19.764794 (+ 118us) write_op.cc:270] Start()
0617 07:53:19.764812 (+ 18us) write_op.cc:276] Timestamp: P: 1781682793006298 usec, L: 0
0617 07:53:19.764945 (+ 133us) write_op.cc:270] Start()
0617 07:53:19.764961 (+ 16us) write_op.cc:276] Timestamp: P: 1781682793038250 usec, L: 0
0617 07:53:19.765088 (+ 127us) write_op.cc:270] Start()
0617 07:53:19.765130 (+ 42us) write_op.cc:276] Timestamp: P: 1781682793078054 usec, L: 0
0617 07:53:19.765245 (+ 115us) write_op.cc:270] Start()
0617 07:53:19.765262 (+ 17us) write_op.cc:276] Timestamp: P: 1781682793107894 usec, L: 0
0617 07:53:19.765362 (+ 100us) write_op.cc:270] Start()
0617 07:53:19.765378 (+ 16us) write_op.cc:276] Timestamp: P: 1781682793134758 usec, L: 0
0617 07:53:19.765474 (+ 96us) write_op.cc:270] Start()
0617 07:53:19.765490 (+ 16us) write_op.cc:276] Timestamp: P: 1781682793136647 usec, L: 0
0617 07:53:19.765597 (+ 107us) write_op.cc:270] Start()
0617 07:53:19.765613 (+ 16us) write_op.cc:276] Timestamp: P: 1781682793175159 usec, L: 0
0617 07:53:19.771938 (+ 6325us) write_op.cc:270] Start()
0617 07:53:19.772006 (+ 68us) write_op.cc:276] Timestamp: P: 1781682793205407 usec, L: 0
0617 07:53:19.772252 (+ 246us) write_op.cc:270] Start()
0617 07:53:19.772275 (+ 23us) write_op.cc:276] Timestamp: P: 1781682793217622 usec, L: 0
0617 07:53:19.772447 (+ 172us) write_op.cc:270] Start()
0617 07:53:19.772467 (+ 20us) write_op.cc:276] Timestamp: P: 1781682793219206 usec, L: 0
0617 07:53:19.772600 (+ 133us) write_op.cc:270] Start()
0617 07:53:19.772619 (+ 19us) write_op.cc:276] Timestamp: P: 1781682793236061 usec, L: 0
0617 07:53:19.772746 (+ 127us) write_op.cc:270] Start()
0617 07:53:19.772763 (+ 17us) write_op.cc:276] Timestamp: P: 1781682793418282 usec, L: 0
0617 07:53:19.772881 (+ 118us) write_op.cc:270] Start()
0617 07:53:19.772898 (+ 17us) write_op.cc:276] Timestamp: P: 1781682793442922 usec, L: 0
0617 07:53:19.773049 (+ 151us) write_op.cc:270] Start()
0617 07:53:19.773066 (+ 17us) write_op.cc:276] Timestamp: P: 1781682793456394 usec, L: 0
0617 07:53:19.773202 (+ 136us) write_op.cc:270] Start()
0617 07:53:19.773220 (+ 18us) write_op.cc:276] Timestamp: P: 1781682793467434 usec, L: 0
0617 07:53:19.773336 (+ 116us) write_op.cc:270] Start()
0617 07:53:19.773352 (+ 16us) write_op.cc:276] Timestamp: P: 1781682793478825 usec, L: 0
0617 07:53:19.773500 (+ 148us) write_op.cc:270] Start()
0617 07:53:19.773518 (+ 18us) write_op.cc:276] Timestamp: P: 1781682793556605 usec, L: 0
0617 07:53:19.773639 (+ 121us) write_op.cc:270] Start()
0617 07:53:19.773656 (+ 17us) write_op.cc:276] Timestamp: P: 1781682793564776 usec, L: 0
0617 07:53:19.773811 (+ 155us) write_op.cc:270] Start()
0617 07:53:19.773830 (+ 19us) write_op.cc:276] Timestamp: P: 1781682793578083 usec, L: 0
0617 07:53:19.773961 (+ 131us) write_op.cc:270] Start()
0617 07:53:19.773993 (+ 32us) write_op.cc:276] Timestamp: P: 1781682793596134 usec, L: 0
0617 07:53:19.774174 (+ 181us) write_op.cc:270] Start()
0617 07:53:19.774197 (+ 23us) write_op.cc:276] Timestamp: P: 1781682793599340 usec, L: 0
0617 07:53:19.774359 (+ 162us) write_op.cc:270] Start()
0617 07:53:19.774380 (+ 21us) write_op.cc:276] Timestamp: P: 1781682793605881 usec, L: 0
0617 07:53:19.774562 (+ 182us) write_op.cc:270] Start()
0617 07:53:19.774583 (+ 21us) write_op.cc:276] Timestamp: P: 1781682793613655 usec, L: 0
0617 07:53:19.774720 (+ 137us) write_op.cc:270] Start()
0617 07:53:19.774738 (+ 18us) write_op.cc:276] Timestamp: P: 1781682793628775 usec, L: 0
0617 07:53:19.774855 (+ 117us) write_op.cc:270] Start()
0617 07:53:19.774871 (+ 16us) write_op.cc:276] Timestamp: P: 1781682793647414 usec, L: 0
0617 07:53:19.775015 (+ 144us) write_op.cc:270] Start()
0617 07:53:19.775037 (+ 22us) write_op.cc:276] Timestamp: P: 1781682793660624 usec, L: 0
0617 07:53:19.775158 (+ 121us) write_op.cc:270] Start()
0617 07:53:19.775176 (+ 18us) write_op.cc:276] Timestamp: P: 1781682793675392 usec, L: 0
0617 07:53:19.775296 (+ 120us) write_op.cc:270] Start()
0617 07:53:19.775313 (+ 17us) write_op.cc:276] Timestamp: P: 1781682793702611 usec, L: 0
0617 07:53:19.775479 (+ 166us) write_op.cc:270] Start()
0617 07:53:19.775502 (+ 23us) write_op.cc:276] Timestamp: P: 1781682793704496 usec, L: 0
0617 07:53:19.775682 (+ 180us) write_op.cc:270] Start()
0617 07:53:19.775703 (+ 21us) write_op.cc:276] Timestamp: P: 1781682793724019 usec, L: 0
0617 07:53:19.775845 (+ 142us) write_op.cc:270] Start()
0617 07:53:19.775864 (+ 19us) write_op.cc:276] Timestamp: P: 1781682793736584 usec, L: 0
0617 07:53:19.776000 (+ 136us) write_op.cc:270] Start()
0617 07:53:19.776020 (+ 20us) write_op.cc:276] Timestamp: P: 1781682793822536 usec, L: 0
0617 07:53:19.776146 (+ 126us) write_op.cc:270] Start()
0617 07:53:19.776164 (+ 18us) write_op.cc:276] Timestamp: P: 1781682793824659 usec, L: 0
0617 07:53:19.776278 (+ 114us) write_op.cc:270] Start()
0617 07:53:19.776296 (+ 18us) write_op.cc:276] Timestamp: P: 1781682793825313 usec, L: 0
0617 07:53:19.804632 (+ 28336us) write_op.cc:270] Start()
0617 07:53:19.804683 (+ 51us) write_op.cc:276] Timestamp: P: 1781682793825967 usec, L: 0
0617 07:53:19.805001 (+ 318us) write_op.cc:270] Start()
0617 07:53:19.805032 (+ 31us) write_op.cc:276] Timestamp: P: 1781682793834081 usec, L: 0
0617 07:53:19.815707 (+ 10675us) write_op.cc:270] Start()
0617 07:53:19.815746 (+ 39us) write_op.cc:276] Timestamp: P: 1781682793836753 usec, L: 0
0617 07:53:19.815981 (+ 235us) write_op.cc:270] Start()
0617 07:53:19.816013 (+ 32us) write_op.cc:276] Timestamp: P: 1781682793898832 usec, L: 0
0617 07:53:19.816235 (+ 222us) write_op.cc:270] Start()
0617 07:53:19.816263 (+ 28us) write_op.cc:276] Timestamp: P: 1781682793899970 usec, L: 0
0617 07:53:19.816428 (+ 165us) write_op.cc:270] Start()
0617 07:53:19.816447 (+ 19us) write_op.cc:276] Timestamp: P: 1781682793921107 usec, L: 0
0617 07:53:19.822268 (+ 5821us) write_op.cc:270] Start()
0617 07:53:19.822323 (+ 55us) write_op.cc:276] Timestamp: P: 1781682793951633 usec, L: 0
0617 07:53:19.822535 (+ 212us) write_op.cc:270] Start()
0617 07:53:19.822559 (+ 24us) write_op.cc:276] Timestamp: P: 1781682793955643 usec, L: 0
0617 07:53:19.822707 (+ 148us) write_op.cc:270] Start()
0617 07:53:19.822729 (+ 22us) write_op.cc:276] Timestamp: P: 1781682793957245 usec, L: 0
0617 07:53:19.823031 (+ 302us) write_op.cc:270] Start()
0617 07:53:19.823053 (+ 22us) write_op.cc:276] Timestamp: P: 1781682793983199 usec, L: 0
0617 07:53:19.823216 (+ 163us) write_op.cc:270] Start()
0617 07:53:19.823239 (+ 23us) write_op.cc:276] Timestamp: P: 1781682793994893 usec, L: 0
0617 07:53:19.823389 (+ 150us) write_op.cc:270] Start()
0617 07:53:19.823416 (+ 27us) write_op.cc:276] Timestamp: P: 1781682794008592 usec, L: 0
0617 07:53:19.823584 (+ 168us) write_op.cc:270] Start()
0617 07:53:19.823606 (+ 22us) write_op.cc:276] Timestamp: P: 1781682794009917 usec, L: 0
0617 07:53:19.823752 (+ 146us) write_op.cc:270] Start()
0617 07:53:19.823774 (+ 22us) write_op.cc:276] Timestamp: P: 1781682794019272 usec, L: 0
0617 07:53:19.825962 (+ 2188us) write_op.cc:270] Start()
0617 07:53:19.825999 (+ 37us) write_op.cc:276] Timestamp: P: 1781682794022976 usec, L: 0
0617 07:53:19.826164 (+ 165us) write_op.cc:270] Start()
0617 07:53:19.826193 (+ 29us) write_op.cc:276] Timestamp: P: 1781682794038971 usec, L: 0
0617 07:53:19.826322 (+ 129us) write_op.cc:270] Start()
0617 07:53:19.826341 (+ 19us) write_op.cc:276] Timestamp: P: 1781682794044460 usec, L: 0
0617 07:53:19.826483 (+ 142us) write_op.cc:270] Start()
0617 07:53:19.826502 (+ 19us) write_op.cc:276] Timestamp: P: 1781682794059107 usec, L: 0
0617 07:53:19.830383 (+ 3881us) write_op.cc:270] Start()
0617 07:53:19.830407 (+ 24us) write_op.cc:276] Timestamp: P: 1781682794069432 usec, L: 0
0617 07:53:19.830551 (+ 144us) write_op.cc:270] Start()
0617 07:53:19.830572 (+ 21us) write_op.cc:276] Timestamp: P: 1781682794167016 usec, L: 0
0617 07:53:19.830734 (+ 162us) write_op.cc:270] Start()
0617 07:53:19.830754 (+ 20us) write_op.cc:276] Timestamp: P: 1781682794226586 usec, L: 0
0617 07:53:19.830882 (+ 128us) write_op.cc:270] Start()
0617 07:53:19.830900 (+ 18us) write_op.cc:276] Timestamp: P: 1781682794265784 usec, L: 0
0617 07:53:19.831074 (+ 174us) write_op.cc:270] Start()
0617 07:53:19.831097 (+ 23us) write_op.cc:276] Timestamp: P: 1781682794275878 usec, L: 0
0617 07:53:19.831256 (+ 159us) write_op.cc:270] Start()
0617 07:53:19.831276 (+ 20us) write_op.cc:276] Timestamp: P: 1781682794284683 usec, L: 0
0617 07:53:19.831404 (+ 128us) write_op.cc:270] Start()
0617 07:53:19.831424 (+ 20us) write_op.cc:276] Timestamp: P: 1781682794293801 usec, L: 0
0617 07:53:19.831589 (+ 165us) write_op.cc:270] Start()
0617 07:53:19.831609 (+ 20us) write_op.cc:276] Timestamp: P: 1781682794309412 usec, L: 0
0617 07:53:19.831760 (+ 151us) write_op.cc:270] Start()
0617 07:53:19.831782 (+ 22us) write_op.cc:276] Timestamp: P: 1781682794341058 usec, L: 0
0617 07:53:19.831925 (+ 143us) write_op.cc:270] Start()
0617 07:53:19.831943 (+ 18us) write_op.cc:276] Timestamp: P: 1781682794356770 usec, L: 0
0617 07:53:19.832099 (+ 156us) write_op.cc:270] Start()
0617 07:53:19.832120 (+ 21us) write_op.cc:276] Timestamp: P: 1781682794363261 usec, L: 0
0617 07:53:19.832282 (+ 162us) write_op.cc:270] Start()
0617 07:53:19.832304 (+ 22us) write_op.cc:276] Timestamp: P: 1781682794363887 usec, L: 0
0617 07:53:19.832432 (+ 128us) write_op.cc:270] Start()
0617 07:53:19.832452 (+ 20us) write_op.cc:276] Timestamp: P: 1781682794374274 usec, L: 0
0617 07:53:19.832600 (+ 148us) write_op.cc:270] Start()
0617 07:53:19.832619 (+ 19us) write_op.cc:276] Timestamp: P: 1781682794374959 usec, L: 0
0617 07:53:19.832765 (+ 146us) write_op.cc:270] Start()
0617 07:53:19.832787 (+ 22us) write_op.cc:276] Timestamp: P: 1781682794375716 usec, L: 0
0617 07:53:19.832951 (+ 164us) write_op.cc:270] Start()
0617 07:53:19.832982 (+ 31us) write_op.cc:276] Timestamp: P: 1781682794403704 usec, L: 0
0617 07:53:19.833124 (+ 142us) write_op.cc:270] Start()
0617 07:53:19.833151 (+ 27us) write_op.cc:276] Timestamp: P: 1781682794413444 usec, L: 0
0617 07:53:19.833284 (+ 133us) write_op.cc:270] Start()
0617 07:53:19.833304 (+ 20us) write_op.cc:276] Timestamp: P: 1781682794417238 usec, L: 0
0617 07:53:19.833447 (+ 143us) write_op.cc:270] Start()
0617 07:53:19.833470 (+ 23us) write_op.cc:276] Timestamp: P: 1781682794436071 usec, L: 0
0617 07:53:19.833628 (+ 158us) write_op.cc:270] Start()
0617 07:53:19.833651 (+ 23us) write_op.cc:276] Timestamp: P: 1781682794465676 usec, L: 0
0617 07:53:19.861582 (+ 27931us) write_op.cc:270] Start()
0617 07:53:19.861622 (+ 40us) write_op.cc:276] Timestamp: P: 1781682794476144 usec, L: 0
0617 07:53:19.861891 (+ 269us) write_op.cc:270] Start()
0617 07:53:19.861938 (+ 47us) write_op.cc:276] Timestamp: P: 1781682794497432 usec, L: 0
0617 07:53:19.862163 (+ 225us) write_op.cc:270] Start()
0617 07:53:19.862188 (+ 25us) write_op.cc:276] Timestamp: P: 1781682794498900 usec, L: 0
0617 07:53:19.862345 (+ 157us) write_op.cc:270] Start()
0617 07:53:19.862367 (+ 22us) write_op.cc:276] Timestamp: P: 1781682794499721 usec, L: 0
0617 07:53:19.862501 (+ 134us) write_op.cc:270] Start()
0617 07:53:19.862520 (+ 19us) write_op.cc:276] Timestamp: P: 1781682794502966 usec, L: 0
0617 07:53:19.862696 (+ 176us) write_op.cc:270] Start()
0617 07:53:19.862758 (+ 62us) write_op.cc:276] Timestamp: P: 1781682794529895 usec, L: 0
0617 07:53:19.862947 (+ 189us) write_op.cc:270] Start()
0617 07:53:19.862981 (+ 34us) write_op.cc:276] Timestamp: P: 1781682794580710 usec, L: 0
0617 07:53:19.863123 (+ 142us) write_op.cc:270] Start()
0617 07:53:19.863144 (+ 21us) write_op.cc:276] Timestamp: P: 1781682794581349 usec, L: 0
0617 07:53:19.863278 (+ 134us) write_op.cc:270] Start()
0617 07:53:19.863300 (+ 22us) write_op.cc:276] Timestamp: P: 1781682794599866 usec, L: 0
0617 07:53:19.863419 (+ 119us) write_op.cc:270] Start()
0617 07:53:19.863436 (+ 17us) write_op.cc:276] Timestamp: P: 1781682794600695 usec, L: 0
0617 07:53:19.863553 (+ 117us) write_op.cc:270] Start()
0617 07:53:19.863569 (+ 16us) write_op.cc:276] Timestamp: P: 1781682794625720 usec, L: 0
0617 07:53:19.863694 (+ 125us) write_op.cc:270] Start()
0617 07:53:19.863714 (+ 20us) write_op.cc:276] Timestamp: P: 1781682794626549 usec, L: 0
0617 07:53:19.863860 (+ 146us) write_op.cc:270] Start()
0617 07:53:19.863879 (+ 19us) write_op.cc:276] Timestamp: P: 1781682794627109 usec, L: 0
0617 07:53:19.864027 (+ 148us) write_op.cc:270] Start()
0617 07:53:19.864046 (+ 19us) write_op.cc:276] Timestamp: P: 1781682794627819 usec, L: 0
0617 07:53:19.864232 (+ 186us) write_op.cc:270] Start()
0617 07:53:19.864254 (+ 22us) write_op.cc:276] Timestamp: P: 1781682794687582 usec, L: 0
0617 07:53:19.864404 (+ 150us) write_op.cc:270] Start()
0617 07:53:19.864423 (+ 19us) write_op.cc:276] Timestamp: P: 1781682794691035 usec, L: 0
0617 07:53:19.864557 (+ 134us) write_op.cc:270] Start()
0617 07:53:19.864576 (+ 19us) write_op.cc:276] Timestamp: P: 1781682794735452 usec, L: 0
0617 07:53:19.864709 (+ 133us) write_op.cc:270] Start()
0617 07:53:19.864727 (+ 18us) write_op.cc:276] Timestamp: P: 1781682794746669 usec, L: 0
0617 07:53:19.864840 (+ 113us) write_op.cc:270] Start()
0617 07:53:19.864856 (+ 16us) write_op.cc:276] Timestamp: P: 1781682794853846 usec, L: 0
0617 07:53:19.864962 (+ 106us) write_op.cc:270] Start()
0617 07:53:19.864989 (+ 27us) write_op.cc:276] Timestamp: P: 1781682794886217 usec, L: 0
0617 07:53:19.865104 (+ 115us) write_op.cc:270] Start()
0617 07:53:19.872478 (+ 7374us) write_op.cc:276] Timestamp: P: 1781682794910589 usec, L: 0
0617 07:53:19.872858 (+ 380us) write_op.cc:270] Start()
0617 07:53:19.872889 (+ 31us) write_op.cc:276] Timestamp: P: 1781682794914964 usec, L: 0
0617 07:53:19.873039 (+ 150us) write_op.cc:270] Start()
0617 07:53:19.873057 (+ 18us) write_op.cc:276] Timestamp: P: 1781682794918636 usec, L: 0
0617 07:53:19.873181 (+ 124us) write_op.cc:270] Start()
0617 07:53:19.873198 (+ 17us) write_op.cc:276] Timestamp: P: 1781682794924693 usec, L: 0
0617 07:53:19.873307 (+ 109us) write_op.cc:270] Start()
0617 07:53:19.873325 (+ 18us) write_op.cc:276] Timestamp: P: 1781682794937719 usec, L: 0
0617 07:53:19.873434 (+ 109us) write_op.cc:270] Start()
0617 07:53:19.873449 (+ 15us) write_op.cc:276] Timestamp: P: 1781682795258967 usec, L: 0
0617 07:53:19.873572 (+ 123us) write_op.cc:270] Start()
0617 07:53:19.873589 (+ 17us) write_op.cc:276] Timestamp: P: 1781682795281329 usec, L: 0
0617 07:53:19.873694 (+ 105us) write_op.cc:270] Start()
0617 07:53:19.873740 (+ 46us) write_op.cc:276] Timestamp: P: 1781682795386828 usec, L: 0
0617 07:53:19.873858 (+ 118us) write_op.cc:270] Start()
0617 07:53:19.873874 (+ 16us) write_op.cc:276] Timestamp: P: 1781682795520343 usec, L: 0
0617 07:53:19.873978 (+ 104us) write_op.cc:270] Start()
0617 07:53:19.873993 (+ 15us) write_op.cc:276] Timestamp: P: 1781682795533930 usec, L: 0
0617 07:53:19.874105 (+ 112us) write_op.cc:270] Start()
0617 07:53:19.874121 (+ 16us) write_op.cc:276] Timestamp: P: 1781682795546393 usec, L: 0
0617 07:53:19.874222 (+ 101us) write_op.cc:270] Start()
0617 07:53:19.874237 (+ 15us) write_op.cc:276] Timestamp: P: 1781682795546975 usec, L: 0
0617 07:53:19.874335 (+ 98us) write_op.cc:270] Start()
0617 07:53:19.874350 (+ 15us)
I20260617 07:53:20.642653 713 leader_election.cc:304] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.676301 2516 raft_consensus.cc:2749] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:20.678628 1178 tablet_bootstrap.cc:492] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:20.678871 1178 ts_tablet_manager.cc:1403] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.000s
I20260617 07:53:20.679736 1862 ts_tablet_manager.cc:1929] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:20.679777 1178 raft_consensus.cc:359] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.679946 1862 log.cc:1199] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/60d1b4975077493eb6919b23d6523d3d
I20260617 07:53:20.680298 1862 ts_tablet_manager.cc:1950] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:20.680585 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 414) took 1899 ms. Trace:
I20260617 07:53:20.680584 1178 raft_consensus.cc:385] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.680742 1178 raft_consensus.cc:740] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:20.680663 1862 rpcz_store.cc:276] 0617 07:53:18.781618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.781670 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:20.149370 (+1367700us) ts_tablet_manager.cc:1151] Deleting tablet 60d1b4975077493eb6919b23d6523d3d
0617 07:53:20.149380 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.555746 (+406366us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.679684 (+123938us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.680572 (+ 888us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1367513}
I20260617 07:53:20.681059 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 430) took 1699 ms. Trace:
I20260617 07:53:20.681135 1862 rpcz_store.cc:276] 0617 07:53:18.982099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.982153 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:20.680940 (+1698787us) ts_tablet_manager.cc:1151] Deleting tablet 3bd63a5d7e8342d9b919aa0862f8cfc7
0617 07:53:20.680948 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.681043 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1698623}
I20260617 07:53:20.681447 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 432) took 1644 ms. Trace:
I20260617 07:53:20.681515 1862 rpcz_store.cc:276] 0617 07:53:19.037133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.040353 (+ 3220us) service_pool.cc:224] Handling call
0617 07:53:20.681357 (+1641004us) ts_tablet_manager.cc:1151] Deleting tablet ce7cc6cbd4a0474880ed62aebc035226
0617 07:53:20.681365 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.681432 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1640843}
I20260617 07:53:20.681855 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 431) took 1650 ms. Trace:
I20260617 07:53:20.681928 1862 rpcz_store.cc:276] 0617 07:53:19.031684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.043041 (+ 11357us) service_pool.cc:224] Handling call
0617 07:53:20.681770 (+1638729us) ts_tablet_manager.cc:1151] Deleting tablet adbb0c38ef9242a5bfbbcbe22faa5df9
0617 07:53:20.681778 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.681841 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1638568}
I20260617 07:53:20.682159 1862 tablet_replica.cc:333] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:20.682343 1862 raft_consensus.cc:2243] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.682487 1862 raft_consensus.cc:2272] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.682688 1178 consensus_queue.cc:260] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.683534 1178 ts_tablet_manager.cc:1434] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 07:53:20.684412 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d06187aa09fd4776a992a07405a10876
I20260617 07:53:20.684906 1178 tablet_bootstrap.cc:492] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:20.686216 1862 ts_tablet_manager.cc:1916] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.686264 1178 tablet_bootstrap.cc:654] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.687589 713 leader_election.cc:304] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.688297 2516 raft_consensus.cc:2749] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:20.689085 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 561c8bf9e5c840628ab1c8cf91dc2d93
I20260617 07:53:20.690822 1846 ts_tablet_manager.cc:1929] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 07:53:20.694046 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 62354.4us
I20260617 07:53:20.695163 2577 tablet.cc:1724] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:20.625386 1170 tablet_replica.cc:333] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:20.691228 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet d06187aa09fd4776a992a07405a10876 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:20.696815 1170 raft_consensus.cc:2243] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.691219 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 561c8bf9e5c840628ab1c8cf91dc2d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:20.696987 1170 raft_consensus.cc:2272] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.697646 1170 ts_tablet_manager.cc:1916] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.686328 2185 ts_manager.cc:194] Registered new tserver with Master: 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:20.705915 1170 ts_tablet_manager.cc:1929] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:20.706055 1170 log.cc:1199] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/18f9bace06e34602acc7fcd7501b3671
I20260617 07:53:20.706423 1170 ts_tablet_manager.cc:1950] T 18f9bace06e34602acc7fcd7501b3671 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:20.669353 1171 consensus_queue.cc:260] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.710824 1171 ts_tablet_manager.cc:1434] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.173s user 0.001s sys 0.001s
I20260617 07:53:20.711303 1171 tablet_bootstrap.cc:492] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:20.711901 2185 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" instance_seqno: 1781682779782584) as {username='slave'} at 127.0.105.131:36449; Asking this server to re-register.
I20260617 07:53:20.717520 1099 heartbeater.cc:461] Registering TS with master...
I20260617 07:53:20.689181 713 leader_election.cc:304] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.719012 2516 raft_consensus.cc:2749] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:20.721061 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 299) took 5033 ms. Trace:
I20260617 07:53:20.721073 743 tablet_service.cc:1558] Processing DeleteTablet for tablet d06187aa09fd4776a992a07405a10876 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.691380 1846 log.cc:1199] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a82e4d6c09bb4414ad7f3b760f7ae681
I20260617 07:53:20.721400 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 561c8bf9e5c840628ab1c8cf91dc2d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.721665 1846 ts_tablet_manager.cc:1950] T a82e4d6c09bb4414ad7f3b760f7ae681 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:20.729676 1170 rpcz_store.cc:276] 0617 07:53:15.687455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.687510 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:20.625327 (+4937817us) ts_tablet_manager.cc:1151] Deleting tablet 18f9bace06e34602acc7fcd7501b3671
0617 07:53:20.625339 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.702046 (+ 76707us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.705857 (+ 3811us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.721041 (+ 15184us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4936119}
I20260617 07:53:20.731060 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 18f9bace06e34602acc7fcd7501b3671 (table default.Table_494d237d1c1a4ab8b4939b39873d9793 [id=ac5919d00ecb484db9c6428a472f080e]) successfully deleted
I20260617 07:53:20.734396 2185 ts_manager.cc:194] Registered new tserver with Master: dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:20.736476 1170 tablet_replica.cc:333] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:20.736687 1170 raft_consensus.cc:2243] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.736855 1170 raft_consensus.cc:2272] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.737339 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 510) took 1846 ms. Trace:
I20260617 07:53:20.737501 1846 rpcz_store.cc:276] 0617 07:53:18.890505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.893766 (+ 3261us) service_pool.cc:224] Handling call
0617 07:53:20.500508 (+1606742us) ts_tablet_manager.cc:1151] Deleting tablet a82e4d6c09bb4414ad7f3b760f7ae681
0617 07:53:20.500519 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.611956 (+111437us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.690751 (+ 78795us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.737313 (+ 46562us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1606594}
I20260617 07:53:20.738000 1846 tablet_replica.cc:333] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:20.738145 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a82e4d6c09bb4414ad7f3b760f7ae681 (table default.Table_b8c2cdf0232f43a2abece8a769ac6cb3 [id=ec77f754c1974d4bbf057719b39c0059]) successfully deleted
I20260617 07:53:20.738255 1846 raft_consensus.cc:2243] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.738400 1846 raft_consensus.cc:2272] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.739002 1846 ts_tablet_manager.cc:1916] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.741451 1170 ts_tablet_manager.cc:1916] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.746428 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1a5905f1182a42e49a2f920255c65e18" } modify_external_catalogs: true
I20260617 07:53:20.747479 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1a5905f1182a42e49a2f920255c65e18" } modify_external_catalogs: true
I20260617 07:53:20.728147 1898 raft_consensus.cc:515] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.750309 2379 sys_catalog.cc:455] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "becdd6b4fad846399c95f04697e01d0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:20.750487 2379 sys_catalog.cc:458] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: This master's current role is: LEADER
I20260617 07:53:20.750753 1898 leader_election.cc:290] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:20.756029 2435 raft_consensus.cc:515] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.756668 2435 leader_election.cc:290] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:20.759291 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_64516816d3d34c23aa3c17ce405a6ad9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.759840 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64516816d3d34c23aa3c17ce405a6ad9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.761112 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_263867c4fce84a18a43a51cf5e9cc83a" } new_table_name: "default.Table_eee6d58a56cc43aabdddcac60c6ad8b8" modify_external_catalogs: true
I20260617 07:53:20.768908 456 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet ee5ddac997834e97a2d6c9b1855ee4e8 (table default.Table_73a149c5190c4fe38934f947932e0d6c [id=5cbacc3e094b4c6184605bc50566e275]). Expected version 3 got 0
I20260617 07:53:20.769249 456 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 9b2af44d9ab34e4bbea24d6c7d95748b (table default.Table_3d57115da6cb45ca9f32f025cdf4b660 [id=e71a10fd4f804bde81b23cf9d9eb611c]). Expected version 1 got 0
I20260617 07:53:20.769613 2602 tablet.cc:1724] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.769703 456 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet e3275c99834f404f84b96fcc7944cd00 (table default.Table_9815ff9400a3426e8f09edd618831938 [id=6a3de6cd076144ecabdfe3c5fe5498bb]). Expected version 3 got 2
I20260617 07:53:20.772012 1172 tablet_bootstrap.cc:492] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:20.772660 1862 ts_tablet_manager.cc:1929] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:20.772866 1862 log.cc:1199] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/630e540a77374c11895ab5a0e394b3bb
I20260617 07:53:20.776880 1172 ts_tablet_manager.cc:1403] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.168s user 0.005s sys 0.000s
I20260617 07:53:20.791074 750 tablet_service.cc:1558] Processing DeleteTablet for tablet a2f21861cb6f481eae968edc733e6e6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:20.792362 1171 tablet_bootstrap.cc:654] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.792900 1862 ts_tablet_manager.cc:1950] T 630e540a77374c11895ab5a0e394b3bb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:20.790745 1172 raft_consensus.cc:359] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.799885 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_90a4260ed99e4d37bf5eb8b28ca1a897"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:20.800572 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 434) took 1745 ms. Trace:
W20260617 07:53:20.800607 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90a4260ed99e4d37bf5eb8b28ca1a897 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.800700 1862 rpcz_store.cc:276] 0617 07:53:19.054932 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.054989 (+ 57us) service_pool.cc:224] Handling call
0617 07:53:20.682122 (+1627133us) ts_tablet_manager.cc:1151] Deleting tablet 630e540a77374c11895ab5a0e394b3bb
0617 07:53:20.682129 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.689502 (+ 7373us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.772608 (+ 83106us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.800551 (+ 27943us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1626908}
I20260617 07:53:20.801052 1862 tablet_replica.cc:333] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:20.801219 1862 raft_consensus.cc:2243] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:20.801443 1862 pending_rounds.cc:70] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:20.801477 1862 pending_rounds.cc:77] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772746341318656 op_type: NO_OP noop_request { }
I20260617 07:53:20.801556 1862 raft_consensus.cc:2889] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:20.801700 1862 raft_consensus.cc:2272] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:20.802014 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6343f3d909ac4438b882283ab2b25a6d consensus state has no leader
I20260617 07:53:20.802220 1862 ts_tablet_manager.cc:1916] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.802383 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e8431c1ec669439d8a2e5d4941c87229" } new_table_name: "default.Table_188549a6fb36472a8803b302e7b3242e" modify_external_catalogs: true
I20260617 07:53:20.803514 1172 raft_consensus.cc:385] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.805224 1172 raft_consensus.cc:740] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:20.807601 851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 111077us
W20260617 07:53:20.812839 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 246858us
I20260617 07:53:20.813113 2519 mvcc.cc:204] Tried to move back new op lower bound from 7297772730993983488 to 7297772704905031680. Current Snapshot: MvccSnapshot[applied={T|T < 7297772730993983488 or (T in {7297772730993983488})}]
I20260617 07:53:20.813222 1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35120ce002f24f2bb1ea0fdc59fbfc9d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:20.813386 1049 raft_consensus.cc:3060] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.814100 2544 tablet.cc:1724] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:20.814146 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2735f7dd40e54aec9004b9b38702607c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:20.814283 1050 raft_consensus.cc:3060] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.816321 1049 raft_consensus.cc:2468] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:20.816936 1050 raft_consensus.cc:2468] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:20.829376 2544 tablet.cc:1724] T c019792d23484fb789378bf377547415 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260617 07:53:20.840540 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca6c265c771745fa8eac4b5c410b5f7b consensus state has no leader
I20260617 07:53:20.840981 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_eef56c9ebee54dfd9afbd23cb41c3997"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:20.841352 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_39d5b904e80841a680a80c122fb5f324"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.841516 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eef56c9ebee54dfd9afbd23cb41c3997 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:20.841821 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39d5b904e80841a680a80c122fb5f324 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.810482 1172 consensus_queue.cc:260] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.845564 2544 tablet.cc:1724] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:20.847227 2613 tablet.cc:1724] T d9f7a4ea634f429794b402439d19bbfe P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.848105 1172 ts_tablet_manager.cc:1434] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.071s user 0.002s sys 0.000s
I20260617 07:53:20.824370 2541 tablet.cc:1724] T 233cae2480ed457bbab22ead8c0bde2c P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.846581 2546 tablet.cc:1724] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:20.825767 851 leader_election.cc:304] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:20.853459 851 leader_election.cc:304] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:20.854146 2607 raft_consensus.cc:2804] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:20.854508 2086 raft_consensus.cc:2804] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:20.854622 2086 raft_consensus.cc:697] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:20.855119 1846 ts_tablet_manager.cc:1929] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:20.855273 2607 raft_consensus.cc:697] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:20.855306 1846 log.cc:1199] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/706373f1f5d44edf81ed04183a8bdf89
I20260617 07:53:20.855758 1846 ts_tablet_manager.cc:1950] T 706373f1f5d44edf81ed04183a8bdf89 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:20.855715 2607 consensus_queue.cc:237] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.856617 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 505) took 1966 ms. Trace:
I20260617 07:53:20.860781 1846 rpcz_store.cc:276] 0617 07:53:18.890039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.893911 (+ 3872us) service_pool.cc:224] Handling call
0617 07:53:20.737948 (+1844037us) ts_tablet_manager.cc:1151] Deleting tablet 706373f1f5d44edf81ed04183a8bdf89
0617 07:53:20.737961 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.746285 (+ 8324us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.855031 (+108746us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.856594 (+ 1563us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1843908}
W20260617 07:53:20.864630 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b71de673a2c349cabc0d9ddc6bc8af38 consensus state has no leader
I20260617 07:53:20.861832 1178 tablet_bootstrap.cc:492] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:20.865872 1178 ts_tablet_manager.cc:1403] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.181s user 0.003s sys 0.001s
I20260617 07:53:20.848021 2612 tablet.cc:1724] T 233cae2480ed457bbab22ead8c0bde2c P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:20.866670 1178 raft_consensus.cc:359] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.866819 1178 raft_consensus.cc:385] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.866865 1178 raft_consensus.cc:740] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
W20260617 07:53:20.867017 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9f525ffe8cb430fb87941c019d40e62 consensus state has no leader
I20260617 07:53:20.867105 1178 consensus_queue.cc:260] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.867278 1172 tablet_bootstrap.cc:492] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:20.869494 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 235fae7a015a44919ee8204faa43d7c5 (DEFAULT_TABLE table=default.Table_dd74772ec6d14ec8a1c24d892c381b69 [id=212943063b0d44ea9392098c53d45db3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.869891 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 235fae7a015a44919ee8204faa43d7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.870012 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5f1a59c68c498e884b1be643933f44 (DEFAULT_TABLE table=default.Table_e1af9d7bebc74f11a4b6a29e9f0ec21e [id=5409c45870224be49404d78ae2810183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.870349 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5f1a59c68c498e884b1be643933f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.873970 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3b87f00ff04525974e942bb1570738 (DEFAULT_TABLE table=default.Table_6a44bc16d9d44201b9858bcb02b82fb2 [id=f1de8373fa3646a3b8881f8bb02007cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.874408 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3b87f00ff04525974e942bb1570738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.879884 754 tablet_service.cc:1511] Processing CreateTablet for tablet 3618d5f43f3f4b6385a3494c887e0880 (DEFAULT_TABLE table=default.Table_05211c75563a42548dc7c2184fac8e7d [id=959821b7b5ad497d865cb02eb4562fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.880013 742 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3b87f00ff04525974e942bb1570738 (DEFAULT_TABLE table=default.Table_6a44bc16d9d44201b9858bcb02b82fb2 [id=f1de8373fa3646a3b8881f8bb02007cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.880275 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3618d5f43f3f4b6385a3494c887e0880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.880506 745 tablet_service.cc:1511] Processing CreateTablet for tablet 10d37e32f7eb40e5aa3927230d0eeb5f (DEFAULT_TABLE table=default.Table_3fc8a58b75aa415993c1afd907d3c7d8 [id=2b887213d870482287d2b507a9308a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.880815 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d37e32f7eb40e5aa3927230d0eeb5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.886004 747 tablet_service.cc:1511] Processing CreateTablet for tablet e4232e6d6f034b39a0ba50dc9ca090ae (DEFAULT_TABLE table=default.Table_864d7fa9dccb4fd98be4356a0c0678f0 [id=c08a6babbc5940bda20534ae47d1f0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.886039 743 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5f1a59c68c498e884b1be643933f44 (DEFAULT_TABLE table=default.Table_e1af9d7bebc74f11a4b6a29e9f0ec21e [id=5409c45870224be49404d78ae2810183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.886412 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4232e6d6f034b39a0ba50dc9ca090ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.886474 744 tablet_service.cc:1511] Processing CreateTablet for tablet b6c112433d54458e8cefa35caeb09024 (DEFAULT_TABLE table=default.Table_b672313e82be462e8bb8adaec42d9ee2 [id=03be5b46787d4842bd92909c83bb1402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.886727 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:20.886826 756 tablet_service.cc:1511] Processing CreateTablet for tablet a0f7775846454e96a9f433e84e90a229 (DEFAULT_TABLE table=default.Table_ccca21d62d364154831f9ccd2cfd2c1d [id=aabd74d374ad4fb4b28e059ec0e01374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.887187 751 tablet_service.cc:1511] Processing CreateTablet for tablet 4d06c3ca75da4a06a8f965f409bbc4a2 (DEFAULT_TABLE table=default.Table_a1fb0f387de44393bfb99cdbce3007d4 [id=7fc04a52842c4a0fbdd047b650bf03a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.887483 2544 tablet.cc:1719] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b: Skipping requested alter to schema version 2, tablet already version 2
I20260617 07:53:20.873946 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 3618d5f43f3f4b6385a3494c887e0880 (DEFAULT_TABLE table=default.Table_05211c75563a42548dc7c2184fac8e7d [id=959821b7b5ad497d865cb02eb4562fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.887662 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_68ed1ed6fe664a738ed9a11be098557e [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 1 got 0
I20260617 07:53:20.887849 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3618d5f43f3f4b6385a3494c887e0880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.887887 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:20.888401 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
I20260617 07:53:20.889156 456 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:20.889978 755 tablet_service.cc:1511] Processing CreateTablet for tablet 3ec0ac6bf0cf445293553691d902033b (DEFAULT_TABLE table=default.Table_0a368d484ee648bba50a045dab04f192 [id=42cf0f9f8ab24a78842f20242d5414c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.890445 1172 tablet_bootstrap.cc:654] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.890476 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3b87f00ff04525974e942bb1570738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.892238 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c112433d54458e8cefa35caeb09024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.895552 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f7775846454e96a9f433e84e90a229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.897938 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d06c3ca75da4a06a8f965f409bbc4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.899537 2086 consensus_queue.cc:237] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.900943 750 tablet_service.cc:1511] Processing CreateTablet for tablet 235fae7a015a44919ee8204faa43d7c5 (DEFAULT_TABLE table=default.Table_dd74772ec6d14ec8a1c24d892c381b69 [id=212943063b0d44ea9392098c53d45db3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.901365 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 235fae7a015a44919ee8204faa43d7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.902005 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ec0ac6bf0cf445293553691d902033b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.906133 2541 tablet.cc:1724] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:20.907053 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5f1a59c68c498e884b1be643933f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.910487 1018 tablet_service.cc:1511] Processing CreateTablet for tablet b6c112433d54458e8cefa35caeb09024 (DEFAULT_TABLE table=default.Table_b672313e82be462e8bb8adaec42d9ee2 [id=03be5b46787d4842bd92909c83bb1402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.910763 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 4d06c3ca75da4a06a8f965f409bbc4a2 (DEFAULT_TABLE table=default.Table_a1fb0f387de44393bfb99cdbce3007d4 [id=7fc04a52842c4a0fbdd047b650bf03a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.910877 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c112433d54458e8cefa35caeb09024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.911027 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d06c3ca75da4a06a8f965f409bbc4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.911090 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 3ec0ac6bf0cf445293553691d902033b (DEFAULT_TABLE table=default.Table_0a368d484ee648bba50a045dab04f192 [id=42cf0f9f8ab24a78842f20242d5414c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.911422 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ec0ac6bf0cf445293553691d902033b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.913954 1022 tablet_service.cc:1511] Processing CreateTablet for tablet e4232e6d6f034b39a0ba50dc9ca090ae (DEFAULT_TABLE table=default.Table_864d7fa9dccb4fd98be4356a0c0678f0 [id=c08a6babbc5940bda20534ae47d1f0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.914261 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4232e6d6f034b39a0ba50dc9ca090ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.917997 1028 tablet_service.cc:1511] Processing CreateTablet for tablet a0f7775846454e96a9f433e84e90a229 (DEFAULT_TABLE table=default.Table_ccca21d62d364154831f9ccd2cfd2c1d [id=aabd74d374ad4fb4b28e059ec0e01374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.918303 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f7775846454e96a9f433e84e90a229. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:20.813045 852 leader_election.cc:343] T 60d1b4975077493eb6919b23d6523d3d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:20.919675 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 106628us
W20260617 07:53:20.919975 852 consensus_peers.cc:597] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.920293 852 leader_election.cc:343] T 49f0f68dcef34228a1b2a018e8aa329e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:20.921379 852 consensus_peers.cc:597] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.921597 852 consensus_peers.cc:597] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.921733 852 leader_election.cc:343] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.921818 852 leader_election.cc:304] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.924839 2577 tablet.cc:1719] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba: Skipping requested alter to schema version 2, tablet already version 2
I20260617 07:53:20.928212 2435 raft_consensus.cc:2749] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:20.928643 852 leader_election.cc:343] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:20.931550 852 leader_election.cc:343] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.931634 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 10d37e32f7eb40e5aa3927230d0eeb5f (DEFAULT_TABLE table=default.Table_3fc8a58b75aa415993c1afd907d3c7d8 [id=2b887213d870482287d2b507a9308a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:20.932081 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d37e32f7eb40e5aa3927230d0eeb5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:20.932397 1178 ts_tablet_manager.cc:1434] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.066s user 0.001s sys 0.000s
I20260617 07:53:20.932772 852 leader_election.cc:304] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:20.935927 1178 tablet_bootstrap.cc:492] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:20.936261 2460 raft_consensus.cc:2749] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:20.937379 852 consensus_peers.cc:597] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.939476 852 leader_election.cc:343] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:20.940791 852 consensus_peers.cc:597] T d9f7a4ea634f429794b402439d19bbfe P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:20.942971 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 514) took 2052 ms. Trace:
I20260617 07:53:20.943035 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 706373f1f5d44edf81ed04183a8bdf89 (table default.Table_3e620975807b4d4a895271b6fadd9c5a [id=c79a8c153d8b440ba0d42ba644fef938]) successfully deleted
W20260617 07:53:20.944402 852 consensus_peers.cc:597] T 28538804fd254dc8b4a341debf508a85 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.944550 852 consensus_peers.cc:597] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.944677 852 leader_election.cc:343] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:20.944931 852 consensus_peers.cc:597] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.945127 852 consensus_peers.cc:597] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:20.945364 1846 rpcz_store.cc:276] 0617 07:53:18.890955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.891887 (+ 932us) service_pool.cc:224] Handling call
0617 07:53:20.942851 (+2050964us) ts_tablet_manager.cc:1151] Deleting tablet 0ebafc920ed34216be5fb115f9bc6f7f
0617 07:53:20.942860 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.942954 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2048702}
I20260617 07:53:20.945758 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 520) took 2054 ms. Trace:
I20260617 07:53:20.945853 1846 rpcz_store.cc:276] 0617 07:53:18.964115 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.964173 (+ 58us) service_pool.cc:224] Handling call
0617 07:53:20.945639 (+1981466us) ts_tablet_manager.cc:1151] Deleting tablet 2684f3200e604bb6bf37a2f97a193eff
0617 07:53:20.945648 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.945743 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1981240}
W20260617 07:53:20.946048 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0ebafc920ed34216be5fb115f9bc6f7f because the tablet was not found. No further retry: Not found: Tablet not found: 0ebafc920ed34216be5fb115f9bc6f7f
I20260617 07:53:20.946162 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 521) took 1981 ms. Trace:
I20260617 07:53:20.946215 1846 rpcz_store.cc:276] 0617 07:53:18.964323 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.964440 (+ 117us) service_pool.cc:224] Handling call
0617 07:53:20.946088 (+1981648us) ts_tablet_manager.cc:1151] Deleting tablet df37ed81b17d4178adeb6057491b4cc9
0617 07:53:20.946096 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.946151 (+ 55us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1981496}
I20260617 07:53:20.946487 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 522) took 1981 ms. Trace:
W20260617 07:53:20.946589 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2684f3200e604bb6bf37a2f97a193eff because the tablet was not found. No further retry: Not found: Tablet not found: 2684f3200e604bb6bf37a2f97a193eff
I20260617 07:53:20.946563 1846 rpcz_store.cc:276] 0617 07:53:18.964884 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.965969 (+ 1085us) service_pool.cc:224] Handling call
0617 07:53:20.946410 (+1980441us) ts_tablet_manager.cc:1151] Deleting tablet 301bd4d6faec429ba71ce354c23d0f75
0617 07:53:20.946419 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.946473 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1980275}
I20260617 07:53:20.946696 1170 ts_tablet_manager.cc:1929] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:20.946794 1170 log.cc:1199] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/4681e8e3f1174b299d89ec541ca8e6b3
W20260617 07:53:20.946851 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df37ed81b17d4178adeb6057491b4cc9 because the tablet was not found. No further retry: Not found: Tablet not found: df37ed81b17d4178adeb6057491b4cc9
I20260617 07:53:20.946885 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 523) took 1980 ms. Trace:
I20260617 07:53:20.946949 1846 rpcz_store.cc:276] 0617 07:53:18.966257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.979858 (+ 13601us) service_pool.cc:224] Handling call
0617 07:53:20.946795 (+1966937us) ts_tablet_manager.cc:1151] Deleting tablet 7934f5fa0287427cb45fe568f0de8758
0617 07:53:20.946804 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.946870 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1966731}
I20260617 07:53:20.947100 1170 ts_tablet_manager.cc:1950] T 4681e8e3f1174b299d89ec541ca8e6b3 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:20.947317 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 524) took 1967 ms. Trace:
I20260617 07:53:20.947392 1846 rpcz_store.cc:276] 0617 07:53:18.980332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.980389 (+ 57us) service_pool.cc:224] Handling call
0617 07:53:20.947182 (+1966793us) ts_tablet_manager.cc:1151] Deleting tablet f15dcc10552d4747bad436538662bb66
0617 07:53:20.947192 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.947302 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1966644}
I20260617 07:53:20.947713 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 525) took 1966 ms. Trace:
I20260617 07:53:20.947782 1846 rpcz_store.cc:276] 0617 07:53:18.980769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.980815 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:20.947613 (+1966798us) ts_tablet_manager.cc:1151] Deleting tablet 92e55be5f28740fba65c1199a571d97a
0617 07:53:20.947620 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.947700 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1966662}
I20260617 07:53:20.948065 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 526) took 1966 ms. Trace:
I20260617 07:53:20.948149 1846 rpcz_store.cc:276] 0617 07:53:18.981920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.986735 (+ 4815us) service_pool.cc:224] Handling call
0617 07:53:20.947970 (+1961235us) ts_tablet_manager.cc:1151] Deleting tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1
0617 07:53:20.947977 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.948049 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1961080}
W20260617 07:53:20.948226 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 301bd4d6faec429ba71ce354c23d0f75 because the tablet was not found. No further retry: Not found: Tablet not found: 301bd4d6faec429ba71ce354c23d0f75
W20260617 07:53:20.948432 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7934f5fa0287427cb45fe568f0de8758 because the tablet was not found. No further retry: Not found: Tablet not found: 7934f5fa0287427cb45fe568f0de8758
I20260617 07:53:20.948472 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 527) took 1961 ms. Trace:
W20260617 07:53:20.948621 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f15dcc10552d4747bad436538662bb66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f15dcc10552d4747bad436538662bb66 already in progress: creating tablet
W20260617 07:53:20.948825 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 92e55be5f28740fba65c1199a571d97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92e55be5f28740fba65c1199a571d97a already in progress: creating tablet
W20260617 07:53:20.949298 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 already in progress: creating tablet
I20260617 07:53:20.952942 1172 tablet_bootstrap.cc:492] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:20.953130 1172 ts_tablet_manager.cc:1403] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.086s user 0.004s sys 0.000s
I20260617 07:53:20.954612 1172 raft_consensus.cc:359] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.954871 1172 raft_consensus.cc:385] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.954982 1172 raft_consensus.cc:740] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:20.955363 1172 consensus_queue.cc:260] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.943894 1178 tablet_bootstrap.cc:654] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.956089 1172 ts_tablet_manager.cc:1434] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260617 07:53:20.958009 852 leader_election.cc:343] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:20.960179 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 307) took 5024 ms. Trace:
I20260617 07:53:20.960526 1172 tablet_bootstrap.cc:492] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:20.962402 1172 tablet_bootstrap.cc:654] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.964594 1178 tablet_bootstrap.cc:492] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:20.964835 1178 ts_tablet_manager.cc:1403] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260617 07:53:20.960507 1170 rpcz_store.cc:276] 0617 07:53:15.923482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.923538 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:20.736425 (+4812887us) ts_tablet_manager.cc:1151] Deleting tablet 4681e8e3f1174b299d89ec541ca8e6b3
0617 07:53:20.736435 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.843929 (+107494us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.946643 (+102714us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.947869 (+ 1226us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4812670}
I20260617 07:53:20.970494 1170 tablet_replica.cc:333] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:20.970784 1178 raft_consensus.cc:359] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.971410 1170 raft_consensus.cc:2243] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: Raft consensus shutting down.
I20260617 07:53:20.971716 1178 raft_consensus.cc:385] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.972041 1170 pending_rounds.cc:70] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:20.972151 1178 raft_consensus.cc:740] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:20.972107 1172 tablet_bootstrap.cc:492] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:20.972643 1170 pending_rounds.cc:77] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7297772751112888320 op_type: NO_OP noop_request { }
I20260617 07:53:20.972929 1178 consensus_queue.cc:260] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.973347 1170 raft_consensus.cc:2889] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:20.974457 1170 raft_consensus.cc:2272] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.975054 1178 ts_tablet_manager.cc:1434] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260617 07:53:20.972815 1172 ts_tablet_manager.cc:1403] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.004s
I20260617 07:53:20.976310 1172 raft_consensus.cc:359] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.976577 1172 raft_consensus.cc:385] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:20.976686 1172 raft_consensus.cc:740] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:20.977017 1172 consensus_queue.cc:260] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.977401 1170 ts_tablet_manager.cc:1916] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.977833 1172 ts_tablet_manager.cc:1434] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:20.980137 1178 tablet_bootstrap.cc:492] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:20.981628 1172 tablet_bootstrap.cc:492] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:20.982421 852 consensus_peers.cc:597] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:20.982565 852 leader_election.cc:343] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:20.982838 852 consensus_peers.cc:597] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:20.985209 452 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6] alter complete (version 1)
I20260617 07:53:20.986167 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1ada4b463745460d84c6b2dabddbb8a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.986724 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ada4b463745460d84c6b2dabddbb8a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:20.989005 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a6e2bb6577648d2ab958cfaa6f4a948 consensus state has no leader
I20260617 07:53:20.990006 1862 ts_tablet_manager.cc:1929] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:20.990108 1862 log.cc:1199] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/98f7c3f6260c4db690de1a5081bb2493
I20260617 07:53:20.990418 1862 ts_tablet_manager.cc:1950] T 98f7c3f6260c4db690de1a5081bb2493 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:20.990715 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 435) took 1935 ms. Trace:
I20260617 07:53:20.990784 1862 rpcz_store.cc:276] 0617 07:53:19.055472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.055519 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:20.801011 (+1745492us) ts_tablet_manager.cc:1151] Deleting tablet 98f7c3f6260c4db690de1a5081bb2493
0617 07:53:20.801020 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.949795 (+148775us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.989949 (+ 40154us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:20.990700 (+ 751us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1745338}
I20260617 07:53:20.991096 1862 tablet_replica.cc:333] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:20.991211 459 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:20.991269 1862 raft_consensus.cc:2243] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:20.991400 1862 raft_consensus.cc:2272] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:20.991814 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8e82234c43f24c1c8a1d9275a00ddad8" } modify_external_catalogs: true
I20260617 07:53:20.991873 1862 ts_tablet_manager.cc:1916] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:20.991963 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8e82234c43f24c1c8a1d9275a00ddad8" } modify_external_catalogs: true
I20260617 07:53:20.992357 988 leader_election.cc:304] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:20.992767 2496 raft_consensus.cc:2804] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:20.992839 2496 raft_consensus.cc:493] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:20.992890 2496 raft_consensus.cc:3060] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:20.994123 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_bdc4153272a245ed8d093b6a029b70ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.994792 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdc4153272a245ed8d093b6a029b70ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.995412 2496 raft_consensus.cc:515] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:20.996600 2496 leader_election.cc:290] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:20.996757 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4f46dc52ee0141efa08440414be77e91" } modify_external_catalogs: true
I20260617 07:53:20.997407 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4f46dc52ee0141efa08440414be77e91" } modify_external_catalogs: true
I20260617 07:53:20.997972 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f5101e7941a84bc48c82f60e1ffec08e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:20.998442 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5101e7941a84bc48c82f60e1ffec08e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:20.999451 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 531ccdf479814053b468a7d5802f5dde) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.005306 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6aab5d840c984238b6468381f10e3272" } modify_external_catalogs: true
I20260617 07:53:21.005520 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6aab5d840c984238b6468381f10e3272" } modify_external_catalogs: true
I20260617 07:53:21.006124 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_94149217b8fd42f3a46ed6df137e9f82" } modify_external_catalogs: true
I20260617 07:53:21.006299 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_94149217b8fd42f3a46ed6df137e9f82" } modify_external_catalogs: true
I20260617 07:53:21.008708 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a6d78e96f79848dfb63d7525bcd52b5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.009218 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6d78e96f79848dfb63d7525bcd52b5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.011559 1172 tablet_bootstrap.cc:654] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:21.014719 988 leader_election.cc:343] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: d657fbccb4af40558033a971aab7f3e4
I20260617 07:53:20.996448 768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2e04c81f964fe1895219311eebdee4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:21.017382 986 leader_election.cc:343] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.018836 1178 tablet_bootstrap.cc:654] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.027863 1172 tablet_bootstrap.cc:492] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:21.028012 1172 ts_tablet_manager.cc:1403] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.000s
I20260617 07:53:21.028702 1172 raft_consensus.cc:359] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.028851 1172 raft_consensus.cc:385] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.028890 1172 raft_consensus.cc:740] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.029083 1172 consensus_queue.cc:260] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.029512 1172 ts_tablet_manager.cc:1434] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 07:53:21.033368 1178 tablet_bootstrap.cc:492] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:21.033972 1172 tablet_bootstrap.cc:492] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:21.034698 1178 ts_tablet_manager.cc:1403] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.005s
I20260617 07:53:21.035320 1172 tablet_bootstrap.cc:654] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.035530 1178 raft_consensus.cc:359] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.035835 1178 raft_consensus.cc:385] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.035949 1178 raft_consensus.cc:740] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.036240 1178 consensus_queue.cc:260] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.041131 1178 ts_tablet_manager.cc:1434] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:21.041678 1178 tablet_bootstrap.cc:492] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:21.043105 988 leader_election.cc:343] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.043220 988 leader_election.cc:304] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:21.043656 2496 raft_consensus.cc:2749] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.044454 1172 tablet_bootstrap.cc:492] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:21.044986 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 843c2afd54ee451a948cc8b92c556a31
I20260617 07:53:21.045207 1171 tablet_bootstrap.cc:492] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:21.045317 1171 ts_tablet_manager.cc:1403] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.334s user 0.009s sys 0.001s
I20260617 07:53:21.045820 1172 ts_tablet_manager.cc:1403] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.001s
I20260617 07:53:21.046375 1172 raft_consensus.cc:359] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.046958 1171 raft_consensus.cc:359] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.047092 1171 raft_consensus.cc:385] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.047134 1171 raft_consensus.cc:740] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.047288 1171 consensus_queue.cc:260] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.047737 1171 ts_tablet_manager.cc:1434] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:21.047966 1171 tablet_bootstrap.cc:492] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:21.049472 1171 tablet_bootstrap.cc:654] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:20.948539 1846 rpcz_store.cc:276] 0617 07:53:18.987032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.987078 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:20.948375 (+1961297us) ts_tablet_manager.cc:1151] Deleting tablet 5942eea42c7541349ad7b6560e6777c8
0617 07:53:20.948385 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.948458 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1961144}
I20260617 07:53:21.050405 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 528) took 2063 ms. Trace:
I20260617 07:53:21.050477 1846 rpcz_store.cc:276] 0617 07:53:18.987412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.987453 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:21.050278 (+2062825us) ts_tablet_manager.cc:1151] Deleting tablet ce7cb453c7b647f298a6ebe20fd0e45b
0617 07:53:21.050288 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.050387 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2062686}
I20260617 07:53:21.050781 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 529) took 2063 ms. Trace:
I20260617 07:53:21.050834 1846 rpcz_store.cc:276] 0617 07:53:18.987738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.987782 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:21.050701 (+2062919us) ts_tablet_manager.cc:1151] Deleting tablet 71e8f7118aaf4c6a9b9caab5abc030fa
0617 07:53:21.050708 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.050771 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2062783}
I20260617 07:53:21.051087 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 531) took 2062 ms. Trace:
I20260617 07:53:21.051147 1846 rpcz_store.cc:276] 0617 07:53:18.988340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.988390 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:21.051010 (+2062620us) ts_tablet_manager.cc:1151] Deleting tablet d965aa4e8dc244cdb93dd15cdee9070c
0617 07:53:21.051017 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.051076 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2062482}
I20260617 07:53:21.051367 1846 tablet_replica.cc:333] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:21.051517 1846 raft_consensus.cc:2243] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.051646 1846 raft_consensus.cc:2272] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.052099 1846 ts_tablet_manager.cc:1916] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.053704 988 leader_election.cc:304] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:21.054106 2496 raft_consensus.cc:2804] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:21.054203 2496 raft_consensus.cc:697] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:21.054421 2496 consensus_queue.cc:237] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.056203 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6a44bc16d9d44201b9858bcb02b82fb2" } new_table_name: "default.Table_ef6ae2b996d941d688299d061c4d4989" modify_external_catalogs: true
W20260617 07:53:21.058418 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5942eea42c7541349ad7b6560e6777c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5942eea42c7541349ad7b6560e6777c8 already in progress: creating tablet
W20260617 07:53:21.058667 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ce7cb453c7b647f298a6ebe20fd0e45b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce7cb453c7b647f298a6ebe20fd0e45b already in progress: creating tablet
W20260617 07:53:21.058887 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 71e8f7118aaf4c6a9b9caab5abc030fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71e8f7118aaf4c6a9b9caab5abc030fa already in progress: creating tablet
W20260617 07:53:21.059087 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d965aa4e8dc244cdb93dd15cdee9070c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d965aa4e8dc244cdb93dd15cdee9070c already in progress: creating tablet
I20260617 07:53:21.059994 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 843c2afd54ee451a948cc8b92c556a31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.060328 988 leader_election.cc:304] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:21.060683 2525 raft_consensus.cc:2804] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:21.061518 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet e9bed1de333b4944a9a72ae26a9f8542
I20260617 07:53:21.062234 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a459934d3ce24abea618034a223e20e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.062798 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a459934d3ce24abea618034a223e20e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.065770 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e9bed1de333b4944a9a72ae26a9f8542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.067881 768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2735f7dd40e54aec9004b9b38702607c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:21.068246 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35120ce002f24f2bb1ea0fdc59fbfc9d" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:21.068807 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 60d1b4975077493eb6919b23d6523d3d (table default.Table_d199dae87e49454e8a74b84f1e0e28df [id=db2d3339eca0486bae7ce80d2f36323b]) successfully deleted
W20260617 07:53:21.069063 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 already in progress: creating tablet
W20260617 07:53:21.069254 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ce7cc6cbd4a0474880ed62aebc035226 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce7cc6cbd4a0474880ed62aebc035226 already in progress: creating tablet
W20260617 07:53:21.069453 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet adbb0c38ef9242a5bfbbcbe22faa5df9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbb0c38ef9242a5bfbbcbe22faa5df9 already in progress: creating tablet
I20260617 07:53:21.070453 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 630e540a77374c11895ab5a0e394b3bb (table default.Table_09ed725f843f4ae09d3c74af68112a46 [id=5000dc26300c4d94a567bd56e0d8599c]) successfully deleted
I20260617 07:53:21.071276 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 843c2afd54ee451a948cc8b92c556a31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.046510 1172 raft_consensus.cc:385] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.071408 1172 raft_consensus.cc:740] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.071517 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet e9bed1de333b4944a9a72ae26a9f8542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.071643 1172 consensus_queue.cc:260] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.040132 1862 ts_tablet_manager.cc:1929] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:21.072350 1862 log.cc:1199] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/121339ab4842432e9fb7bc357750f8ad
I20260617 07:53:21.072749 1862 ts_tablet_manager.cc:1950] T 121339ab4842432e9fb7bc357750f8ad P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:21.073513 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 436) took 2017 ms. Trace:
I20260617 07:53:21.073757 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet e793cbccf5774e95a8316d6298d4646f
I20260617 07:53:21.073638 1862 rpcz_store.cc:276] 0617 07:53:19.055853 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.055899 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:20.991042 (+1935143us) ts_tablet_manager.cc:1151] Deleting tablet 121339ab4842432e9fb7bc357750f8ad
0617 07:53:20.991051 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.037122 (+ 46071us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.040084 (+ 2962us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.073491 (+ 33407us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1935008}
I20260617 07:53:21.073946 1862 tablet_replica.cc:333] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:21.074110 1862 raft_consensus.cc:2243] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:21.074433 1862 pending_rounds.cc:70] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:21.074502 1862 pending_rounds.cc:77] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772744594018304 op_type: NO_OP noop_request { }
I20260617 07:53:21.074597 1862 raft_consensus.cc:2889] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:21.074672 1862 raft_consensus.cc:2272] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.075157 1862 ts_tablet_manager.cc:1916] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.075691 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:21.076435 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_94ca7e593fc74524abf0ef739e7f986b" } new_table_name: "default.Table_940ae22d379b46c9b49a775aab3b8df7" modify_external_catalogs: true
I20260617 07:53:21.077924 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e793cbccf5774e95a8316d6298d4646f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.079191 1171 tablet_bootstrap.cc:492] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:21.079324 1171 ts_tablet_manager.cc:1403] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20260617 07:53:21.079712 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_7cf71f8401574af8942dd3ca2655bce9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:21.079988 1171 raft_consensus.cc:359] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.080156 1171 raft_consensus.cc:385] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.080209 1171 raft_consensus.cc:740] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:21.080252 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cf71f8401574af8942dd3ca2655bce9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.081429 1170 ts_tablet_manager.cc:1929] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260617 07:53:21.081568 1170 log.cc:1199] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d657fbccb4af40558033a971aab7f3e4
I20260617 07:53:21.081631 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_02c5782d285546afa40f4361def24646" } new_table_name: "default.Table_635f5a30f3b74987a484ab09420698c8" modify_external_catalogs: true
I20260617 07:53:21.082000 2525 raft_consensus.cc:697] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:21.082273 2525 consensus_queue.cc:237] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.082731 763 raft_consensus.cc:3060] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.083294 1171 consensus_queue.cc:260] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.083761 1171 ts_tablet_manager.cc:1434] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 07:53:21.084012 1171 tablet_bootstrap.cc:492] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:21.085325 1171 tablet_bootstrap.cc:654] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.090763 1172 ts_tablet_manager.cc:1434] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.045s user 0.001s sys 0.001s
I20260617 07:53:21.095196 1178 tablet_bootstrap.cc:654] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.097560 1172 tablet_bootstrap.cc:492] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:21.108296 1172 tablet_bootstrap.cc:654] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.108624 1178 tablet_bootstrap.cc:492] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:21.108842 1178 ts_tablet_manager.cc:1403] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.067s user 0.024s sys 0.004s
I20260617 07:53:21.109530 1178 raft_consensus.cc:359] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.109786 1178 raft_consensus.cc:385] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.109887 1178 raft_consensus.cc:740] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.110054 2601 tablet.cc:1724] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:21.110147 1178 consensus_queue.cc:260] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.110592 1178 ts_tablet_manager.cc:1434] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:21.110882 1178 tablet_bootstrap.cc:492] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:21.112290 1178 tablet_bootstrap.cc:654] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.117633 2595 tablet.cc:1724] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:21.082057 1170 ts_tablet_manager.cc:1950] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:21.124764 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 306) took 5201 ms. Trace:
I20260617 07:53:21.124945 1170 rpcz_store.cc:276] 0617 07:53:15.923333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.924242 (+ 909us) service_pool.cc:224] Handling call
0617 07:53:20.970431 (+5046189us) ts_tablet_manager.cc:1151] Deleting tablet d657fbccb4af40558033a971aab7f3e4
0617 07:53:20.970443 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:20.990636 (+ 20193us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.081368 (+ 90732us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.124740 (+ 43372us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5046027}
I20260617 07:53:21.125536 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 308) took 5199 ms. Trace:
I20260617 07:53:21.125788 1170 rpcz_store.cc:276] 0617 07:53:15.925598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.926013 (+ 415us) service_pool.cc:224] Handling call
0617 07:53:21.125420 (+5199407us) ts_tablet_manager.cc:1151] Deleting tablet 8c76bfcbd22e4bfb97346a1b56f68dab
0617 07:53:21.125431 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.125523 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5199255}
I20260617 07:53:21.126338 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 309) took 5196 ms. Trace:
I20260617 07:53:21.126470 1170 rpcz_store.cc:276] 0617 07:53:15.929485 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.929874 (+ 389us) service_pool.cc:224] Handling call
0617 07:53:21.126057 (+5196183us) ts_tablet_manager.cc:1151] Deleting tablet ed9a99cdcbb74a3fb74654a26716a1c9
0617 07:53:21.126068 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.126319 (+ 251us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5196021}
I20260617 07:53:21.126895 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 310) took 5157 ms. Trace:
I20260617 07:53:21.127025 1170 rpcz_store.cc:276] 0617 07:53:15.969452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.969512 (+ 60us) service_pool.cc:224] Handling call
0617 07:53:21.126787 (+5157275us) ts_tablet_manager.cc:1151] Deleting tablet dac3dc9d7da447cb8fdca84fdac0dc39
0617 07:53:21.126798 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.126878 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5157007}
I20260617 07:53:21.127315 1170 tablet_replica.cc:333] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:21.127524 1170 raft_consensus.cc:2243] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.127702 1170 raft_consensus.cc:2272] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.128242 1170 ts_tablet_manager.cc:1916] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.128304 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d657fbccb4af40558033a971aab7f3e4 (table default.Table_de275810487f4911a911f2d6e00a8963 [id=1f208e21034e47a8a25e0e9988e5b156]) successfully deleted
W20260617 07:53:21.129899 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ed9a99cdcbb74a3fb74654a26716a1c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed9a99cdcbb74a3fb74654a26716a1c9 already in progress: creating tablet
W20260617 07:53:21.131150 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet dac3dc9d7da447cb8fdca84fdac0dc39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dac3dc9d7da447cb8fdca84fdac0dc39 already in progress: creating tablet
I20260617 07:53:21.135866 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet b4c9a032007a412e95bbd2b229edd50b
I20260617 07:53:21.136898 754 tablet_service.cc:1558] Processing DeleteTablet for tablet b4c9a032007a412e95bbd2b229edd50b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.138424 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c4e47d1c1dd44cd0b8444ac78849276a" } new_table_name: "default.Table_229fd1939d334451bd1bfe29710d945a" modify_external_catalogs: true
I20260617 07:53:21.144088 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]). Expected version 1 got 0
I20260617 07:53:21.144855 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ca9627895d9a4657b6ada887dc66a04d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:21.145296 1846 ts_tablet_manager.cc:1929] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:21.145392 1846 log.cc:1199] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a38bb8a140ef4bcab65aaa03bdb79040
W20260617 07:53:21.145375 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca9627895d9a4657b6ada887dc66a04d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.145664 1846 ts_tablet_manager.cc:1950] T a38bb8a140ef4bcab65aaa03bdb79040 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:21.146374 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 532) took 2157 ms. Trace:
W20260617 07:53:21.147401 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e3b87f00ff04525974e942bb1570738 consensus state has no leader
I20260617 07:53:21.147686 454 master_service.cc:960] ReplaceTablet: received request to replace tablet e9488e8a501e404f85540fb045d8916f from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:21.148043 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 98f7c3f6260c4db690de1a5081bb2493 (table default.Table_010f16ad25e74ae9a880163fe9e08de8 [id=94a23a9e1e434285acc94bced26578f6]) successfully deleted
W20260617 07:53:21.152261 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a22d9bc2cbe2478e869e54878e52e0ed consensus state has no leader
W20260617 07:53:21.166858 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe1d18ae17af40478a47d136f8e02549 consensus state has no leader
I20260617 07:53:21.170548 1171 tablet_bootstrap.cc:492] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:21.170697 1171 ts_tablet_manager.cc:1403] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.087s user 0.014s sys 0.004s
I20260617 07:53:21.174386 1171 raft_consensus.cc:359] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.174554 1171 raft_consensus.cc:385] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.174607 1171 raft_consensus.cc:740] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.174779 1171 consensus_queue.cc:260] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.176174 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 24ba13170e864dfa96cddfb1a76b8c40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.177662 1171 ts_tablet_manager.cc:1434] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:21.177923 885 tablet_service.cc:1558] Processing DeleteTablet for tablet ea4c1033487a4dd2a73bd5148d5bb8f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.178541 885 tablet_service.cc:1558] Processing DeleteTablet for tablet d06187aa09fd4776a992a07405a10876 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.179129 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 561c8bf9e5c840628ab1c8cf91dc2d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.181351 885 tablet_service.cc:1511] Processing CreateTablet for tablet 235fae7a015a44919ee8204faa43d7c5 (DEFAULT_TABLE table=default.Table_dd74772ec6d14ec8a1c24d892c381b69 [id=212943063b0d44ea9392098c53d45db3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.181805 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 235fae7a015a44919ee8204faa43d7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.177968 1171 tablet_bootstrap.cc:492] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:21.184201 1171 tablet_bootstrap.cc:654] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.137832 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet e793cbccf5774e95a8316d6298d4646f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.139644 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet b4c9a032007a412e95bbd2b229edd50b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.195441 1170 ts_tablet_manager.cc:1929] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:21.195581 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:21.196218 887 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5f1a59c68c498e884b1be643933f44 (DEFAULT_TABLE table=default.Table_e1af9d7bebc74f11a4b6a29e9f0ec21e [id=5409c45870224be49404d78ae2810183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.196609 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5f1a59c68c498e884b1be643933f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.197114 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_a760668e4e954d438ebe1331c429627f [id=3d306a3bde784759bd8e3a45fa8cddec] alter complete (version 2)
I20260617 07:53:21.203325 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1de5405081c8481b91216795e6dc49e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.203876 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1de5405081c8481b91216795e6dc49e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.205118 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2e0c8868cecd4508931d50741b88c707"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.205618 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e0c8868cecd4508931d50741b88c707 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.208384 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4b4c152f005d443b9db80fc5cafbf4ae" } new_table_name: "default.Table_125fb3025f5f4359b73f8c91805c07ee" modify_external_catalogs: true
I20260617 07:53:21.208384 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_62f82c8919c149e1951e96accea98979"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.208989 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62f82c8919c149e1951e96accea98979 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.210708 886 tablet_service.cc:1511] Processing CreateTablet for tablet 10d37e32f7eb40e5aa3927230d0eeb5f (DEFAULT_TABLE table=default.Table_3fc8a58b75aa415993c1afd907d3c7d8 [id=2b887213d870482287d2b507a9308a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.211165 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d37e32f7eb40e5aa3927230d0eeb5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.217555 892 tablet_service.cc:1511] Processing CreateTablet for tablet e4232e6d6f034b39a0ba50dc9ca090ae (DEFAULT_TABLE table=default.Table_864d7fa9dccb4fd98be4356a0c0678f0 [id=c08a6babbc5940bda20534ae47d1f0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.217947 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4232e6d6f034b39a0ba50dc9ca090ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.221817 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8] alter complete (version 1)
I20260617 07:53:21.223325 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf] alter complete (version 1)
I20260617 07:53:21.224625 887 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3b87f00ff04525974e942bb1570738 (DEFAULT_TABLE table=default.Table_6a44bc16d9d44201b9858bcb02b82fb2 [id=f1de8373fa3646a3b8881f8bb02007cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.225075 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3b87f00ff04525974e942bb1570738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.225565 886 tablet_service.cc:1511] Processing CreateTablet for tablet b6c112433d54458e8cefa35caeb09024 (DEFAULT_TABLE table=default.Table_b672313e82be462e8bb8adaec42d9ee2 [id=03be5b46787d4842bd92909c83bb1402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.232070 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c112433d54458e8cefa35caeb09024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.243455 2196 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" instance_seqno: 1781682779293509) as {username='slave'} at 127.0.105.130:44983; Asking this server to re-register.
I20260617 07:53:21.258404 892 tablet_service.cc:1511] Processing CreateTablet for tablet 4d06c3ca75da4a06a8f965f409bbc4a2 (DEFAULT_TABLE table=default.Table_a1fb0f387de44393bfb99cdbce3007d4 [id=7fc04a52842c4a0fbdd047b650bf03a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.258996 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d06c3ca75da4a06a8f965f409bbc4a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:21.259006 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86ba708f127f40398ddf6fd846e4ff49 consensus state has no leader
I20260617 07:53:21.262892 459 catalog_manager.cc:5696] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:21.263465 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:21.263883 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 8cf4025a0f784cc6868950e51a45da2e (table default.Table_162d3b6e1d5749068f166f820520acc0 [id=bf143b9baca647f0b25452d16dff2ae6]). Expected version 1 got 0
I20260617 07:53:21.266454 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 843c2afd54ee451a948cc8b92c556a31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.266832 884 tablet_service.cc:1558] Processing DeleteTablet for tablet e9bed1de333b4944a9a72ae26a9f8542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.267158 884 tablet_service.cc:1558] Processing DeleteTablet for tablet e793cbccf5774e95a8316d6298d4646f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.267470 884 tablet_service.cc:1558] Processing DeleteTablet for tablet b4c9a032007a412e95bbd2b229edd50b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.269990 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e2fdbe909a5540ef9bdfd194cfda30d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.270558 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2fdbe909a5540ef9bdfd194cfda30d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.271808 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c35a3ed8e6204960bfd8de4797c65873" } modify_external_catalogs: true
I20260617 07:53:21.272053 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c35a3ed8e6204960bfd8de4797c65873" } modify_external_catalogs: true
I20260617 07:53:21.273398 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c813206f83544ff98e3076dd51d314fc" } modify_external_catalogs: true
I20260617 07:53:21.273608 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c813206f83544ff98e3076dd51d314fc" } modify_external_catalogs: true
I20260617 07:53:21.167003 1178 tablet_bootstrap.cc:492] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:21.274654 1178 ts_tablet_manager.cc:1403] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.164s user 0.003s sys 0.003s
I20260617 07:53:21.275363 1178 raft_consensus.cc:359] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.275506 1178 raft_consensus.cc:385] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.275549 1178 raft_consensus.cc:740] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.275756 1178 consensus_queue.cc:260] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.257655 2516 raft_consensus.cc:493] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.276070 2516 raft_consensus.cc:515] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.276634 2516 leader_election.cc:290] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:21.280490 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8ad88b948b384a1d85bd46175deef92e (DEFAULT_TABLE table=default.Table_eef56c9ebee54dfd9afbd23cb41c3997 [id=2a5490317bef4e85b503ea7bc8c7e8f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.280856 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad88b948b384a1d85bd46175deef92e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:21.282238 716 leader_election.cc:343] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 3bee4c9cd9f2415ca54b8e85dbd326a7
W20260617 07:53:21.286043 713 leader_election.cc:343] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 3bee4c9cd9f2415ca54b8e85dbd326a7
I20260617 07:53:21.286150 713 leader_election.cc:304] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.286381 2516 raft_consensus.cc:2749] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.292928 2594 consensus_queue.cc:1048] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:21.296022 460 master_service.cc:960] ReplaceTablet: received request to replace tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:21.296872 1178 ts_tablet_manager.cc:1434] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.022s user 0.001s sys 0.005s
I20260617 07:53:21.297266 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ef8f02d7ea8d407898c00619b16844d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.297829 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef8f02d7ea8d407898c00619b16844d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.299005 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_aef641dfc3a1426eb4f2870b832f873d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.299464 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aef641dfc3a1426eb4f2870b832f873d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.299613 1178 tablet_bootstrap.cc:492] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:21.302723 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 421ad54782ac4ea1bef756a0129b3f21
I20260617 07:53:21.302977 1178 tablet_bootstrap.cc:654] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.304883 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9cbd5b289a9346eaad72894e1a5dd1c8" } modify_external_catalogs: true
I20260617 07:53:21.305055 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9cbd5b289a9346eaad72894e1a5dd1c8" } modify_external_catalogs: true
I20260617 07:53:21.307058 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913] alter complete (version 3)
I20260617 07:53:21.309782 1846 rpcz_store.cc:276] 0617 07:53:18.988455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.988559 (+ 104us) service_pool.cc:224] Handling call
0617 07:53:21.051334 (+2062775us) ts_tablet_manager.cc:1151] Deleting tablet a38bb8a140ef4bcab65aaa03bdb79040
0617 07:53:21.051341 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.104559 (+ 53218us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.145240 (+ 40681us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.146357 (+ 1117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2062619}
I20260617 07:53:21.310269 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 533) took 2321 ms. Trace:
I20260617 07:53:21.310348 1846 rpcz_store.cc:276] 0617 07:53:18.988565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.988726 (+ 161us) service_pool.cc:224] Handling call
0617 07:53:21.310141 (+2321415us) ts_tablet_manager.cc:1151] Deleting tablet df5224716de249e9be9d7239407579a9
0617 07:53:21.310152 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.310251 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2321298}
I20260617 07:53:21.310668 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 535) took 2321 ms. Trace:
I20260617 07:53:21.310737 1846 rpcz_store.cc:276] 0617 07:53:18.988814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.988864 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:21.310568 (+2321704us) ts_tablet_manager.cc:1151] Deleting tablet 66140c5d364f453a8089f143cc96ede8
0617 07:53:21.310588 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.310655 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2321553}
I20260617 07:53:21.311080 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 534) took 2322 ms. Trace:
I20260617 07:53:21.311144 1846 rpcz_store.cc:276] 0617 07:53:18.988714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.989052 (+ 338us) service_pool.cc:224] Handling call
0617 07:53:21.310978 (+2321926us) ts_tablet_manager.cc:1151] Deleting tablet 8a4f81daf583464e988521e189ca39b6
0617 07:53:21.310989 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.311069 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2321796}
I20260617 07:53:21.311368 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 538) took 2322 ms. Trace:
I20260617 07:53:21.311421 1846 rpcz_store.cc:276] 0617 07:53:18.989127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.989210 (+ 83us) service_pool.cc:224] Handling call
0617 07:53:21.311296 (+2322086us) ts_tablet_manager.cc:1151] Deleting tablet e55d63a25a2845dbbcce20e560361007
0617 07:53:21.311303 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.311358 (+ 55us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2321979}
I20260617 07:53:21.311671 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 540) took 2322 ms. Trace:
I20260617 07:53:21.311723 1846 rpcz_store.cc:276] 0617 07:53:18.989310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.989347 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:21.311595 (+2322248us) ts_tablet_manager.cc:1151] Deleting tablet adbbe7eb5181431290f57ed9128181a3
0617 07:53:21.311603 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.311659 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322074}
I20260617 07:53:21.311959 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 541) took 2322 ms. Trace:
I20260617 07:53:21.312021 1846 rpcz_store.cc:276] 0617 07:53:18.989432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.989543 (+ 111us) service_pool.cc:224] Handling call
0617 07:53:21.311885 (+2322342us) ts_tablet_manager.cc:1151] Deleting tablet 0be19ece3a0a4a51abad7b8e2f3b2420
0617 07:53:21.311891 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.311949 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322231}
I20260617 07:53:21.312278 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 543) took 2322 ms. Trace:
I20260617 07:53:21.312341 1846 rpcz_store.cc:276] 0617 07:53:18.989647 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.989682 (+ 35us) service_pool.cc:224] Handling call
0617 07:53:21.312203 (+2322521us) ts_tablet_manager.cc:1151] Deleting tablet 737e9344fc824714a2c2596170637158
0617 07:53:21.312211 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.312267 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322368}
I20260617 07:53:21.312587 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 537) took 2323 ms. Trace:
I20260617 07:53:21.312963 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a38bb8a140ef4bcab65aaa03bdb79040 (table default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]) successfully deleted
W20260617 07:53:21.313218 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet df5224716de249e9be9d7239407579a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df5224716de249e9be9d7239407579a9 already in progress: creating tablet
W20260617 07:53:21.313458 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 66140c5d364f453a8089f143cc96ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66140c5d364f453a8089f143cc96ede8 already in progress: creating tablet
W20260617 07:53:21.313668 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8a4f81daf583464e988521e189ca39b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4f81daf583464e988521e189ca39b6 already in progress: creating tablet
W20260617 07:53:21.313933 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e55d63a25a2845dbbcce20e560361007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55d63a25a2845dbbcce20e560361007 already in progress: creating tablet
W20260617 07:53:21.314118 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet adbbe7eb5181431290f57ed9128181a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbbe7eb5181431290f57ed9128181a3 already in progress: creating tablet
W20260617 07:53:21.314329 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0be19ece3a0a4a51abad7b8e2f3b2420 already in progress: creating tablet
W20260617 07:53:21.314512 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 737e9344fc824714a2c2596170637158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 737e9344fc824714a2c2596170637158 already in progress: creating tablet
I20260617 07:53:21.316067 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 421ad54782ac4ea1bef756a0129b3f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.319613 754 tablet_service.cc:1511] Processing CreateTablet for tablet 35603d6795ed447aae92edfb3ddbadd6 (DEFAULT_TABLE table=default.Table_90a4260ed99e4d37bf5eb8b28ca1a897 [id=098e2556c4b84075a1cdd91e84264580]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.320053 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35603d6795ed447aae92edfb3ddbadd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.321273 885 tablet_service.cc:1511] Processing CreateTablet for tablet 3618d5f43f3f4b6385a3494c887e0880 (DEFAULT_TABLE table=default.Table_05211c75563a42548dc7c2184fac8e7d [id=959821b7b5ad497d865cb02eb4562fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.321633 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3618d5f43f3f4b6385a3494c887e0880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.327069 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.327172 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.327474 881 tablet_service.cc:1558] Processing DeleteTablet for tablet eb75a965740344c2bd0b68a8dda28be5 with delete_type TABLET_DATA_DELETED (replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.328516 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 60d1b4975077493eb6919b23d6523d3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.173677 1862 ts_tablet_manager.cc:1929] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:21.333977 1862 log.cc:1199] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/4de8df5e15cb43c0b95ec5af3110db66
I20260617 07:53:21.334438 1862 ts_tablet_manager.cc:1950] T 4de8df5e15cb43c0b95ec5af3110db66 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:21.336383 743 tablet_service.cc:1511] Processing CreateTablet for tablet 2c120eba06a549ef88ffa19998ab0f3d (DEFAULT_TABLE table=default.Table_73897e868adb452cbbcedea7797a6352 [id=03d2a1add32c43898bafa557e4d010fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.336788 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c120eba06a549ef88ffa19998ab0f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.338052 881 tablet_service.cc:1558] Processing DeleteTablet for tablet 421ad54782ac4ea1bef756a0129b3f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.338508 881 tablet_service.cc:1511] Processing CreateTablet for tablet 8ad88b948b384a1d85bd46175deef92e (DEFAULT_TABLE table=default.Table_eef56c9ebee54dfd9afbd23cb41c3997 [id=2a5490317bef4e85b503ea7bc8c7e8f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.338958 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d with delete_type TABLET_DATA_DELETED (replaced by tablet c449d3e251aa4f06a9191114bff0e0e2) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.339195 896 tablet_service.cc:1558] Processing DeleteTablet for tablet eba5976fcadd4add9c671300b431617b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.339342 891 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.339449 879 tablet_service.cc:1511] Processing CreateTablet for tablet 35603d6795ed447aae92edfb3ddbadd6 (DEFAULT_TABLE table=default.Table_90a4260ed99e4d37bf5eb8b28ca1a897 [id=098e2556c4b84075a1cdd91e84264580]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.339572 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.343101 751 tablet_service.cc:1511] Processing CreateTablet for tablet 175fd4179bf942bea115d528ef8ec5b3 (DEFAULT_TABLE table=default.Table_0e9b1e85ad604663ab3ccec9715a7f58 [id=413ebfa41eaf4bd3a6734234a30fa136]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.343453 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175fd4179bf942bea115d528ef8ec5b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:21.344515 445 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 (table default.Table_188549a6fb36472a8803b302e7b3242e [id=82e3b8ffa5114e59a20d7aaa93aca993], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6a6e2bb6577648d2ab958cfaa6f4a948 consensus state has no leader
I20260617 07:53:21.345964 755 tablet_service.cc:1511] Processing CreateTablet for tablet 523910abbabe476cbcf79484f53849db (DEFAULT_TABLE table=default.Table_cbdb621b1fb848b4a04b402345b7d37b [id=ff3033d580bb46298d77291006b064fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.346273 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 523910abbabe476cbcf79484f53849db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.349478 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_758d420011294192a9452766d8318b18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.350806 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_758d420011294192a9452766d8318b18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.358744 2644 raft_consensus.cc:493] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.358883 2644 raft_consensus.cc:515] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.359543 2644 leader_election.cc:290] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:21.360949 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464cf1effff241608f4a7255f2646b04" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:21.361203 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2e04c81f964fe1895219311eebdee4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:21.361356 914 raft_consensus.cc:3060] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.363842 914 raft_consensus.cc:2468] T ad2e04c81f964fe1895219311eebdee4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:21.364291 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad88b948b384a1d85bd46175deef92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.366505 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6b3ef645c2e84944a54aafdcf255ab13" } new_table_name: "default.Table_393005a135094d7fb79b604c25778597" modify_external_catalogs: true
I20260617 07:53:21.369927 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35603d6795ed447aae92edfb3ddbadd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.373920 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4a565d37b37b41ccb4986fa0375d4cca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.374471 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a565d37b37b41ccb4986fa0375d4cca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.375936 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b258682fadd740239b48cefca07e7c9c" } modify_external_catalogs: true
I20260617 07:53:21.376165 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b258682fadd740239b48cefca07e7c9c" } modify_external_catalogs: true
I20260617 07:53:21.378623 1171 tablet_bootstrap.cc:492] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:21.378803 1171 ts_tablet_manager.cc:1403] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.201s user 0.014s sys 0.031s
I20260617 07:53:21.379487 1171 raft_consensus.cc:359] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.379644 1171 raft_consensus.cc:385] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.379707 1171 raft_consensus.cc:740] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.379866 1171 consensus_queue.cc:260] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.383608 1171 ts_tablet_manager.cc:1434] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:21.383929 1171 tablet_bootstrap.cc:492] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:21.384781 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 5f4a8b06f77643dcb28f0c3136510253
I20260617 07:53:21.384902 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 437) took 2328 ms. Trace:
I20260617 07:53:21.384975 1862 rpcz_store.cc:276] 0617 07:53:19.056202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.056259 (+ 57us) service_pool.cc:224] Handling call
0617 07:53:21.073905 (+2017646us) ts_tablet_manager.cc:1151] Deleting tablet 4de8df5e15cb43c0b95ec5af3110db66
0617 07:53:21.073913 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.170361 (+ 96448us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.173629 (+ 3268us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.384883 (+211254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6693,"tablet-delete.queue_time_us":2017510}
I20260617 07:53:21.385335 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 438) took 2289 ms. Trace:
I20260617 07:53:21.385398 1862 rpcz_store.cc:276] 0617 07:53:19.095881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.095935 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:21.385228 (+2289293us) ts_tablet_manager.cc:1151] Deleting tablet fb74bb5046dc4bda98be3a9ba2f4a3c6
0617 07:53:21.385237 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.385320 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2289098}
I20260617 07:53:21.385592 1171 tablet_bootstrap.cc:654] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.385741 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 439) took 2252 ms. Trace:
I20260617 07:53:21.388798 1178 tablet_bootstrap.cc:492] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:21.389781 1178 ts_tablet_manager.cc:1403] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.090s user 0.001s sys 0.005s
I20260617 07:53:21.391180 887 tablet_service.cc:1511] Processing CreateTablet for tablet 3ec0ac6bf0cf445293553691d902033b (DEFAULT_TABLE table=default.Table_0a368d484ee648bba50a045dab04f192 [id=42cf0f9f8ab24a78842f20242d5414c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.391582 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ec0ac6bf0cf445293553691d902033b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.392890 1178 raft_consensus.cc:359] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.385814 1862 rpcz_store.cc:276] 0617 07:53:19.133256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.134988 (+ 1732us) service_pool.cc:224] Handling call
0617 07:53:21.385631 (+2250643us) ts_tablet_manager.cc:1151] Deleting tablet 5fb489c72a7a4e3590b81c768eeb5c43
0617 07:53:21.385638 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.385702 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2250449}
I20260617 07:53:21.394560 1862 tablet_replica.cc:333] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:21.394942 1178 raft_consensus.cc:385] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.396754 1178 raft_consensus.cc:740] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.395401 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4a8b06f77643dcb28f0c3136510253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.312641 1846 rpcz_store.cc:276] 0617 07:53:18.989017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.989843 (+ 826us) service_pool.cc:224] Handling call
0617 07:53:21.312504 (+2322661us) ts_tablet_manager.cc:1151] Deleting tablet 4e8e9692227147d6a8c6854133941b44
0617 07:53:21.312511 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.312565 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322541}
I20260617 07:53:21.397492 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 545) took 2407 ms. Trace:
W20260617 07:53:21.397603 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4e8e9692227147d6a8c6854133941b44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e8e9692227147d6a8c6854133941b44 already in progress: creating tablet
I20260617 07:53:21.397629 1846 rpcz_store.cc:276] 0617 07:53:18.989888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.989997 (+ 109us) service_pool.cc:224] Handling call
0617 07:53:21.397369 (+2407372us) ts_tablet_manager.cc:1151] Deleting tablet bc57a1e3bc8b434da43f484705476b9b
0617 07:53:21.397378 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.397477 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2407241}
I20260617 07:53:21.398039 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 542) took 2408 ms. Trace:
W20260617 07:53:21.398094 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bc57a1e3bc8b434da43f484705476b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc57a1e3bc8b434da43f484705476b9b already in progress: creating tablet
I20260617 07:53:21.398175 1846 rpcz_store.cc:276] 0617 07:53:18.989555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.990151 (+ 596us) service_pool.cc:224] Handling call
0617 07:53:21.397930 (+2407779us) ts_tablet_manager.cc:1151] Deleting tablet c9657e0dd2a8459cb728bdfe8a68b840
0617 07:53:21.397941 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.398027 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2407642}
I20260617 07:53:21.398502 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 544) took 2408 ms. Trace:
W20260617 07:53:21.398598 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c9657e0dd2a8459cb728bdfe8a68b840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9657e0dd2a8459cb728bdfe8a68b840 already in progress: creating tablet
I20260617 07:53:21.398571 1846 rpcz_store.cc:276] 0617 07:53:18.989790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.990415 (+ 625us) service_pool.cc:224] Handling call
0617 07:53:21.398407 (+2407992us) ts_tablet_manager.cc:1151] Deleting tablet 446114516f164dc0a956f2ccbf2e7c35
0617 07:53:21.398416 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.398487 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2407869}
I20260617 07:53:21.398846 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 550) took 2408 ms. Trace:
I20260617 07:53:21.398916 1846 rpcz_store.cc:276] 0617 07:53:18.990407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.990564 (+ 157us) service_pool.cc:224] Handling call
0617 07:53:21.398775 (+2408211us) ts_tablet_manager.cc:1151] Deleting tablet 3e3d05dcda274f288aebc279aba3e10a
0617 07:53:21.398783 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.398833 (+ 50us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2408073}
W20260617 07:53:21.399046 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 446114516f164dc0a956f2ccbf2e7c35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 446114516f164dc0a956f2ccbf2e7c35 already in progress: creating tablet
I20260617 07:53:21.399173 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 547) took 2409 ms. Trace:
I20260617 07:53:21.399236 1846 rpcz_store.cc:276] 0617 07:53:18.990157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.990727 (+ 570us) service_pool.cc:224] Handling call
0617 07:53:21.399093 (+2408366us) ts_tablet_manager.cc:1151] Deleting tablet ed9a99cdcbb74a3fb74654a26716a1c9
0617 07:53:21.399100 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.399161 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2408258}
I20260617 07:53:21.399523 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 553) took 2408 ms. Trace:
I20260617 07:53:21.399597 1846 rpcz_store.cc:276] 0617 07:53:18.990731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.990859 (+ 128us) service_pool.cc:224] Handling call
0617 07:53:21.399444 (+2408585us) ts_tablet_manager.cc:1151] Deleting tablet 51e757e6f4ce4c6eb8223c4b6955245e
0617 07:53:21.399452 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.399512 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2408436}
W20260617 07:53:21.399639 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3e3d05dcda274f288aebc279aba3e10a because the tablet was not found. No further retry: Not found: Tablet not found: 3e3d05dcda274f288aebc279aba3e10a
W20260617 07:53:21.399852 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ed9a99cdcbb74a3fb74654a26716a1c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed9a99cdcbb74a3fb74654a26716a1c9 already in progress: creating tablet
I20260617 07:53:21.398787 1171 tablet_bootstrap.cc:492] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:21.400184 1171 ts_tablet_manager.cc:1403] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
W20260617 07:53:21.400314 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e757e6f4ce4c6eb8223c4b6955245e already in progress: creating tablet
I20260617 07:53:21.400264 1178 consensus_queue.cc:260] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.400933 1171 raft_consensus.cc:359] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.401095 1171 raft_consensus.cc:385] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.401166 1171 raft_consensus.cc:740] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.401401 1171 consensus_queue.cc:260] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.404876 1171 ts_tablet_manager.cc:1434] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:21.405148 1171 tablet_bootstrap.cc:492] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:21.406679 1171 tablet_bootstrap.cc:654] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.407035 886 tablet_service.cc:1511] Processing CreateTablet for tablet a0f7775846454e96a9f433e84e90a229 (DEFAULT_TABLE table=default.Table_ccca21d62d364154831f9ccd2cfd2c1d [id=aabd74d374ad4fb4b28e059ec0e01374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.407407 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f7775846454e96a9f433e84e90a229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.410243 1178 ts_tablet_manager.cc:1434] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.018s user 0.000s sys 0.001s
I20260617 07:53:21.413959 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 6343f3d909ac4438b882283ab2b25a6d
I20260617 07:53:21.414743 743 tablet_service.cc:1558] Processing DeleteTablet for tablet 6343f3d909ac4438b882283ab2b25a6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.395406 1862 raft_consensus.cc:2243] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:21.417995 1862 raft_consensus.cc:2272] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.418418 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_df8e6f336fd640d1aaf3d25d471ae455" } new_table_name: "default.Table_b307d9b7a2d4490c8a53ab98064af6ee" modify_external_catalogs: true
I20260617 07:53:21.420665 755 tablet_service.cc:1511] Processing CreateTablet for tablet 20bf3fee02684ee5b9b2c5a35dba3547 (DEFAULT_TABLE table=default.Table_185b4f9af57a43a39db312f1884ff5c7 [id=8d45d3c78e0349e0a8e6e03250582d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.421099 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bf3fee02684ee5b9b2c5a35dba3547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.421386 743 tablet_service.cc:1558] Processing DeleteTablet for tablet f15dcc10552d4747bad436538662bb66 with delete_type TABLET_DATA_DELETED (replaced by tablet 262732996d6d47749830529ac025f42f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.423027 1862 ts_tablet_manager.cc:1916] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.425657 754 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7f343e041140af85b54fe5cba3a5d0 (DEFAULT_TABLE table=default.Table_f6a150c17a204e7eaffe9853d8a7e9d3 [id=f5ab5d66b2624006afb14a0ba2b58335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.427820 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7f343e041140af85b54fe5cba3a5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.177597 1172 tablet_bootstrap.cc:492] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:21.427958 1170 log.cc:1199] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/eba5976fcadd4add9c671300b431617b
I20260617 07:53:21.428056 1172 ts_tablet_manager.cc:1403] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.331s user 0.001s sys 0.004s
I20260617 07:53:21.428371 1170 ts_tablet_manager.cc:1950] T eba5976fcadd4add9c671300b431617b P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:21.428730 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:21.428777 1172 raft_consensus.cc:359] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.428972 1172 raft_consensus.cc:385] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.429032 1172 raft_consensus.cc:740] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.429128 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 312) took 5436 ms. Trace:
I20260617 07:53:21.429281 1172 consensus_queue.cc:260] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.199914 2525 raft_consensus.cc:493] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.429605 2525 raft_consensus.cc:515] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.430217 2525 leader_election.cc:290] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:21.295225 2628 raft_consensus.cc:493] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.430589 2628 raft_consensus.cc:515] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.430929 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_50c9e41224614d21a12eac5dea96559c [id=121feb8666fe4cb5b796fecf0bf1f8b0]) successfully deleted
I20260617 07:53:21.431056 2628 leader_election.cc:290] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:21.315332 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 421ad54782ac4ea1bef756a0129b3f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.315734 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.318697 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 8ad88b948b384a1d85bd46175deef92e (DEFAULT_TABLE table=default.Table_eef56c9ebee54dfd9afbd23cb41c3997 [id=2a5490317bef4e85b503ea7bc8c7e8f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.432788 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad88b948b384a1d85bd46175deef92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.345732 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 35603d6795ed447aae92edfb3ddbadd6 (DEFAULT_TABLE table=default.Table_90a4260ed99e4d37bf5eb8b28ca1a897 [id=098e2556c4b84075a1cdd91e84264580]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.435256 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35603d6795ed447aae92edfb3ddbadd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.436246 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet cc4d21f9ad9543b0b90fc66f1a6e3b13
I20260617 07:53:21.436718 460 catalog_manager.cc:6784] ReplaceTablet: tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 deleted and replaced by tablet 7c5ec941f083497380896277365be5c9
I20260617 07:53:21.345949 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 175fd4179bf942bea115d528ef8ec5b3 (DEFAULT_TABLE table=default.Table_0e9b1e85ad604663ab3ccec9715a7f58 [id=413ebfa41eaf4bd3a6734234a30fa136]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.438334 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175fd4179bf942bea115d528ef8ec5b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.439402 755 tablet_service.cc:1558] Processing DeleteTablet for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c5ec941f083497380896277365be5c9) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.443246 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_af6270e3aac64c5f83403a481f16f0fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:21.345659 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 2c120eba06a549ef88ffa19998ab0f3d (DEFAULT_TABLE table=default.Table_73897e868adb452cbbcedea7797a6352 [id=03d2a1add32c43898bafa557e4d010fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.443854 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c120eba06a549ef88ffa19998ab0f3d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:21.443924 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af6270e3aac64c5f83403a481f16f0fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.360085 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464cf1effff241608f4a7255f2646b04" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:21.394780 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4a8b06f77643dcb28f0c3136510253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.420838 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 6343f3d909ac4438b882283ab2b25a6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.421689 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 523910abbabe476cbcf79484f53849db (DEFAULT_TABLE table=default.Table_cbdb621b1fb848b4a04b402345b7d37b [id=ff3033d580bb46298d77291006b064fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.446415 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 523910abbabe476cbcf79484f53849db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.422302 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7f343e041140af85b54fe5cba3a5d0 (DEFAULT_TABLE table=default.Table_f6a150c17a204e7eaffe9853d8a7e9d3 [id=f5ab5d66b2624006afb14a0ba2b58335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.449222 755 tablet_service.cc:1511] Processing CreateTablet for tablet a7aebe17e159446ba9ca7de20f83462d (DEFAULT_TABLE table=default.Table_98d79d950a7b4d938f69e1e678fa2846 [id=a8cc2ad1e83a4dd1b13b73cc84e57b35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.449491 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7f343e041140af85b54fe5cba3a5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.449671 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aebe17e159446ba9ca7de20f83462d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.453423 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c5ec941f083497380896277365be5c9) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.454241 768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02dbb70eec84932917ef282fdae0bd7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:21.454921 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5364dfe28b8d4042941c8d8d4d1cf503" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:21.457686 986 leader_election.cc:343] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:21.457885 986 leader_election.cc:343] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.458510 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 55ecfaaa2efc488aa0b58c7aa2d6b798 (DEFAULT_TABLE table=default.Table_64516816d3d34c23aa3c17ce405a6ad9 [id=30a61df51b714c428f6ffa897c5e1859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.458832 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ecfaaa2efc488aa0b58c7aa2d6b798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.460086 713 leader_election.cc:304] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.460428 2644 raft_consensus.cc:493] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.460520 2644 raft_consensus.cc:515] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.461020 2644 leader_election.cc:290] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:21.461150 2644 raft_consensus.cc:2749] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:21.462116 716 leader_election.cc:343] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: ee0e12aa4c60457182201a94caecda45
I20260617 07:53:21.463088 1029 tablet_service.cc:1511] Processing CreateTablet for tablet a7aebe17e159446ba9ca7de20f83462d (DEFAULT_TABLE table=default.Table_98d79d950a7b4d938f69e1e678fa2846 [id=a8cc2ad1e83a4dd1b13b73cc84e57b35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.463480 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aebe17e159446ba9ca7de20f83462d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.466578 763 raft_consensus.cc:3060] T 464cf1effff241608f4a7255f2646b04 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.471086 454 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:21.472993 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_68ed1ed6fe664a738ed9a11be098557e" } new_table_name: "default.Table_11e8915c1fc444049ee51be7f91d14db" modify_external_catalogs: true
W20260617 07:53:21.473253 713 leader_election.cc:343] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: ee0e12aa4c60457182201a94caecda45
I20260617 07:53:21.473357 713 leader_election.cc:304] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.476128 743 tablet_service.cc:1511] Processing CreateTablet for tablet 55ecfaaa2efc488aa0b58c7aa2d6b798 (DEFAULT_TABLE table=default.Table_64516816d3d34c23aa3c17ce405a6ad9 [id=30a61df51b714c428f6ffa897c5e1859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.476981 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ecfaaa2efc488aa0b58c7aa2d6b798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.479094 2644 raft_consensus.cc:2749] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.480296 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_de82b245aadc4b368d45f9fc52330c76" } new_table_name: "default.Table_50456ce872334470a5d513d6d074b0eb" modify_external_catalogs: true
W20260617 07:53:21.482506 852 leader_election.cc:343] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:21.482803 852 leader_election.cc:343] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:21.483079 852 consensus_peers.cc:597] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:21.483707 965 heartbeater.cc:461] Registering TS with master...
I20260617 07:53:21.484114 2628 raft_consensus.cc:493] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.496529 751 tablet_service.cc:1511] Processing CreateTablet for tablet f9780f9700e842e9b09fa223cf5d6a68 (DEFAULT_TABLE table=default.Table_51413fc9aaa6421da86dd52735a48765 [id=f9e5009d9fc146a7b62f80088c9bdef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.496958 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9780f9700e842e9b09fa223cf5d6a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.496999 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 8c848e07e67e4091a9ee51e35ecceebc (DEFAULT_TABLE table=default.Table_56effd53fa854253987f08623eb95332 [id=e1282bcc6f2946f3b49c227ea424c1c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.497972 756 tablet_service.cc:1511] Processing CreateTablet for tablet 7fad8fb5fbb24baeb5f67cfabfb9ba92 (DEFAULT_TABLE table=default.Table_c2fdf0867f834e1486a73ec4d9afcffe [id=977443be576743099736b8fabbc8a72c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.498311 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fad8fb5fbb24baeb5f67cfabfb9ba92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.498338 2525 raft_consensus.cc:493] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.499018 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4c2c33710d4a4141833994f4cbef2ce4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.499737 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c2c33710d4a4141833994f4cbef2ce4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.501852 2644 raft_consensus.cc:493] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.501968 2644 raft_consensus.cc:515] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.502574 2644 leader_election.cc:290] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:21.503047 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a632b42300d64471b516008ebca3312f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:21.507344 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet f249a9d29de54c959dbae1751501daee
I20260617 07:53:21.512609 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3b0a6c4136014884b620452ccd92d8b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.513192 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b0a6c4136014884b620452ccd92d8b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.513943 751 tablet_service.cc:1558] Processing DeleteTablet for tablet f249a9d29de54c959dbae1751501daee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.525502 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet f249a9d29de54c959dbae1751501daee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.527156 2607 raft_consensus.cc:493] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.527292 2607 raft_consensus.cc:515] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.527854 2607 leader_election.cc:290] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:21.529188 851 leader_election.cc:343] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 18f9bace06e34602acc7fcd7501b3671
I20260617 07:53:21.532439 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_691581b4ba6547cf8ddbbdd0688f17c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.533022 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_691581b4ba6547cf8ddbbdd0688f17c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:21.534085 988 leader_election.cc:343] T d657fbccb4af40558033a971aab7f3e4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: d657fbccb4af40558033a971aab7f3e4
I20260617 07:53:21.534608 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 4de8df5e15cb43c0b95ec5af3110db66 (table default.Table_da5430a09e3e44e48bafd3678bf638a2 [id=27e37deb26df4bb28507736f1decf709]) successfully deleted
W20260617 07:53:21.534858 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 already in progress: creating tablet
I20260617 07:53:21.426187 1178 tablet_bootstrap.cc:492] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:21.539052 1171 tablet_bootstrap.cc:492] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:21.539619 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 551) took 2549 ms. Trace:
I20260617 07:53:21.539914 1171 ts_tablet_manager.cc:1403] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.135s user 0.011s sys 0.023s
I20260617 07:53:21.540148 1846 rpcz_store.cc:276] 0617 07:53:18.990510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.990954 (+ 444us) service_pool.cc:224] Handling call
0617 07:53:21.399771 (+2408817us) ts_tablet_manager.cc:1151] Deleting tablet 369442b72f754ee08dc6a484d51f2e99
0617 07:53:21.399778 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.539598 (+139820us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2408680}
W20260617 07:53:21.542127 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 369442b72f754ee08dc6a484d51f2e99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 369442b72f754ee08dc6a484d51f2e99 already in progress: creating tablet
I20260617 07:53:21.542436 1178 tablet_bootstrap.cc:654] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.542822 2628 raft_consensus.cc:515] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.543159 1171 raft_consensus.cc:359] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.543802 2628 leader_election.cc:290] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:21.544265 2525 raft_consensus.cc:515] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:21.544661 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b479c2984934852a864699b66416538 consensus state has no leader
I20260617 07:53:21.544798 2525 leader_election.cc:290] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:21.545121 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 7fad8fb5fbb24baeb5f67cfabfb9ba92 (DEFAULT_TABLE table=default.Table_c2fdf0867f834e1486a73ec4d9afcffe [id=977443be576743099736b8fabbc8a72c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.545439 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 67bfbd00d911462584baa3e20e71b0d4 (DEFAULT_TABLE table=default.Table_42883661210443e59d1c013720d7d360 [id=73e3082a22914a62b530bc80462f17d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.545817 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c848e07e67e4091a9ee51e35ecceebc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:21.548214 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5fb489c72a7a4e3590b81c768eeb5c43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fb489c72a7a4e3590b81c768eeb5c43 already in progress: creating tablet
I20260617 07:53:21.548059 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf4025a0f784cc6868950e51a45da2e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:21.548834 1015 tablet_service.cc:1511] Processing CreateTablet for tablet f9780f9700e842e9b09fa223cf5d6a68 (DEFAULT_TABLE table=default.Table_51413fc9aaa6421da86dd52735a48765 [id=f9e5009d9fc146a7b62f80088c9bdef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.549217 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67bfbd00d911462584baa3e20e71b0d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.549679 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fad8fb5fbb24baeb5f67cfabfb9ba92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.550570 1171 raft_consensus.cc:385] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.550647 1171 raft_consensus.cc:740] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.551314 1172 ts_tablet_manager.cc:1434] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.058s user 0.000s sys 0.001s
I20260617 07:53:21.551723 1172 tablet_bootstrap.cc:492] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:21.552295 755 tablet_service.cc:1511] Processing CreateTablet for tablet 8c848e07e67e4091a9ee51e35ecceebc (DEFAULT_TABLE table=default.Table_56effd53fa854253987f08623eb95332 [id=e1282bcc6f2946f3b49c227ea424c1c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.552983 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f47806c047a34b93a384080784ec392d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:21.553182 1171 consensus_queue.cc:260] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.553825 1172 tablet_bootstrap.cc:654] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.553941 2525 raft_consensus.cc:493] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:21.553536 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f47806c047a34b93a384080784ec392d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.554059 2525 raft_consensus.cc:515] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.554718 2525 leader_election.cc:290] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:21.555217 986 leader_election.cc:343] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.555693 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9780f9700e842e9b09fa223cf5d6a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.557816 2607 raft_consensus.cc:493] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.557933 2607 raft_consensus.cc:515] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.558507 2607 leader_election.cc:290] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:21.559072 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02dbb70eec84932917ef282fdae0bd7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:21.559599 886 tablet_service.cc:1511] Processing CreateTablet for tablet 2c120eba06a549ef88ffa19998ab0f3d (DEFAULT_TABLE table=default.Table_73897e868adb452cbbcedea7797a6352 [id=03d2a1add32c43898bafa557e4d010fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.559789 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5364dfe28b8d4042941c8d8d4d1cf503" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:21.559965 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c120eba06a549ef88ffa19998ab0f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.561228 1862 ts_tablet_manager.cc:1929] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:21.561323 1862 log.cc:1199] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/cbc79cfa11e342bd87da1aa03847c3cb
I20260617 07:53:21.565307 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_7c71fb4276494d539fb7ccb468f0e300" } new_table_name: "default.Table_acb19b0a19f54fe9a4be9d22be8f44b7" modify_external_catalogs: true
I20260617 07:53:21.555670 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8602b87a20455884c16196a901d335" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:21.556766 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361845f7627b4b9f8481b4a66bc53e9c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:21.570787 754 tablet_service.cc:1511] Processing CreateTablet for tablet 67bfbd00d911462584baa3e20e71b0d4 (DEFAULT_TABLE table=default.Table_42883661210443e59d1c013720d7d360 [id=73e3082a22914a62b530bc80462f17d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.561666 1862 ts_tablet_manager.cc:1950] T cbc79cfa11e342bd87da1aa03847c3cb P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:21.573014 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 450) took 2374 ms. Trace:
I20260617 07:53:21.573100 1862 rpcz_store.cc:276] 0617 07:53:19.198671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.198725 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:21.394510 (+2195785us) ts_tablet_manager.cc:1151] Deleting tablet cbc79cfa11e342bd87da1aa03847c3cb
0617 07:53:21.394523 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.551783 (+157260us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.561174 (+ 9391us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.572991 (+ 11817us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195594}
I20260617 07:53:21.573406 1862 tablet_replica.cc:333] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:21.573563 1862 raft_consensus.cc:2243] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:21.573894 1862 raft_consensus.cc:2272] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.576896 1862 ts_tablet_manager.cc:1916] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.580137 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 83878d63683d49a6836ed0f925397e61
I20260617 07:53:21.580746 459 master_service.cc:960] ReplaceTablet: received request to replace tablet e897b111e65c497591c7daaa81d783c7 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:21.581248 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_828befbda7ff41f3adf71e43e7adf2e3" } modify_external_catalogs: true
I20260617 07:53:21.581449 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_828befbda7ff41f3adf71e43e7adf2e3" } modify_external_catalogs: true
W20260617 07:53:21.581910 986 leader_election.cc:343] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:21.582100 986 leader_election.cc:343] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.586078 887 tablet_service.cc:1511] Processing CreateTablet for tablet 175fd4179bf942bea115d528ef8ec5b3 (DEFAULT_TABLE table=default.Table_0e9b1e85ad604663ab3ccec9715a7f58 [id=413ebfa41eaf4bd3a6734234a30fa136]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.586541 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175fd4179bf942bea115d528ef8ec5b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:21.590911 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f30f0bbfdf404569a417662861b06f73 consensus state has no leader
I20260617 07:53:21.591274 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9f1c5148c98f470a88b93558ee1c10bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.591830 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f1c5148c98f470a88b93558ee1c10bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.592971 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4a8b06f77643dcb28f0c3136510253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.593245 460 master_service.cc:960] ReplaceTablet: received request to replace tablet a6f90a0d37cb483faa540451bf4dbe85 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:21.593338 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 6343f3d909ac4438b882283ab2b25a6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.593865 885 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7f343e041140af85b54fe5cba3a5d0 (DEFAULT_TABLE table=default.Table_f6a150c17a204e7eaffe9853d8a7e9d3 [id=f5ab5d66b2624006afb14a0ba2b58335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.594273 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7f343e041140af85b54fe5cba3a5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.597994 892 tablet_service.cc:1558] Processing DeleteTablet for tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c5ec941f083497380896277365be5c9) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.598610 892 tablet_service.cc:1511] Processing CreateTablet for tablet 20bf3fee02684ee5b9b2c5a35dba3547 (DEFAULT_TABLE table=default.Table_185b4f9af57a43a39db312f1884ff5c7 [id=8d45d3c78e0349e0a8e6e03250582d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.598977 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bf3fee02684ee5b9b2c5a35dba3547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.602327 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c94947b1e4614158b9ab608219830eec" } modify_external_catalogs: true
I20260617 07:53:21.605593 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 83878d63683d49a6836ed0f925397e61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.606839 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c94947b1e4614158b9ab608219830eec" } modify_external_catalogs: true
I20260617 07:53:21.609954 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a632b42300d64471b516008ebca3312f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:21.610360 988 leader_election.cc:304] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
W20260617 07:53:21.610772 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 72825.1us
I20260617 07:53:21.612387 2525 raft_consensus.cc:2804] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
W20260617 07:53:21.612392 851 leader_election.cc:343] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: eba5976fcadd4add9c671300b431617b
I20260617 07:53:21.612526 2525 raft_consensus.cc:697] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:21.612802 2525 consensus_queue.cc:237] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.613584 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 83878d63683d49a6836ed0f925397e61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.614498 892 tablet_service.cc:1511] Processing CreateTablet for tablet 55ecfaaa2efc488aa0b58c7aa2d6b798 (DEFAULT_TABLE table=default.Table_64516816d3d34c23aa3c17ce405a6ad9 [id=30a61df51b714c428f6ffa897c5e1859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.614975 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ecfaaa2efc488aa0b58c7aa2d6b798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.616568 713 leader_election.cc:304] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.617012 2644 raft_consensus.cc:2749] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.617261 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 20bf3fee02684ee5b9b2c5a35dba3547 (DEFAULT_TABLE table=default.Table_185b4f9af57a43a39db312f1884ff5c7 [id=8d45d3c78e0349e0a8e6e03250582d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.618250 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bf3fee02684ee5b9b2c5a35dba3547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.621227 1862 ts_tablet_manager.cc:1929] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:21.621582 885 tablet_service.cc:1511] Processing CreateTablet for tablet a7aebe17e159446ba9ca7de20f83462d (DEFAULT_TABLE table=default.Table_98d79d950a7b4d938f69e1e678fa2846 [id=a8cc2ad1e83a4dd1b13b73cc84e57b35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.621809 1862 log.cc:1199] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/9d94915d96694d6f9a86063640e5fe18
I20260617 07:53:21.624315 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ac5369fc08d64d709036b33d6d55d2c2" } modify_external_catalogs: true
I20260617 07:53:21.624523 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ac5369fc08d64d709036b33d6d55d2c2" } modify_external_catalogs: true
I20260617 07:53:21.629860 884 tablet_service.cc:1511] Processing CreateTablet for tablet 7fad8fb5fbb24baeb5f67cfabfb9ba92 (DEFAULT_TABLE table=default.Table_c2fdf0867f834e1486a73ec4d9afcffe [id=977443be576743099736b8fabbc8a72c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.630191 1862 ts_tablet_manager.cc:1950] T 9d94915d96694d6f9a86063640e5fe18 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:21.630533 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 454) took 2363 ms. Trace:
I20260617 07:53:21.630611 891 tablet_service.cc:1558] Processing DeleteTablet for tablet f249a9d29de54c959dbae1751501daee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.631177 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 83878d63683d49a6836ed0f925397e61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.632881 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 531ccdf479814053b468a7d5802f5dde) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:21.634222 988 leader_election.cc:343] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.634400 988 leader_election.cc:304] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:21.634850 988 leader_election.cc:343] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.634955 988 leader_election.cc:304] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:21.635308 2629 raft_consensus.cc:2749] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.635505 2629 raft_consensus.cc:2749] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.635152 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]) successfully deleted
I20260617 07:53:21.622061 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aebe17e159446ba9ca7de20f83462d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.636078 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fad8fb5fbb24baeb5f67cfabfb9ba92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.636086 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 548) took 2645 ms. Trace:
I20260617 07:53:21.636181 1846 rpcz_store.cc:276] 0617 07:53:18.990251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.990865 (+ 614us) service_pool.cc:224] Handling call
0617 07:53:21.541964 (+2551099us) ts_tablet_manager.cc:1151] Deleting tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3
0617 07:53:21.635910 (+ 93946us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.636054 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2550829}
I20260617 07:53:21.636613 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 554) took 2645 ms. Trace:
I20260617 07:53:21.636695 1846 rpcz_store.cc:276] 0617 07:53:18.990820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.991130 (+ 310us) service_pool.cc:224] Handling call
0617 07:53:21.636502 (+2645372us) ts_tablet_manager.cc:1151] Deleting tablet e03a26e301e747febc4d5bafdc1a49c6
0617 07:53:21.636514 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.636597 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2645251}
I20260617 07:53:21.636956 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 536) took 2648 ms. Trace:
I20260617 07:53:21.637008 1846 rpcz_store.cc:276] 0617 07:53:18.988925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.991156 (+ 2231us) service_pool.cc:224] Handling call
0617 07:53:21.636882 (+2645726us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:21.636889 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.636947 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2645601}
I20260617 07:53:21.637226 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 557) took 2646 ms. Trace:
I20260617 07:53:21.637274 1846 rpcz_store.cc:276] 0617 07:53:18.991156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.991306 (+ 150us) service_pool.cc:224] Handling call
0617 07:53:21.637172 (+2645866us) ts_tablet_manager.cc:1151] Deleting tablet be14a95f458d440e86133ef65c484571
0617 07:53:21.637179 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.637216 (+ 37us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2645759}
I20260617 07:53:21.637486 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 546) took 2647 ms. Trace:
I20260617 07:53:21.637540 1846 rpcz_store.cc:276] 0617 07:53:18.990038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.991440 (+ 1402us) service_pool.cc:224] Handling call
0617 07:53:21.637418 (+2645978us) ts_tablet_manager.cc:1151] Deleting tablet 8c76bfcbd22e4bfb97346a1b56f68dab
0617 07:53:21.637424 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.637477 (+ 53us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2645857}
I20260617 07:53:21.637806 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 559) took 2646 ms. Trace:
I20260617 07:53:21.637866 1846 rpcz_store.cc:276] 0617 07:53:18.991399 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.991445 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:21.637698 (+2646253us) ts_tablet_manager.cc:1151] Deleting tablet e897b111e65c497591c7daaa81d783c7
0617 07:53:21.637704 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.637793 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2646042}
I20260617 07:53:21.638115 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 539) took 2648 ms. Trace:
I20260617 07:53:21.638170 1846 rpcz_store.cc:276] 0617 07:53:18.989224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.991685 (+ 2461us) service_pool.cc:224] Handling call
0617 07:53:21.638039 (+2646354us) ts_tablet_manager.cc:1151] Deleting tablet 2f8cd6ff8fa44536acdd84a107ab1525
0617 07:53:21.638046 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.638104 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2646216}
I20260617 07:53:21.638351 1846 tablet_replica.cc:333] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:21.638443 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 already in progress: creating tablet
I20260617 07:53:21.638509 1846 raft_consensus.cc:2243] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.638646 1846 raft_consensus.cc:2272] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:21.638819 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e03a26e301e747febc4d5bafdc1a49c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03a26e301e747febc4d5bafdc1a49c6 already in progress: creating tablet
I20260617 07:53:21.639135 1846 ts_tablet_manager.cc:1916] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:21.639171 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7f7611958cf143438497c93f5f2bc098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7611958cf143438497c93f5f2bc098 already in progress: creating tablet
W20260617 07:53:21.639489 446 catalog_manager.cc:4994] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet be14a95f458d440e86133ef65c484571 because the tablet was not found. No further retry: Not found: Tablet not found: be14a95f458d440e86133ef65c484571
W20260617 07:53:21.639814 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8c76bfcbd22e4bfb97346a1b56f68dab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c76bfcbd22e4bfb97346a1b56f68dab already in progress: creating tablet
W20260617 07:53:21.640101 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e897b111e65c497591c7daaa81d783c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e897b111e65c497591c7daaa81d783c7 already in progress: creating tablet
I20260617 07:53:21.640524 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f9bace06e34602acc7fcd7501b3671" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:21.642642 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba5976fcadd4add9c671300b431617b" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:21.643786 766 raft_consensus.cc:3060] T a632b42300d64471b516008ebca3312f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.624958 1171 ts_tablet_manager.cc:1434] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.084s user 0.001s sys 0.001s
I20260617 07:53:21.625560 879 tablet_service.cc:1511] Processing CreateTablet for tablet 67bfbd00d911462584baa3e20e71b0d4 (DEFAULT_TABLE table=default.Table_42883661210443e59d1c013720d7d360 [id=73e3082a22914a62b530bc80462f17d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.646056 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67bfbd00d911462584baa3e20e71b0d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:21.647392 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
I20260617 07:53:21.626086 881 tablet_service.cc:1511] Processing CreateTablet for tablet 8c848e07e67e4091a9ee51e35ecceebc (DEFAULT_TABLE table=default.Table_56effd53fa854253987f08623eb95332 [id=e1282bcc6f2946f3b49c227ea424c1c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.650174 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c848e07e67e4091a9ee51e35ecceebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.629365 883 tablet_service.cc:1511] Processing CreateTablet for tablet f9780f9700e842e9b09fa223cf5d6a68 (DEFAULT_TABLE table=default.Table_51413fc9aaa6421da86dd52735a48765 [id=f9e5009d9fc146a7b62f80088c9bdef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.654068 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9780f9700e842e9b09fa223cf5d6a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.662448 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67bfbd00d911462584baa3e20e71b0d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.663219 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c848e07e67e4091a9ee51e35ecceebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.663439 2185 ts_manager.cc:194] Registered new tserver with Master: 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:21.666265 2644 raft_consensus.cc:493] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.666395 2644 raft_consensus.cc:515] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.666579 1171 tablet_bootstrap.cc:492] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:21.666967 2644 leader_election.cc:290] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:21.667933 716 leader_election.cc:343] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 63bf519b83c445798bddda3120b542ce
I20260617 07:53:21.630625 1862 rpcz_store.cc:276] 0617 07:53:19.267106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.267161 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:21.573366 (+2306205us) ts_tablet_manager.cc:1151] Deleting tablet 9d94915d96694d6f9a86063640e5fe18
0617 07:53:21.573374 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.582634 (+ 9260us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.621176 (+ 38542us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.630513 (+ 9337us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2306025}
I20260617 07:53:21.669644 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c2b4123400f94ed9b7d9c4de82728499"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:21.670097 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 455) took 2402 ms. Trace:
I20260617 07:53:21.670168 1862 rpcz_store.cc:276] 0617 07:53:19.267528 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.267571 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:21.669956 (+2402385us) ts_tablet_manager.cc:1151] Deleting tablet e9f8492f127243eca07b2ffbabddded5
0617 07:53:21.669965 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.670081 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2402249}
W20260617 07:53:21.670295 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2b4123400f94ed9b7d9c4de82728499 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.670508 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 457) took 2333 ms. Trace:
I20260617 07:53:21.670576 1862 rpcz_store.cc:276] 0617 07:53:19.337482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.337528 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:21.670382 (+2332854us) ts_tablet_manager.cc:1151] Deleting tablet 6cdcd3904a754939b9ae09cc3672bbc6
0617 07:53:21.670389 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.670489 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2332659}
I20260617 07:53:21.670832 1862 tablet_replica.cc:333] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:21.670998 1862 raft_consensus.cc:2243] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:21.671306 1862 raft_consensus.cc:2272] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.671835 1862 ts_tablet_manager.cc:1916] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:21.672569 713 leader_election.cc:343] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 63bf519b83c445798bddda3120b542ce
I20260617 07:53:21.672716 713 leader_election.cc:304] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.672973 2644 raft_consensus.cc:2749] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.673566 1846 ts_tablet_manager.cc:1929] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:21.673692 1846 log.cc:1199] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/ee0e12aa4c60457182201a94caecda45
I20260617 07:53:21.674052 1846 ts_tablet_manager.cc:1950] T ee0e12aa4c60457182201a94caecda45 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:21.675171 1171 tablet_bootstrap.cc:654] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.678015 2659 tablet.cc:1724] T 39b291b1c9794faa9305f7d936604a44 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:21.682221 887 tablet_service.cc:1511] Processing CreateTablet for tablet 523910abbabe476cbcf79484f53849db (DEFAULT_TABLE table=default.Table_cbdb621b1fb848b4a04b402345b7d37b [id=ff3033d580bb46298d77291006b064fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:21.682605 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 523910abbabe476cbcf79484f53849db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:21.683979 1172 tablet_bootstrap.cc:492] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:21.684202 1172 ts_tablet_manager.cc:1403] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.133s user 0.006s sys 0.000s
I20260617 07:53:21.685015 1172 raft_consensus.cc:359] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.685302 1172 raft_consensus.cc:385] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.429234 1170 rpcz_store.cc:276] 0617 07:53:15.993035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:15.993088 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:21.127278 (+5134190us) ts_tablet_manager.cc:1151] Deleting tablet eba5976fcadd4add9c671300b431617b
0617 07:53:21.127286 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.192723 (+ 65437us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.195391 (+ 2668us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.429108 (+233717us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5134020}
I20260617 07:53:21.685834 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet eba5976fcadd4add9c671300b431617b (table default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb [id=ee23302b46474cb096ae93bc49011eeb]) successfully deleted
I20260617 07:53:21.685904 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 316) took 5631 ms. Trace:
I20260617 07:53:21.685998 1170 rpcz_store.cc:276] 0617 07:53:16.054237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.054291 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:21.685810 (+5631519us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:21.685819 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.685889 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5631292}
W20260617 07:53:21.686486 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd because the tablet was not found. No further retry: Not found: Tablet not found: 6f2d9e473fd444efa6ab63cc51dbb2bd
I20260617 07:53:21.687058 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 318) took 5632 ms. Trace:
I20260617 07:53:21.687181 1170 rpcz_store.cc:276] 0617 07:53:16.054465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.054515 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:21.686946 (+5632431us) ts_tablet_manager.cc:1151] Deleting tablet e55d63a25a2845dbbcce20e560361007
0617 07:53:21.686954 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.687029 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5632223}
W20260617 07:53:21.687623 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e55d63a25a2845dbbcce20e560361007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55d63a25a2845dbbcce20e560361007 already in progress: creating tablet
I20260617 07:53:21.688197 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 319) took 5633 ms. Trace:
I20260617 07:53:21.688330 1170 rpcz_store.cc:276] 0617 07:53:16.054584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.054662 (+ 78us) service_pool.cc:224] Handling call
0617 07:53:21.687881 (+5633219us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:21.687889 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.687934 (+ 45us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5633104}
W20260617 07:53:21.688777 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7f7611958cf143438497c93f5f2bc098 because the tablet was not found. No further retry: Not found: Tablet not found: 7f7611958cf143438497c93f5f2bc098
I20260617 07:53:21.689083 1170 tablet_replica.cc:333] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:21.689327 1170 raft_consensus.cc:2243] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.689541 1170 raft_consensus.cc:2272] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.693003 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 562) took 2701 ms. Trace:
I20260617 07:53:21.693158 1846 rpcz_store.cc:276] 0617 07:53:18.991750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.991846 (+ 96us) service_pool.cc:224] Handling call
0617 07:53:21.638318 (+2646472us) ts_tablet_manager.cc:1151] Deleting tablet ee0e12aa4c60457182201a94caecda45
0617 07:53:21.638325 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.642662 (+ 4337us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.673510 (+ 30848us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.692974 (+ 19464us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2646365}
I20260617 07:53:21.693701 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet ee0e12aa4c60457182201a94caecda45 (table default.Table_e29065138d484e19b64a88c7bbc05d79 [id=398622ff90f141a49522bcc42f67c1e8]) successfully deleted
W20260617 07:53:21.696164 852 leader_election.cc:343] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.696367 852 leader_election.cc:304] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.696472 2607 raft_consensus.cc:493] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.696645 2086 raft_consensus.cc:2749] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.696699 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 556) took 2705 ms. Trace:
I20260617 07:53:21.696579 2607 raft_consensus.cc:515] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.696244 2664 tablet.cc:1724] T 39b291b1c9794faa9305f7d936604a44 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:21.696858 1846 rpcz_store.cc:276] 0617 07:53:18.991040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.991985 (+ 945us) service_pool.cc:224] Handling call
0617 07:53:21.696550 (+2704565us) ts_tablet_manager.cc:1151] Deleting tablet 5f8602b87a20455884c16196a901d335
0617 07:53:21.696561 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.696680 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2704418}
I20260617 07:53:21.697242 2607 leader_election.cc:290] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:21.697377 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5f8602b87a20455884c16196a901d335 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f8602b87a20455884c16196a901d335 already in progress: creating tablet
I20260617 07:53:21.697899 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf5384ec244d36ba3d4e781c5eb8a3" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:21.698694 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2d90416672b341028309278d5b5a367c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.698874 851 leader_election.cc:343] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.699081 2653 tablet.cc:1724] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260617 07:53:21.699303 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d90416672b341028309278d5b5a367c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.703467 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.685413 1172 raft_consensus.cc:740] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.706075 2665 tablet.cc:1724] T 24066965db7141a6a970ec08f835a820 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260617 07:53:21.709177 852 leader_election.cc:343] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.709352 852 leader_election.cc:304] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.711233 2607 raft_consensus.cc:2749] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.713672 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_92c8821eb1ef48fcb303b919f55c6b58" } modify_external_catalogs: true
I20260617 07:53:21.713932 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_92c8821eb1ef48fcb303b919f55c6b58" } modify_external_catalogs: true
W20260617 07:53:21.718727 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 146829us
I20260617 07:53:21.720949 2628 raft_consensus.cc:493] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.721124 2628 raft_consensus.cc:515] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.721910 2628 leader_election.cc:290] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:21.728223 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037539021d1743bb9a66403b8a01662f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:21.728863 986 leader_election.cc:343] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:21.729681 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7d4fc81456445518c1158f912dd2f8f consensus state has no leader
I20260617 07:53:21.736385 1178 tablet_bootstrap.cc:492] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:21.736620 1178 ts_tablet_manager.cc:1403] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.310s user 0.022s sys 0.010s
I20260617 07:53:21.737303 1178 raft_consensus.cc:359] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.737521 1178 raft_consensus.cc:385] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.737603 1178 raft_consensus.cc:740] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.737826 2607 raft_consensus.cc:493] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.738302 1178 consensus_queue.cc:260] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.738951 1178 ts_tablet_manager.cc:1434] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:21.738715 453 catalog_manager.cc:5696] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:21.739231 1178 tablet_bootstrap.cc:492] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:21.739722 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 564) took 2747 ms. Trace:
I20260617 07:53:21.739809 1846 rpcz_store.cc:276] 0617 07:53:18.991931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.991984 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:21.739593 (+2747609us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:21.739601 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.739706 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2747341}
I20260617 07:53:21.740167 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 549) took 2749 ms. Trace:
I20260617 07:53:21.740238 1846 rpcz_store.cc:276] 0617 07:53:18.990339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.992285 (+ 1946us) service_pool.cc:224] Handling call
0617 07:53:21.740068 (+2747783us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:21.740076 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.740153 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2747645}
I20260617 07:53:21.740501 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 560) took 2749 ms. Trace:
I20260617 07:53:21.740597 1846 rpcz_store.cc:276] 0617 07:53:18.991504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.992447 (+ 943us) service_pool.cc:224] Handling call
0617 07:53:21.740418 (+2747971us) ts_tablet_manager.cc:1151] Deleting tablet c58bbdbf59c7426c8adbbbe3f0aafaed
0617 07:53:21.740426 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.740487 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2747862}
I20260617 07:53:21.740599 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0cc937610f884774b7b7c3d5c1739d85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.740903 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65bf5384ec244d36ba3d4e781c5eb8a3 already in progress: creating tablet
I20260617 07:53:21.741034 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 569) took 2748 ms. Trace:
I20260617 07:53:21.741113 1846 rpcz_store.cc:276] 0617 07:53:18.992552 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.992587 (+ 35us) service_pool.cc:224] Handling call
0617 07:53:21.740935 (+2748348us) ts_tablet_manager.cc:1151] Deleting tablet 488cc3a082b14dee8f70153e6f2925a4
0617 07:53:21.740944 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.741020 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2748217}
W20260617 07:53:21.741189 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet bbc3d13d519843a9bc38e97dc85b67c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbc3d13d519843a9bc38e97dc85b67c8 already in progress: creating tablet
W20260617 07:53:21.741415 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c58bbdbf59c7426c8adbbbe3f0aafaed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c58bbdbf59c7426c8adbbbe3f0aafaed already in progress: creating tablet
I20260617 07:53:21.741482 1846 tablet_replica.cc:333] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:21.741632 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 488cc3a082b14dee8f70153e6f2925a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 488cc3a082b14dee8f70153e6f2925a4 already in progress: creating tablet
I20260617 07:53:21.742106 1178 tablet_bootstrap.cc:654] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:21.742586 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cc937610f884774b7b7c3d5c1739d85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.746217 1170 ts_tablet_manager.cc:1916] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.705668 1172 consensus_queue.cc:260] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.751055 1172 ts_tablet_manager.cc:1434] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.067s user 0.002s sys 0.000s
I20260617 07:53:21.751406 1172 tablet_bootstrap.cc:492] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:21.753026 1171 tablet_bootstrap.cc:492] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:21.753006 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d8b83fda0ce74779b4cca2ffd2a9b903
I20260617 07:53:21.753176 1171 ts_tablet_manager.cc:1403] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.087s user 0.002s sys 0.002s
I20260617 07:53:21.753969 1171 raft_consensus.cc:359] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.754145 1171 raft_consensus.cc:385] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.754196 1171 raft_consensus.cc:740] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.754369 1171 consensus_queue.cc:260] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.754866 1171 ts_tablet_manager.cc:1434] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:21.755148 1862 ts_tablet_manager.cc:1929] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:21.755240 1862 log.cc:1199] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/63de833f7aa740b0b5bf2494b78aca5c
W20260617 07:53:21.755355 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 43690.4us
I20260617 07:53:21.755625 1862 ts_tablet_manager.cc:1950] T 63de833f7aa740b0b5bf2494b78aca5c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:21.755882 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf4025a0f784cc6868950e51a45da2e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:21.756031 915 raft_consensus.cc:2468] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:21.756134 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361845f7627b4b9f8481b4a66bc53e9c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:21.756269 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8602b87a20455884c16196a901d335" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:21.756310 914 raft_consensus.cc:2468] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:21.737950 2607 raft_consensus.cc:515] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.758282 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]) successfully deleted
W20260617 07:53:21.758530 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e9f8492f127243eca07b2ffbabddded5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9f8492f127243eca07b2ffbabddded5 already in progress: creating tablet
W20260617 07:53:21.758814 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6cdcd3904a754939b9ae09cc3672bbc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cdcd3904a754939b9ae09cc3672bbc6 already in progress: creating tablet
I20260617 07:53:21.758981 1846 raft_consensus.cc:2243] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.759138 1846 raft_consensus.cc:2272] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.759611 1846 ts_tablet_manager.cc:1916] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.759536 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037539021d1743bb9a66403b8a01662f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:21.761595 913 raft_consensus.cc:2468] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:21.762928 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bf5384ec244d36ba3d4e781c5eb8a3" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:21.765914 755 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b83fda0ce74779b4cca2ffd2a9b903 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.768121 885 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b83fda0ce74779b4cca2ffd2a9b903 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:21.768833 852 leader_election.cc:343] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.768947 852 leader_election.cc:304] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.769375 2086 raft_consensus.cc:2749] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.770699 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b83fda0ce74779b4cca2ffd2a9b903 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.771201 988 leader_election.cc:304] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:21.771502 2525 raft_consensus.cc:2804] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:21.771588 2525 raft_consensus.cc:493] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:21.771696 2525 raft_consensus.cc:3060] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.771673 988 leader_election.cc:304] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:21.771888 2628 raft_consensus.cc:2804] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:21.771987 2628 raft_consensus.cc:493] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:21.772083 2628 raft_consensus.cc:3060] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.772215 2669 tablet.cc:1724] T 39b291b1c9794faa9305f7d936604a44 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:21.773208 1171 tablet_bootstrap.cc:492] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:21.774802 2628 raft_consensus.cc:515] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.775470 2628 leader_election.cc:290] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:21.772081 988 leader_election.cc:343] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.776470 988 leader_election.cc:304] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:21.776863 988 leader_election.cc:304] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:21.777470 2629 raft_consensus.cc:2749] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.777655 2629 raft_consensus.cc:2804] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:21.777748 2629 raft_consensus.cc:493] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:21.777839 2629 raft_consensus.cc:3060] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.778074 2607 leader_election.cc:290] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:21.778894 2664 tablet.cc:1724] T 956eefc9ac3147bb857a448563c6fb6f P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:21.779655 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_524a3b28dffc47f5bf32de043600d64b" } new_table_name: "default.Table_aca497e7a1dc4ec4a26c7f94b18fddca" modify_external_catalogs: true
I20260617 07:53:21.780467 2629 raft_consensus.cc:515] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.781069 2629 leader_election.cc:290] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:21.782374 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037539021d1743bb9a66403b8a01662f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:21.783685 851 leader_election.cc:343] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 4681e8e3f1174b299d89ec541ca8e6b3
I20260617 07:53:21.783952 2659 tablet.cc:1724] T 956eefc9ac3147bb857a448563c6fb6f P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:21.788295 2525 raft_consensus.cc:515] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.789129 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361845f7627b4b9f8481b4a66bc53e9c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:21.789443 2525 leader_election.cc:290] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:21.790023 986 leader_election.cc:343] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:21.790217 986 leader_election.cc:343] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.791164 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 458) took 2450 ms. Trace:
I20260617 07:53:21.791252 1862 rpcz_store.cc:276] 0617 07:53:19.340204 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.340253 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:21.670781 (+2330528us) ts_tablet_manager.cc:1151] Deleting tablet 63de833f7aa740b0b5bf2494b78aca5c
0617 07:53:21.670792 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.704828 (+ 34036us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.755086 (+ 50258us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.791139 (+ 36053us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2330349}
I20260617 07:53:21.792722 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4b4f883d15d0470eb3031e2d963eac96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:21.793445 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf4025a0f784cc6868950e51a45da2e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:21.793766 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b4f883d15d0470eb3031e2d963eac96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:21.793927 986 leader_election.cc:343] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.794085 1172 tablet_bootstrap.cc:654] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.794167 1171 tablet_bootstrap.cc:654] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.794834 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 456) took 2457 ms. Trace:
I20260617 07:53:21.794916 1862 rpcz_store.cc:276] 0617 07:53:19.337352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.342450 (+ 5098us) service_pool.cc:224] Handling call
0617 07:53:21.792088 (+2449638us) ts_tablet_manager.cc:1151] Deleting tablet cc1d9ce2ab5b428893719d9acd272d88
0617 07:53:21.792098 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.794812 (+ 2714us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2449422}
I20260617 07:53:21.799723 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet a6f90a0d37cb483faa540451bf4dbe85
I20260617 07:53:21.800184 460 catalog_manager.cc:6784] ReplaceTablet: tablet a6f90a0d37cb483faa540451bf4dbe85 deleted and replaced by tablet ee4a2f3a22d1482eab85d44310c8a176
I20260617 07:53:21.805563 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f90a0d37cb483faa540451bf4dbe85 with delete_type TABLET_DATA_DELETED (replaced by tablet ee4a2f3a22d1482eab85d44310c8a176) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.806723 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f90a0d37cb483faa540451bf4dbe85 with delete_type TABLET_DATA_DELETED (replaced by tablet ee4a2f3a22d1482eab85d44310c8a176) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.807578 2594 raft_consensus.cc:493] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.807727 2594 raft_consensus.cc:515] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.808604 2594 leader_election.cc:290] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:21.808655 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3afd0e47dfc84e8f92c7684c766a3f99" } modify_external_catalogs: true
I20260617 07:53:21.808851 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3afd0e47dfc84e8f92c7684c766a3f99" } modify_external_catalogs: true
W20260617 07:53:21.809494 851 leader_election.cc:343] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 3fcf87953dc14bf190ac74101547e52f
I20260617 07:53:21.811203 1170 ts_tablet_manager.cc:1929] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:21.813985 1170 log.cc:1199] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/65bf5384ec244d36ba3d4e781c5eb8a3
I20260617 07:53:21.818753 1171 tablet_bootstrap.cc:492] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:21.818928 1171 ts_tablet_manager.cc:1403] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.001s
I20260617 07:53:21.820642 1171 raft_consensus.cc:359] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.820899 1171 raft_consensus.cc:385] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.821007 1171 raft_consensus.cc:740] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.821288 1171 consensus_queue.cc:260] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.821930 1171 ts_tablet_manager.cc:1434] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260617 07:53:21.822386 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 53560.1us
I20260617 07:53:21.823441 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]) successfully deleted
I20260617 07:53:21.823320 1171 tablet_bootstrap.cc:492] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:21.823845 885 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f90a0d37cb483faa540451bf4dbe85 with delete_type TABLET_DATA_DELETED (replaced by tablet ee4a2f3a22d1482eab85d44310c8a176) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.823987 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361845f7627b4b9f8481b4a66bc53e9c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:21.824151 913 raft_consensus.cc:3060] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.825258 1171 tablet_bootstrap.cc:654] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.826601 913 raft_consensus.cc:2468] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:21.827049 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037539021d1743bb9a66403b8a01662f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:21.827557 913 raft_consensus.cc:3060] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.830188 913 raft_consensus.cc:2468] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:21.831033 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4681e8e3f1174b299d89ec541ca8e6b3" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:21.831209 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 2c60d917996341109ae66b9af24f6cb4
I20260617 07:53:21.832278 1170 ts_tablet_manager.cc:1950] T 65bf5384ec244d36ba3d4e781c5eb8a3 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:21.832705 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fcf87953dc14bf190ac74101547e52f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:21.833078 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 320) took 5778 ms. Trace:
I20260617 07:53:21.833518 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c60d917996341109ae66b9af24f6cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.833868 766 raft_consensus.cc:3060] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.835546 2594 consensus_queue.cc:1048] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:21.835114 1172 tablet_bootstrap.cc:492] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:21.837930 1172 ts_tablet_manager.cc:1403] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.000s
I20260617 07:53:21.837895 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf4025a0f784cc6868950e51a45da2e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:21.838043 913 raft_consensus.cc:3060] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:21.838793 1172 raft_consensus.cc:359] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.839027 1172 raft_consensus.cc:385] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.839140 1172 raft_consensus.cc:740] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.839396 1172 consensus_queue.cc:260] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.839947 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c60d917996341109ae66b9af24f6cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.840108 1172 ts_tablet_manager.cc:1434] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:21.840426 1172 tablet_bootstrap.cc:492] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:21.840561 913 raft_consensus.cc:2468] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
W20260617 07:53:21.841696 852 leader_election.cc:343] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.841858 852 leader_election.cc:304] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.837466 1170 rpcz_store.cc:276] 0617 07:53:16.054689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.054758 (+ 69us) service_pool.cc:224] Handling call
0617 07:53:21.689015 (+5634257us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:21.689022 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.807922 (+118900us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.811140 (+ 3218us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.833040 (+ 21900us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5634135}
I20260617 07:53:21.842087 2594 raft_consensus.cc:2749] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.842363 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 65bf5384ec244d36ba3d4e781c5eb8a3 (table default.Table_0b705f18dfe34487821e76d515b4a2be [id=d3c16f845bc84f5f916ae4a5cf3e8254]) successfully deleted
I20260617 07:53:21.843135 1172 tablet_bootstrap.cc:654] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:21.843111 852 leader_election.cc:343] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:21.843243 852 leader_election.cc:304] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:21.843466 2594 raft_consensus.cc:2749] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:21.843314 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 321) took 5788 ms. Trace:
I20260617 07:53:21.844009 988 leader_election.cc:304] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:21.845379 988 leader_election.cc:304] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:21.845687 2628 raft_consensus.cc:2804] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:21.845851 2628 raft_consensus.cc:697] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:21.846079 2628 consensus_queue.cc:237] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.846990 2629 raft_consensus.cc:2804] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:21.850136 988 leader_election.cc:304] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:21.851433 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 459) took 2433 ms. Trace:
I20260617 07:53:21.852247 2525 raft_consensus.cc:2804] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:21.852456 2525 raft_consensus.cc:697] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
W20260617 07:53:21.852746 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet cc1d9ce2ab5b428893719d9acd272d88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc1d9ce2ab5b428893719d9acd272d88 already in progress: creating tablet
I20260617 07:53:21.852782 2525 consensus_queue.cc:237] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.854092 1846 ts_tablet_manager.cc:1929] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:21.854256 1846 log.cc:1199] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/63bf519b83c445798bddda3120b542ce
I20260617 07:53:21.854640 1846 ts_tablet_manager.cc:1950] T 63bf519b83c445798bddda3120b542ce P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:21.855393 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 567) took 2863 ms. Trace:
I20260617 07:53:21.855932 1846 rpcz_store.cc:276] 0617 07:53:18.992351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.992740 (+ 389us) service_pool.cc:224] Handling call
0617 07:53:21.741437 (+2748697us) ts_tablet_manager.cc:1151] Deleting tablet 63bf519b83c445798bddda3120b542ce
0617 07:53:21.741448 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.850546 (+109098us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.854038 (+ 3492us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.855371 (+ 1333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17290,"tablet-delete.queue_time_us":2748565}
I20260617 07:53:21.856456 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 552) took 2865 ms. Trace:
I20260617 07:53:21.856496 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 63bf519b83c445798bddda3120b542ce (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]) successfully deleted
I20260617 07:53:21.856585 1846 rpcz_store.cc:276] 0617 07:53:18.990637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.992894 (+ 2257us) service_pool.cc:224] Handling call
0617 07:53:21.856335 (+2863441us) ts_tablet_manager.cc:1151] Deleting tablet 5364dfe28b8d4042941c8d8d4d1cf503
0617 07:53:21.856348 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.856441 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2863344}
I20260617 07:53:21.856894 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 555) took 2865 ms. Trace:
I20260617 07:53:21.857020 1846 rpcz_store.cc:276] 0617 07:53:18.990947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.993012 (+ 2065us) service_pool.cc:224] Handling call
0617 07:53:21.856791 (+2863779us) ts_tablet_manager.cc:1151] Deleting tablet 11794aa70824476e9751a41ab305cc80
0617 07:53:21.856799 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.856878 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2863642}
W20260617 07:53:21.857151 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5364dfe28b8d4042941c8d8d4d1cf503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5364dfe28b8d4042941c8d8d4d1cf503 already in progress: creating tablet
I20260617 07:53:21.857362 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 565) took 2865 ms. Trace:
W20260617 07:53:21.857640 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 11794aa70824476e9751a41ab305cc80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11794aa70824476e9751a41ab305cc80 already in progress: creating tablet
I20260617 07:53:21.857479 1846 rpcz_store.cc:276] 0617 07:53:18.992045 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.993171 (+ 1126us) service_pool.cc:224] Handling call
0617 07:53:21.857277 (+2864106us) ts_tablet_manager.cc:1151] Deleting tablet 35120ce002f24f2bb1ea0fdc59fbfc9d
0617 07:53:21.857285 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.857350 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2863937}
I20260617 07:53:21.862965 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ed5563cfe75940168702bf237d8647cd
I20260617 07:53:21.868492 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5563cfe75940168702bf237d8647cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:21.851908 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c60d917996341109ae66b9af24f6cb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:21.852715 852 consensus_peers.cc:597] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:21.870429 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4b89f3bc484f44458e623c0e47f28f5f" } new_table_name: "default.Table_9daebbcfe24743b2a3107921957cb78b" modify_external_catalogs: true
I20260617 07:53:21.870906 885 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5563cfe75940168702bf237d8647cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:21.872212 1862 rpcz_store.cc:276] 0617 07:53:19.417923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.417988 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:21.851297 (+2433309us) ts_tablet_manager.cc:1151] Deleting tablet eafcf54494f244f1b978b4b5e39d93bd
0617 07:53:21.851308 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.851411 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2433112}
I20260617 07:53:21.873588 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 466) took 2327 ms. Trace:
I20260617 07:53:21.875399 2591 catalog_manager.cc:1294] Loaded cluster ID: 6a36b51fde3b4c70a9a0683607c17859
W20260617 07:53:21.875630 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet eafcf54494f244f1b978b4b5e39d93bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eafcf54494f244f1b978b4b5e39d93bd already in progress: creating tablet
I20260617 07:53:21.876633 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 561) took 2885 ms. Trace:
I20260617 07:53:21.876765 1846 rpcz_store.cc:276] 0617 07:53:18.991613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.993389 (+ 1776us) service_pool.cc:224] Handling call
0617 07:53:21.876506 (+2883117us) ts_tablet_manager.cc:1151] Deleting tablet 9436fb7fca094eaab925748e254b1a62
0617 07:53:21.876518 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.876615 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2882827}
I20260617 07:53:21.877161 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 558) took 2885 ms. Trace:
I20260617 07:53:21.877285 1846 rpcz_store.cc:276] 0617 07:53:18.991303 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.993888 (+ 2585us) service_pool.cc:224] Handling call
0617 07:53:21.877069 (+2883181us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:21.877077 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.877147 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2883051}
I20260617 07:53:21.877651 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 570) took 2884 ms. Trace:
I20260617 07:53:21.878051 1846 rpcz_store.cc:276] 0617 07:53:18.992687 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.994057 (+ 1370us) service_pool.cc:224] Handling call
0617 07:53:21.877554 (+2883497us) ts_tablet_manager.cc:1151] Deleting tablet 4681e8e3f1174b299d89ec541ca8e6b3
0617 07:53:21.877564 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.877636 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2883362}
W20260617 07:53:21.878187 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
W20260617 07:53:21.878448 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2d9e473fd444efa6ab63cc51dbb2bd already in progress: creating tablet
I20260617 07:53:21.878542 1846 tablet_replica.cc:333] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:21.878393 1862 rpcz_store.cc:276] 0617 07:53:19.546541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.548007 (+ 1466us) service_pool.cc:224] Handling call
0617 07:53:21.873451 (+2325444us) ts_tablet_manager.cc:1151] Deleting tablet a90472b619d644b7b01f5104872ecb64
0617 07:53:21.873466 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.873571 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2325258}
W20260617 07:53:21.878715 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4681e8e3f1174b299d89ec541ca8e6b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4681e8e3f1174b299d89ec541ca8e6b3 already in progress: creating tablet
I20260617 07:53:21.878729 1846 raft_consensus.cc:2243] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.878846 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 473) took 2297 ms. Trace:
I20260617 07:53:21.878926 1862 rpcz_store.cc:276] 0617 07:53:19.581574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.584408 (+ 2834us) service_pool.cc:224] Handling call
0617 07:53:21.878709 (+2294301us) ts_tablet_manager.cc:1151] Deleting tablet c449d3e251aa4f06a9191114bff0e0e2
0617 07:53:21.878723 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.878829 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2294127}
I20260617 07:53:21.879340 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 475) took 2297 ms. Trace:
I20260617 07:53:21.879426 1862 rpcz_store.cc:276] 0617 07:53:19.581704 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.584623 (+ 2919us) service_pool.cc:224] Handling call
0617 07:53:21.879235 (+2294612us) ts_tablet_manager.cc:1151] Deleting tablet 4f95a13b909c4ef9be6c56a317b42c9b
0617 07:53:21.879246 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.879326 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2279615}
I20260617 07:53:21.879699 1862 tablet_replica.cc:333] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:21.880159 1170 rpcz_store.cc:276] 0617 07:53:16.054780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.054855 (+ 75us) service_pool.cc:224] Handling call
0617 07:53:21.842691 (+5787836us) ts_tablet_manager.cc:1151] Deleting tablet 84f498f551ff4767bd16628b03f55ae2
0617 07:53:21.842700 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.843278 (+ 578us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5787672}
I20260617 07:53:21.880409 2591 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: loading cluster ID for follower catalog manager: success
I20260617 07:53:21.864164 1178 tablet_bootstrap.cc:492] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:21.867667 755 tablet_service.cc:1558] Processing DeleteTablet for tablet ed5563cfe75940168702bf237d8647cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.880664 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 317) took 5826 ms. Trace:
I20260617 07:53:21.880824 1178 ts_tablet_manager.cc:1403] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.142s user 0.005s sys 0.001s
I20260617 07:53:21.880846 1170 rpcz_store.cc:276] 0617 07:53:16.054353 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.054578 (+ 225us) service_pool.cc:224] Handling call
0617 07:53:21.880478 (+5825900us) ts_tablet_manager.cc:1151] Deleting tablet 2f8cd6ff8fa44536acdd84a107ab1525
0617 07:53:21.880489 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.880610 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5825446}
I20260617 07:53:21.881168 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 322) took 5825 ms. Trace:
I20260617 07:53:21.881254 1170 rpcz_store.cc:276] 0617 07:53:16.055843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.055899 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:21.881054 (+5825155us) ts_tablet_manager.cc:1151] Deleting tablet 51e757e6f4ce4c6eb8223c4b6955245e
0617 07:53:21.881063 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.881135 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5825004}
I20260617 07:53:21.881567 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 315) took 5827 ms. Trace:
I20260617 07:53:21.881655 1170 rpcz_store.cc:276] 0617 07:53:16.054082 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.063392 (+ 9310us) service_pool.cc:224] Handling call
0617 07:53:21.881453 (+5818061us) ts_tablet_manager.cc:1151] Deleting tablet 5dcfb101cf51487692ef9a6a17f40804
0617 07:53:21.881462 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.881533 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5817863}
I20260617 07:53:21.881989 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 333) took 5044 ms. Trace:
I20260617 07:53:21.882074 1170 rpcz_store.cc:276] 0617 07:53:16.837069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.837125 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:21.881867 (+5044742us) ts_tablet_manager.cc:1151] Deleting tablet bc57a1e3bc8b434da43f484705476b9b
0617 07:53:21.881874 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.881958 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5044543}
I20260617 07:53:21.882392 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 335) took 5040 ms. Trace:
I20260617 07:53:21.882469 1170 rpcz_store.cc:276] 0617 07:53:16.842351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.842808 (+ 457us) service_pool.cc:224] Handling call
0617 07:53:21.882267 (+5039459us) ts_tablet_manager.cc:1151] Deleting tablet beb8fbb44e6147be8c9605be886a8aea
0617 07:53:21.882275 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.882358 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5039285}
I20260617 07:53:21.882783 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 339) took 4893 ms. Trace:
I20260617 07:53:21.882858 1170 rpcz_store.cc:276] 0617 07:53:16.989263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.989324 (+ 61us) service_pool.cc:224] Handling call
0617 07:53:21.882679 (+4893355us) ts_tablet_manager.cc:1151] Deleting tablet 369442b72f754ee08dc6a484d51f2e99
0617 07:53:21.882687 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.882755 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4893192}
I20260617 07:53:21.883124 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 340) took 4891 ms. Trace:
I20260617 07:53:21.883195 1170 rpcz_store.cc:276] 0617 07:53:16.991771 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.991830 (+ 59us) service_pool.cc:224] Handling call
0617 07:53:21.883023 (+4891193us) ts_tablet_manager.cc:1151] Deleting tablet 739cadc7ad124e229441333de949f2c6
0617 07:53:21.883030 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.883100 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4891040}
W20260617 07:53:21.883544 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a90472b619d644b7b01f5104872ecb64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a90472b619d644b7b01f5104872ecb64 already in progress: creating tablet
I20260617 07:53:21.883951 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 341) took 4891 ms. Trace:
W20260617 07:53:21.884107 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c449d3e251aa4f06a9191114bff0e0e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c449d3e251aa4f06a9191114bff0e0e2 already in progress: creating tablet
W20260617 07:53:21.884721 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 4f95a13b909c4ef9be6c56a317b42c9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f95a13b909c4ef9be6c56a317b42c9b already in progress: creating tablet
I20260617 07:53:21.885185 2669 tablet.cc:1724] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 07:53:21.885680 852 consensus_peers.cc:597] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:21.886248 1170 rpcz_store.cc:276] 0617 07:53:16.992218 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:16.992265 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:21.883853 (+4891588us) ts_tablet_manager.cc:1151] Deleting tablet e03a26e301e747febc4d5bafdc1a49c6
0617 07:53:21.883861 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.883921 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4891467}
I20260617 07:53:21.886080 1862 raft_consensus.cc:2243] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.887475 1862 raft_consensus.cc:2272] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.890200 1846 raft_consensus.cc:2272] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.891494 1862 ts_tablet_manager.cc:1916] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.891599 1846 ts_tablet_manager.cc:1916] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.890666 1178 raft_consensus.cc:359] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.893384 1178 raft_consensus.cc:385] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.893502 1178 raft_consensus.cc:740] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.893800 1178 consensus_queue.cc:260] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.899051 1178 ts_tablet_manager.cc:1434] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260617 07:53:21.899459 1178 tablet_bootstrap.cc:492] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:21.901511 1178 tablet_bootstrap.cc:654] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.911834 1862 ts_tablet_manager.cc:1929] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:21.912068 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_23f74c07c322499982b3fcbc0ce236ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:21.912708 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23f74c07c322499982b3fcbc0ce236ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.918973 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_691581b4ba6547cf8ddbbdd0688f17c5" } new_table_name: "default.Table_d79c4d8bf3004df6b2883bf337b7ba59" modify_external_catalogs: true
I20260617 07:53:21.920186 1862 log.cc:1199] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5578fd5cb3724ed5b92b313bd52889ad
I20260617 07:53:21.920265 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 56c70f5c41e04ad0b913c15aa315353f
I20260617 07:53:21.920485 1862 ts_tablet_manager.cc:1950] T 5578fd5cb3724ed5b92b313bd52889ad P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:21.920974 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_732577db3896433fa1d09544bbf1ffb7" } new_table_name: "default.Table_d3149ace5367458db7d2f835bc7d88fe" modify_external_catalogs: true
I20260617 07:53:21.921123 1170 tablet_replica.cc:333] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:21.921382 1170 raft_consensus.cc:2243] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.921550 1170 pending_rounds.cc:70] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:21.921612 1170 pending_rounds.cc:77] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772752298979328 op_type: NO_OP noop_request { }
I20260617 07:53:21.921738 1170 raft_consensus.cc:2889] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:21.921823 1170 raft_consensus.cc:2272] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:21.917495 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 67373.2us
I20260617 07:53:21.922570 1170 ts_tablet_manager.cc:1916] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.917641 2629 raft_consensus.cc:697] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:21.923552 2629 consensus_queue.cc:237] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.926776 1172 tablet_bootstrap.cc:492] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:21.927062 1172 ts_tablet_manager.cc:1403] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.087s user 0.005s sys 0.000s
I20260617 07:53:21.927878 1172 raft_consensus.cc:359] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.928157 1172 raft_consensus.cc:385] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.928287 1172 raft_consensus.cc:740] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.928560 1172 consensus_queue.cc:260] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.928922 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b6a829d6282344d28e1edc117789070d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:21.929236 1172 ts_tablet_manager.cc:1434] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:21.929507 1172 tablet_bootstrap.cc:492] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:21.929473 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6a829d6282344d28e1edc117789070d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:21.930660 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb2f0680609849828fd5a368aac4ba92 consensus state has no leader
I20260617 07:53:21.931008 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2d28753af2b849528f0bd51b9b878119"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:21.931231 1172 tablet_bootstrap.cc:654] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:21.931473 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d28753af2b849528f0bd51b9b878119 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.931736 1171 tablet_bootstrap.cc:492] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:21.931859 1171 ts_tablet_manager.cc:1403] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.109s user 0.006s sys 0.001s
I20260617 07:53:21.932520 1171 raft_consensus.cc:359] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.932689 1171 raft_consensus.cc:385] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.932739 1171 raft_consensus.cc:740] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.932960 1171 consensus_queue.cc:260] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.933447 1171 ts_tablet_manager.cc:1434] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:21.933743 1171 tablet_bootstrap.cc:492] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:21.933919 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 485) took 2132 ms. Trace:
I20260617 07:53:21.933996 1862 rpcz_store.cc:276] 0617 07:53:19.801506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.801686 (+ 180us) service_pool.cc:224] Handling call
0617 07:53:21.879653 (+2077967us) ts_tablet_manager.cc:1151] Deleting tablet 5578fd5cb3724ed5b92b313bd52889ad
0617 07:53:21.879663 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.894651 (+ 14988us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.911769 (+ 17118us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.933898 (+ 22129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6121,"tablet-delete.queue_time_us":1976912}
I20260617 07:53:21.934167 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ce78660edab64a4d973c183fa5f3e33e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:21.934298 1862 tablet_replica.cc:333] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:21.934478 1862 raft_consensus.cc:2243] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
W20260617 07:53:21.934645 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce78660edab64a4d973c183fa5f3e33e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:21.934700 1862 pending_rounds.cc:70] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:21.934749 1862 pending_rounds.cc:77] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772744571826176 op_type: NO_OP noop_request { }
I20260617 07:53:21.934823 1862 raft_consensus.cc:2889] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:21.934895 1862 raft_consensus.cc:2272] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.935072 1171 tablet_bootstrap.cc:654] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.935388 1862 ts_tablet_manager.cc:1916] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:21.936244 851 consensus_peers.cc:597] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:21.945556 1170 ts_tablet_manager.cc:1929] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:21.946444 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 543fd8173b174946830d6228e47b2caa
I20260617 07:53:21.947265 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_05211c75563a42548dc7c2184fac8e7d" } new_table_name: "default.Table_30dc4f99090d427ba86417507dc67054" modify_external_catalogs: true
I20260617 07:53:21.953341 1862 ts_tablet_manager.cc:1929] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:21.957616 2591 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: acquiring CA information for follower catalog manager: success
I20260617 07:53:21.959162 1170 log.cc:1199] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/35120ce002f24f2bb1ea0fdc59fbfc9d
I20260617 07:53:21.959671 1170 ts_tablet_manager.cc:1950] T 35120ce002f24f2bb1ea0fdc59fbfc9d P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:21.960875 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 342) took 4958 ms. Trace:
I20260617 07:53:21.963711 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 56c70f5c41e04ad0b913c15aa315353f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.963747 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 543fd8173b174946830d6228e47b2caa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:21.965920 1172 tablet_bootstrap.cc:492] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:21.966218 1172 ts_tablet_manager.cc:1403] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.001s
I20260617 07:53:21.966993 1172 raft_consensus.cc:359] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.967577 1172 raft_consensus.cc:385] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:21.967708 1172 raft_consensus.cc:740] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:21.967988 1172 consensus_queue.cc:260] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.965870 1170 rpcz_store.cc:276] 0617 07:53:17.002315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.002400 (+ 85us) service_pool.cc:224] Handling call
0617 07:53:21.921057 (+4918657us) ts_tablet_manager.cc:1151] Deleting tablet 35120ce002f24f2bb1ea0fdc59fbfc9d
0617 07:53:21.921066 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.929248 (+ 8182us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.945483 (+ 16235us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.960828 (+ 15345us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4918455}
I20260617 07:53:21.970306 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 343) took 4611 ms. Trace:
I20260617 07:53:21.970479 1170 rpcz_store.cc:276] 0617 07:53:17.358408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:17.358983 (+ 575us) service_pool.cc:224] Handling call
0617 07:53:21.970092 (+4611109us) ts_tablet_manager.cc:1151] Deleting tablet 283c08c31718433e83f0cedd799215fe
0617 07:53:21.970101 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.970249 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4610901}
I20260617 07:53:21.970827 1170 tablet_replica.cc:333] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:21.971073 1862 log.cc:1199] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/596ef68705c84791b54f07e03b219b4c
I20260617 07:53:21.971349 1170 raft_consensus.cc:2243] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.971807 1862 ts_tablet_manager.cc:1950] T 596ef68705c84791b54f07e03b219b4c P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:21.972012 1170 raft_consensus.cc:2272] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.972625 1170 ts_tablet_manager.cc:1916] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:21.973517 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 490) took 2070 ms. Trace:
I20260617 07:53:21.973229 1172 ts_tablet_manager.cc:1434] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 07:53:21.978830 1172 tablet_bootstrap.cc:492] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:21.980991 1172 tablet_bootstrap.cc:654] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:21.981122 1862 rpcz_store.cc:276] 0617 07:53:19.903153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.903454 (+ 301us) service_pool.cc:224] Handling call
0617 07:53:21.934248 (+2030794us) ts_tablet_manager.cc:1151] Deleting tablet 596ef68705c84791b54f07e03b219b4c
0617 07:53:21.934259 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.950450 (+ 16191us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.953290 (+ 2840us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.973493 (+ 20203us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2030644}
I20260617 07:53:21.981600 1862 tablet_replica.cc:333] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:21.985908 1862 raft_consensus.cc:2243] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:21.986141 1862 raft_consensus.cc:2272] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:21.986711 1862 ts_tablet_manager.cc:1916] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:21.992960 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 45ec77478d3046d3af44f23b5835f49f has no consensus state
I20260617 07:53:21.992990 1862 ts_tablet_manager.cc:1929] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:21.993084 1862 log.cc:1199] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/bbc3d13d519843a9bc38e97dc85b67c8
I20260617 07:53:21.993368 1862 ts_tablet_manager.cc:1950] T bbc3d13d519843a9bc38e97dc85b67c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:21.995226 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 58ba8963530d49a89fe4eb626225377d (table default.Table_836c7fa9740f4820976c85223f980368 [id=4e86a2cea5304843b61370201d4d13b6]). Expected version 1 got 0
I20260617 07:53:21.995806 2644 raft_consensus.cc:493] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:21.995945 2644 raft_consensus.cc:515] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:21.996542 2644 leader_election.cc:290] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:21.998124 716 leader_election.cc:343] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: f15dcc10552d4747bad436538662bb66
I20260617 07:53:21.999202 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_360fa4c3327249579a54f68d3a81e327" } modify_external_catalogs: true
I20260617 07:53:21.999392 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_360fa4c3327249579a54f68d3a81e327" } modify_external_catalogs: true
W20260617 07:53:22.000095 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f659b794a08745d2a111016332e604b8 consensus state has no leader
I20260617 07:53:22.000468 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b0e2a57a3f144fa9a96d787075d34640"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.000993 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0e2a57a3f144fa9a96d787075d34640 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.002560 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 18e866278bb64196ba96e7d870195362 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:22.003278 1170 ts_tablet_manager.cc:1929] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.007572 1170 log.cc:1199] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/49f0f68dcef34228a1b2a018e8aa329e
I20260617 07:53:22.008771 1170 ts_tablet_manager.cc:1950] T 49f0f68dcef34228a1b2a018e8aa329e P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:22.008379 1172 tablet_bootstrap.cc:492] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.009073 1172 ts_tablet_manager.cc:1403] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.001s
I20260617 07:53:22.010159 1172 raft_consensus.cc:359] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.010480 1172 raft_consensus.cc:385] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.010633 1172 raft_consensus.cc:740] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.010949 1172 consensus_queue.cc:260] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:22.011330 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3618d5f43f3f4b6385a3494c887e0880 consensus state has no leader
I20260617 07:53:22.011802 1172 ts_tablet_manager.cc:1434] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:22.012252 1172 tablet_bootstrap.cc:492] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.014345 1172 tablet_bootstrap.cc:654] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.016117 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ec89beb01ab24e39a452439e1b445844"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:22.018347 1178 tablet_bootstrap.cc:492] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.018524 1178 ts_tablet_manager.cc:1403] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.119s user 0.006s sys 0.004s
I20260617 07:53:22.019212 1178 raft_consensus.cc:359] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.019433 1178 raft_consensus.cc:385] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.019521 1178 raft_consensus.cc:740] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.019753 1178 consensus_queue.cc:260] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:22.022477 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec89beb01ab24e39a452439e1b445844 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.022583 2629 raft_consensus.cc:493] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.022725 2629 raft_consensus.cc:515] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.023361 2629 leader_election.cc:290] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:22.015353 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 354) took 3882 ms. Trace:
I20260617 07:53:22.023765 1170 rpcz_store.cc:276] 0617 07:53:18.132746 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.132925 (+ 179us) service_pool.cc:224] Handling call
0617 07:53:21.970772 (+3837847us) ts_tablet_manager.cc:1151] Deleting tablet 49f0f68dcef34228a1b2a018e8aa329e
0617 07:53:21.970780 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.984277 (+ 13497us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.003191 (+ 18914us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.015313 (+ 12122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3830520}
I20260617 07:53:22.024327 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 355) took 3875 ms. Trace:
I20260617 07:53:22.024477 1170 rpcz_store.cc:276] 0617 07:53:18.149317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.149370 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:22.024156 (+3874786us) ts_tablet_manager.cc:1151] Deleting tablet 446114516f164dc0a956f2ccbf2e7c35
0617 07:53:22.024168 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.024276 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3874592}
I20260617 07:53:22.025429 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 356) took 3834 ms. Trace:
I20260617 07:53:22.026125 1170 rpcz_store.cc:276] 0617 07:53:18.191446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.191712 (+ 266us) service_pool.cc:224] Handling call
0617 07:53:22.025311 (+3833599us) ts_tablet_manager.cc:1151] Deleting tablet a0dcd837e1c54af696394e7a6c4d26f0
0617 07:53:22.025319 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.025403 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3833403}
I20260617 07:53:22.026530 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 367) took 3670 ms. Trace:
I20260617 07:53:22.026674 1170 rpcz_store.cc:276] 0617 07:53:18.356504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.356555 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:22.026416 (+3669861us) ts_tablet_manager.cc:1151] Deleting tablet 306742b9da81497991d58947bf3c1ebb
0617 07:53:22.026424 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.026502 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3669677}
I20260617 07:53:22.025981 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 488) took 2123 ms. Trace:
I20260617 07:53:22.026988 1862 rpcz_store.cc:276] 0617 07:53:19.902974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.903215 (+ 241us) service_pool.cc:224] Handling call
0617 07:53:21.981549 (+2078334us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:21.981560 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.989695 (+ 8135us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:21.992943 (+ 3248us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.025957 (+ 33014us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2057711}
I20260617 07:53:22.028522 1862 tablet_replica.cc:333] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.027467 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 370) took 3593 ms. Trace:
I20260617 07:53:22.028733 1170 rpcz_store.cc:276] 0617 07:53:18.434501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.449767 (+ 15266us) service_pool.cc:224] Handling call
0617 07:53:22.027337 (+3577570us) ts_tablet_manager.cc:1151] Deleting tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3
0617 07:53:22.027346 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.027432 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3577383}
I20260617 07:53:22.028818 2460 raft_consensus.cc:493] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.029006 2460 raft_consensus.cc:515] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.029610 2460 leader_election.cc:290] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.029973 1862 raft_consensus.cc:2243] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.030335 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 371) took 3567 ms. Trace:
I20260617 07:53:22.030705 1862 raft_consensus.cc:2272] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.031029 1178 ts_tablet_manager.cc:1434] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260617 07:53:22.030634 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9488e8a501e404f85540fb045d8916f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:22.031191 1170 rpcz_store.cc:276] 0617 07:53:18.463028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.463432 (+ 404us) service_pool.cc:224] Handling call
0617 07:53:22.030205 (+3566773us) ts_tablet_manager.cc:1151] Deleting tablet 44b06e32039e4ad28924f5173035820a
0617 07:53:22.030213 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.030301 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3566587}
I20260617 07:53:22.031998 1862 ts_tablet_manager.cc:1916] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.035885 1178 tablet_bootstrap.cc:492] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:22.037423 1178 tablet_bootstrap.cc:654] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.037989 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 373) took 3341 ms. Trace:
I20260617 07:53:22.038156 1170 rpcz_store.cc:276] 0617 07:53:18.696296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.696346 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:22.037854 (+3341508us) ts_tablet_manager.cc:1151] Deleting tablet d2304939c17648a6962f702524aa9b76
0617 07:53:22.037863 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.037957 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3323475}
I20260617 07:53:22.031347 1046 raft_consensus.cc:2468] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:22.038311 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5578fd5cb3724ed5b92b313bd52889ad (table default.Table_8fd650978f1f476f81cdd48faa9f9b0e [id=fbc20aae446e4e9583612295778577b0]) successfully deleted
I20260617 07:53:22.032739 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0ff0f0426440fba477a3dc4d1644e0" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:22.033126 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 56c70f5c41e04ad0b913c15aa315353f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.038882 851 leader_election.cc:304] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:22.033402 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 543fd8173b174946830d6228e47b2caa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.039158 2607 raft_consensus.cc:2804] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:22.039237 2607 raft_consensus.cc:493] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:22.039301 2607 raft_consensus.cc:3060] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:22.041899 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 596ef68705c84791b54f07e03b219b4c (table default.Table_0a73e0c5eead4482b2f6747fec27846f [id=3cda30618acd40f08728b0ccb01bb973]) successfully deleted
I20260617 07:53:22.041958 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 372) took 3345 ms. Trace:
I20260617 07:53:22.042053 1170 rpcz_store.cc:276] 0617 07:53:18.696177 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.696819 (+ 642us) service_pool.cc:224] Handling call
0617 07:53:22.041823 (+3345004us) ts_tablet_manager.cc:1151] Deleting tablet 752b6cf345384750bf9b62158ae50f26
0617 07:53:22.041833 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.041927 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3327390}
I20260617 07:53:22.042501 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 374) took 3271 ms. Trace:
I20260617 07:53:22.042457 2607 raft_consensus.cc:515] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.042662 1170 rpcz_store.cc:276] 0617 07:53:18.771088 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.771144 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:22.042381 (+3271237us) ts_tablet_manager.cc:1151] Deleting tablet 531ccdf479814053b468a7d5802f5dde
0617 07:53:22.042390 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.042470 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3271053}
I20260617 07:53:22.043005 1170 tablet_replica.cc:333] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:22.043054 2607 leader_election.cc:290] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.043900 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9488e8a501e404f85540fb045d8916f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:22.044121 1046 raft_consensus.cc:3060] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:22.046695 1046 raft_consensus.cc:2468] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:22.046950 1170 raft_consensus.cc:2243] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.047195 1170 raft_consensus.cc:2272] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.047181 851 leader_election.cc:304] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:22.047443 2607 raft_consensus.cc:2804] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:22.047665 2607 raft_consensus.cc:697] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:22.047884 1170 ts_tablet_manager.cc:1916] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.047912 2607 consensus_queue.cc:237] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.051309 2591 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 29a94ff9f875443ab6aeac00922cda0d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260617 07:53:22.054479 1172 tablet_bootstrap.cc:492] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.054709 1172 ts_tablet_manager.cc:1403] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.001s
I20260617 07:53:22.055639 1172 raft_consensus.cc:359] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.056006 1172 raft_consensus.cc:385] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.056128 1172 raft_consensus.cc:740] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.056448 1172 consensus_queue.cc:260] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.058663 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0ff0f0426440fba477a3dc4d1644e0" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.059604 1172 ts_tablet_manager.cc:1434] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:22.059978 1172 tablet_bootstrap.cc:492] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.061435 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 56c70f5c41e04ad0b913c15aa315353f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:22.061934 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 543fd8173b174946830d6228e47b2caa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:22.062397 713 leader_election.cc:343] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: f15dcc10552d4747bad436538662bb66
I20260617 07:53:22.062592 713 leader_election.cc:304] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:22.064057 2644 raft_consensus.cc:2749] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.064842 1178 tablet_bootstrap.cc:492] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.065014 1178 ts_tablet_manager.cc:1403] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.002s
I20260617 07:53:22.065732 1178 raft_consensus.cc:359] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.065946 1178 raft_consensus.cc:385] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.066037 1178 raft_consensus.cc:740] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.066309 1178 consensus_queue.cc:260] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.066948 1862 ts_tablet_manager.cc:1929] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.072110 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_aab2b789b2dc48719838e0704687a406" } modify_external_catalogs: true
I20260617 07:53:22.072359 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_aab2b789b2dc48719838e0704687a406" } modify_external_catalogs: true
I20260617 07:53:22.072412 1862 log.cc:1199] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/1f6264adc3994c22864ea73106ba2320
I20260617 07:53:22.072736 1862 ts_tablet_manager.cc:1950] T 1f6264adc3994c22864ea73106ba2320 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.073444 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 486) took 2271 ms. Trace:
I20260617 07:53:22.073520 1862 rpcz_store.cc:276] 0617 07:53:19.801612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.801761 (+ 149us) service_pool.cc:224] Handling call
0617 07:53:22.028480 (+2226719us) ts_tablet_manager.cc:1151] Deleting tablet 1f6264adc3994c22864ea73106ba2320
0617 07:53:22.028490 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.064036 (+ 35546us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.066899 (+ 2863us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.073425 (+ 6526us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2097723}
I20260617 07:53:22.073845 1862 tablet_replica.cc:333] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.074110 1862 raft_consensus.cc:2243] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:22.074375 1172 tablet_bootstrap.cc:654] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:22.076354 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 84f498f551ff4767bd16628b03f55ae2 because the tablet was not found. No further retry: Not found: Tablet not found: 84f498f551ff4767bd16628b03f55ae2
W20260617 07:53:22.076683 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2f8cd6ff8fa44536acdd84a107ab1525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f8cd6ff8fa44536acdd84a107ab1525 already in progress: creating tablet
W20260617 07:53:22.077397 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51e757e6f4ce4c6eb8223c4b6955245e already in progress: creating tablet
I20260617 07:53:22.077034 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_188549a6fb36472a8803b302e7b3242e" } modify_external_catalogs: true
I20260617 07:53:22.077622 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_188549a6fb36472a8803b302e7b3242e" } modify_external_catalogs: true
W20260617 07:53:22.078258 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5dcfb101cf51487692ef9a6a17f40804 because the tablet was not found. No further retry: Not found: Tablet not found: 5dcfb101cf51487692ef9a6a17f40804
W20260617 07:53:22.078516 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet bc57a1e3bc8b434da43f484705476b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc57a1e3bc8b434da43f484705476b9b already in progress: creating tablet
W20260617 07:53:22.078781 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet beb8fbb44e6147be8c9605be886a8aea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet beb8fbb44e6147be8c9605be886a8aea already in progress: creating tablet
W20260617 07:53:22.079036 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 369442b72f754ee08dc6a484d51f2e99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 369442b72f754ee08dc6a484d51f2e99 already in progress: creating tablet
W20260617 07:53:22.079452 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 739cadc7ad124e229441333de949f2c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 739cadc7ad124e229441333de949f2c6 already in progress: creating tablet
W20260617 07:53:22.079723 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e03a26e301e747febc4d5bafdc1a49c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03a26e301e747febc4d5bafdc1a49c6 already in progress: creating tablet
W20260617 07:53:22.080030 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 283c08c31718433e83f0cedd799215fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 283c08c31718433e83f0cedd799215fe already in progress: creating tablet
I20260617 07:53:22.080264 1170 ts_tablet_manager.cc:1929] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.080276 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 49f0f68dcef34228a1b2a018e8aa329e (table default.Table_871f52a414934a248bcacbe3399ccee8 [id=7543297cccfb4a3d90a50fe63ba0742f]) successfully deleted
W20260617 07:53:22.080468 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 446114516f164dc0a956f2ccbf2e7c35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 446114516f164dc0a956f2ccbf2e7c35 already in progress: creating tablet
I20260617 07:53:22.080574 1862 pending_rounds.cc:70] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
W20260617 07:53:22.080734 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a0dcd837e1c54af696394e7a6c4d26f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0dcd837e1c54af696394e7a6c4d26f0 already in progress: creating tablet
I20260617 07:53:22.080796 1862 pending_rounds.cc:77] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772746512232448 op_type: NO_OP noop_request { }
W20260617 07:53:22.081025 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 306742b9da81497991d58947bf3c1ebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 306742b9da81497991d58947bf3c1ebb already in progress: creating tablet
W20260617 07:53:22.081390 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 44b06e32039e4ad28924f5173035820a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44b06e32039e4ad28924f5173035820a already in progress: creating tablet
W20260617 07:53:22.081670 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d2304939c17648a6962f702524aa9b76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2304939c17648a6962f702524aa9b76 already in progress: creating tablet
W20260617 07:53:22.081940 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 752b6cf345384750bf9b62158ae50f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 752b6cf345384750bf9b62158ae50f26 already in progress: creating tablet
W20260617 07:53:22.082384 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 531ccdf479814053b468a7d5802f5dde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 531ccdf479814053b468a7d5802f5dde already in progress: creating tablet
I20260617 07:53:22.083529 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet df5bbdbcf3044128a4cb274f83d5d29b
I20260617 07:53:22.084364 754 tablet_service.cc:1558] Processing DeleteTablet for tablet df5bbdbcf3044128a4cb274f83d5d29b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:22.084899 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet bbc3d13d519843a9bc38e97dc85b67c8 (table default.Table_9e163236fd4f4a23b074e860f9688936 [id=bfdf05bf71594f8a9eb9d4c4898c2e23]) successfully deleted
I20260617 07:53:22.085289 1862 raft_consensus.cc:2889] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:22.085512 1170 log.cc:1199] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/60d1b4975077493eb6919b23d6523d3d
I20260617 07:53:22.086068 1170 ts_tablet_manager.cc:1950] T 60d1b4975077493eb6919b23d6523d3d P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:22.086570 1862 raft_consensus.cc:2272] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:22.087216 988 consensus_peers.cc:597] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 630e540a77374c11895ab5a0e394b3bb. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:22.087495 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 375) took 3304 ms. Trace:
W20260617 07:53:22.087651 988 consensus_peers.cc:597] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbc3d13d519843a9bc38e97dc85b67c8. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:22.087610 456 catalog_manager.cc:5696] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:22.088061 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 8cf4025a0f784cc6868950e51a45da2e (table default.Table_162d3b6e1d5749068f166f820520acc0 [id=bf143b9baca647f0b25452d16dff2ae6]). Expected version 1 got 0
I20260617 07:53:22.088116 1178 ts_tablet_manager.cc:1434] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.023s user 0.001s sys 0.000s
I20260617 07:53:22.088155 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9488e8a501e404f85540fb045d8916f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.088297 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:22.088310 1862 ts_tablet_manager.cc:1916] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.088533 456 catalog_manager.cc:5696] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:22.088892 754 tablet_service.cc:1511] Processing CreateTablet for tablet e34b4f1af1be48b2a4a6fca25a7140d7 (DEFAULT_TABLE table=default.Table_aef641dfc3a1426eb4f2870b832f873d [id=86f541f5917449e491a3ee4d069d500c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.088969 456 catalog_manager.cc:5696] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:22.089257 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e34b4f1af1be48b2a4a6fca25a7140d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.089306 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_2cd3859046ff474fa0cd1bdc9145099c [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 1 got 0
I20260617 07:53:22.089511 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:22.093771 1178 tablet_bootstrap.cc:492] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:22.093837 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_940ae22d379b46c9b49a775aab3b8df7 [id=1951a43bb71a41bfaa40c0d3bedc99d0] alter complete (version 1)
I20260617 07:53:22.096386 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 66140c5d364f453a8089f143cc96ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:22.097919 743 tablet_service.cc:1511] Processing CreateTablet for tablet 97a249e9b81e467a9f7a5bdffc9cf1dd (DEFAULT_TABLE table=default.Table_2e0c8868cecd4508931d50741b88c707 [id=58d4472fe7464f0cbc611e3c7d3960c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.100797 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a249e9b81e467a9f7a5bdffc9cf1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.102847 1172 tablet_bootstrap.cc:492] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.102982 1172 ts_tablet_manager.cc:1403] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.005s
I20260617 07:53:22.103744 1172 raft_consensus.cc:359] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.103927 1172 raft_consensus.cc:385] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.103991 1172 raft_consensus.cc:740] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.097644 755 tablet_service.cc:1511] Processing CreateTablet for tablet fac31abffeb3453f8f0eeed3542ee965 (DEFAULT_TABLE table=default.Table_e2fdbe909a5540ef9bdfd194cfda30d1 [id=98093e993f82497f9e2851e094f6e52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.104254 1172 consensus_queue.cc:260] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.104485 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac31abffeb3453f8f0eeed3542ee965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.106300 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 18e866278bb64196ba96e7d870195362
I20260617 07:53:22.106756 459 catalog_manager.cc:6784] ReplaceTablet: tablet 18e866278bb64196ba96e7d870195362 deleted and replaced by tablet d53bfc4f1b454613bc05b74ffc7f58ac
I20260617 07:53:22.107426 1172 ts_tablet_manager.cc:1434] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:22.107808 1172 tablet_bootstrap.cc:492] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.108594 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2d9e473fd444efa6ab63cc51dbb2bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:22.108770 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 18e866278bb64196ba96e7d870195362 with delete_type TABLET_DATA_DELETED (replaced by tablet d53bfc4f1b454613bc05b74ffc7f58ac) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:22.109702 1172 tablet_bootstrap.cc:654] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:22.110917 986 leader_election.cc:343] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:22.111239 986 consensus_peers.cc:597] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:22.111299 1862 ts_tablet_manager.cc:1929] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:22.111486 1862 log.cc:1199] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/68b448c65e684f49bf142ce2b5084d33
I20260617 07:53:22.111882 1862 ts_tablet_manager.cc:1950] T 68b448c65e684f49bf142ce2b5084d33 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.112651 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 489) took 2209 ms. Trace:
I20260617 07:53:22.112788 1862 rpcz_store.cc:276] 0617 07:53:19.903069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.903118 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:22.073796 (+2170678us) ts_tablet_manager.cc:1151] Deleting tablet 68b448c65e684f49bf142ce2b5084d33
0617 07:53:22.073807 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.091189 (+ 17382us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.111235 (+ 20046us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.112631 (+ 1396us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2143020}
I20260617 07:53:22.113237 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 492) took 2185 ms. Trace:
I20260617 07:53:22.100337 754 tablet_service.cc:1511] Processing CreateTablet for tablet e9be16511ec74a7fb5f1c5ee069aadf7 (DEFAULT_TABLE table=default.Table_1de5405081c8481b91216795e6dc49e9 [id=86274f4a209246668dd12077889fb93c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.113981 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9be16511ec74a7fb5f1c5ee069aadf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.114410 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8506cf31d2bb4fa49924c129b0cfaa33 (DEFAULT_TABLE table=default.Table_a6d78e96f79848dfb63d7525bcd52b5d [id=c9d7d5a1b26f4db7b8aa933b457ac7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.114732 756 tablet_service.cc:1511] Processing CreateTablet for tablet 14970c67aacc4e499fd6ae705b64e4fa (DEFAULT_TABLE table=default.Table_1ada4b463745460d84c6b2dabddbb8a9 [id=8ee7ccea12994912bf15bd98b5ea925f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.114746 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8506cf31d2bb4fa49924c129b0cfaa33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.117748 1862 rpcz_store.cc:276] 0617 07:53:19.928248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.930800 (+ 2552us) service_pool.cc:224] Handling call
0617 07:53:22.113115 (+2182315us) ts_tablet_manager.cc:1151] Deleting tablet 37b36c91191445478055b78830be9450
0617 07:53:22.113124 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.113223 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2182184}
I20260617 07:53:22.118000 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14970c67aacc4e499fd6ae705b64e4fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.118093 744 tablet_service.cc:1511] Processing CreateTablet for tablet 6859b886ab844645828c938f8c783a29 (DEFAULT_TABLE table=default.Table_f5101e7941a84bc48c82f60e1ffec08e [id=fbaac79e131f4e79a1a7a86b2f85c0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.118208 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 493) took 2187 ms. Trace:
I20260617 07:53:22.118275 1862 rpcz_store.cc:276] 0617 07:53:19.931171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.931661 (+ 490us) service_pool.cc:224] Handling call
0617 07:53:22.118063 (+2186402us) ts_tablet_manager.cc:1151] Deleting tablet 61510f9812e849e388c6c163e9af5f4f
0617 07:53:22.118072 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.118191 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2186253}
I20260617 07:53:22.118420 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6859b886ab844645828c938f8c783a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.118526 1862 tablet_replica.cc:333] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.118686 1862 raft_consensus.cc:2243] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:22.118718 1171 tablet_bootstrap.cc:492] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:22.118860 1171 ts_tablet_manager.cc:1403] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.185s user 0.007s sys 0.003s
I20260617 07:53:22.118961 1862 raft_consensus.cc:2272] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.119431 1862 ts_tablet_manager.cc:1916] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.119541 1171 raft_consensus.cc:359] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.119688 1171 raft_consensus.cc:385] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.119732 1171 raft_consensus.cc:740] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.119884 1171 consensus_queue.cc:260] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.120445 1171 ts_tablet_manager.cc:1434] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:22.120676 1171 tablet_bootstrap.cc:492] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:22.122794 1171 tablet_bootstrap.cc:654] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.123030 1172 tablet_bootstrap.cc:492] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.123236 1172 ts_tablet_manager.cc:1403] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260617 07:53:22.124004 1172 raft_consensus.cc:359] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.124254 1172 raft_consensus.cc:385] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.124383 1172 raft_consensus.cc:740] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.124668 1172 consensus_queue.cc:260] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.125484 1172 ts_tablet_manager.cc:1434] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:22.125823 1172 tablet_bootstrap.cc:492] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.126942 743 tablet_service.cc:1511] Processing CreateTablet for tablet 6a108ac251ae42d5a50cca72a83886ea (DEFAULT_TABLE table=default.Table_ca9627895d9a4657b6ada887dc66a04d [id=eb3212a5594a4e419048544939b3f115]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.127318 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a108ac251ae42d5a50cca72a83886ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.127483 1172 tablet_bootstrap.cc:654] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.129422 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 1f6264adc3994c22864ea73106ba2320 (table default.Table_b4e56877f98d44cf897d768d1058f5d5 [id=ddf79f1c39544fabb0b412114c2f0e21]) successfully deleted
W20260617 07:53:22.128890 988 leader_election.cc:343] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.129642 988 leader_election.cc:304] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:22.130014 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9488e8a501e404f85540fb045d8916f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:22.130113 2629 raft_consensus.cc:2749] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.132843 755 tablet_service.cc:1511] Processing CreateTablet for tablet 73ad0a2015854c89b43d8828c1c288f9 (DEFAULT_TABLE table=default.Table_a459934d3ce24abea618034a223e20e2 [id=f22037c097234241bb74d3b5148978b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.133246 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ad0a2015854c89b43d8828c1c288f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.135617 887 tablet_service.cc:1558] Processing DeleteTablet for tablet df5bbdbcf3044128a4cb274f83d5d29b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.135959 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ef9bd7437e0247ff91a297900a69d739"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.136329 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 227351us
W20260617 07:53:22.136528 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef9bd7437e0247ff91a297900a69d739 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.136574 1862 ts_tablet_manager.cc:1929] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:22.136658 1862 log.cc:1199] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5ec425bb523a449d9fe16d3ea3a0d7ae
I20260617 07:53:22.136967 1862 ts_tablet_manager.cc:1950] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.138013 756 tablet_service.cc:1511] Processing CreateTablet for tablet de62256b5bd748fdb35a589c28d7e024 (DEFAULT_TABLE table=default.Table_62f82c8919c149e1951e96accea98979 [id=5b1e6ece65054c1a901eee7154c1f763]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.138487 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de62256b5bd748fdb35a589c28d7e024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.139127 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 495) took 2204 ms. Trace:
I20260617 07:53:22.140749 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet df5bbdbcf3044128a4cb274f83d5d29b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:22.142899 2629 raft_consensus.cc:493] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.143070 2629 raft_consensus.cc:515] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.143718 2629 leader_election.cc:290] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:22.144131 1178 tablet_bootstrap.cc:654] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.144335 1014 tablet_service.cc:1511] Processing CreateTablet for tablet e34b4f1af1be48b2a4a6fca25a7140d7 (DEFAULT_TABLE table=default.Table_aef641dfc3a1426eb4f2870b832f873d [id=86f541f5917449e491a3ee4d069d500c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.144721 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e34b4f1af1be48b2a4a6fca25a7140d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.145081 751 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc1ee8656e941e9b15fc05018ebf753 (DEFAULT_TABLE table=default.Table_bdc4153272a245ed8d093b6a029b70ef [id=2a109d573dd94ab88f2086c5076cc93f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.145363 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc1ee8656e941e9b15fc05018ebf753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.147080 744 tablet_service.cc:1511] Processing CreateTablet for tablet e9a3e4eab60c4119867722e73e9b14bc (DEFAULT_TABLE table=default.Table_758d420011294192a9452766d8318b18 [id=76eac437c6054535b2f72b5e103615cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.147362 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a3e4eab60c4119867722e73e9b14bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.139878 887 tablet_service.cc:1511] Processing CreateTablet for tablet e34b4f1af1be48b2a4a6fca25a7140d7 (DEFAULT_TABLE table=default.Table_aef641dfc3a1426eb4f2870b832f873d [id=86f541f5917449e491a3ee4d069d500c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.150422 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e34b4f1af1be48b2a4a6fca25a7140d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.087603 1170 rpcz_store.cc:276] 0617 07:53:18.782940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.783610 (+ 670us) service_pool.cc:224] Handling call
0617 07:53:22.042938 (+3259328us) ts_tablet_manager.cc:1151] Deleting tablet 60d1b4975077493eb6919b23d6523d3d
0617 07:53:22.042947 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.068216 (+ 25269us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.080192 (+ 11976us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.087458 (+ 7266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3259130}
I20260617 07:53:22.152045 1170 tablet_replica.cc:333] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:22.152266 1170 raft_consensus.cc:2243] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.152415 1170 raft_consensus.cc:2272] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.152642 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.153421 1014 tablet_service.cc:1511] Processing CreateTablet for tablet fac31abffeb3453f8f0eeed3542ee965 (DEFAULT_TABLE table=default.Table_e2fdbe909a5540ef9bdfd194cfda30d1 [id=98093e993f82497f9e2851e094f6e52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.153784 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac31abffeb3453f8f0eeed3542ee965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.143640 885 tablet_service.cc:1511] Processing CreateTablet for tablet fac31abffeb3453f8f0eeed3542ee965 (DEFAULT_TABLE table=default.Table_e2fdbe909a5540ef9bdfd194cfda30d1 [id=98093e993f82497f9e2851e094f6e52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.154219 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac31abffeb3453f8f0eeed3542ee965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.159466 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 6a6e2bb6577648d2ab958cfaa6f4a948
I20260617 07:53:22.162755 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 9c86376216db4788b38bd55248e03f73
I20260617 07:53:22.165661 1862 rpcz_store.cc:276] 0617 07:53:19.934321 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.934491 (+ 170us) service_pool.cc:224] Handling call
0617 07:53:22.118490 (+2183999us) ts_tablet_manager.cc:1151] Deleting tablet 5ec425bb523a449d9fe16d3ea3a0d7ae
0617 07:53:22.118498 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.129467 (+ 10969us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.136530 (+ 7063us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.139108 (+ 2578us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2178490}
I20260617 07:53:22.166429 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 491) took 2238 ms. Trace:
I20260617 07:53:22.167125 1172 tablet_bootstrap.cc:492] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.167338 1172 ts_tablet_manager.cc:1403] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.005s
I20260617 07:53:22.168174 1172 raft_consensus.cc:359] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.168413 1172 raft_consensus.cc:385] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.168527 1172 raft_consensus.cc:740] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.168769 1172 consensus_queue.cc:260] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.169441 1172 ts_tablet_manager.cc:1434] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:22.169781 1172 tablet_bootstrap.cc:492] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.173496 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c86376216db4788b38bd55248e03f73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:22.174371 1172 tablet_bootstrap.cc:654] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.174511 1862 rpcz_store.cc:276] 0617 07:53:19.928144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.928324 (+ 180us) service_pool.cc:224] Handling call
0617 07:53:22.166296 (+2237972us) ts_tablet_manager.cc:1151] Deleting tablet 17c8a945eca643f3b3f4807406e9a24e
0617 07:53:22.166305 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.166413 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2226025}
I20260617 07:53:22.174935 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 514) took 2156 ms. Trace:
I20260617 07:53:22.175061 1862 rpcz_store.cc:276] 0617 07:53:20.018233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.118399 (+100166us) service_pool.cc:224] Handling call
0617 07:53:22.174815 (+2056416us) ts_tablet_manager.cc:1151] Deleting tablet 67cd66ea6ebc42bda00fbec82da73f16
0617 07:53:22.174824 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.174922 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2032017}
I20260617 07:53:22.175424 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 515) took 2157 ms. Trace:
I20260617 07:53:22.175520 1862 rpcz_store.cc:276] 0617 07:53:20.018300 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.142831 (+124531us) service_pool.cc:224] Handling call
0617 07:53:22.175342 (+2032511us) ts_tablet_manager.cc:1151] Deleting tablet f34a2ee6fa82482db979ab25bc284f8e
0617 07:53:22.175349 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.175413 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2032365}
I20260617 07:53:22.175870 744 tablet_service.cc:1511] Processing CreateTablet for tablet d3f843a058bd449796d59b89e2470d8c (DEFAULT_TABLE table=default.Table_ef8f02d7ea8d407898c00619b16844d2 [id=fa62d9f914ca4053b7065f8023603e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.176235 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f843a058bd449796d59b89e2470d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.176685 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 516) took 2158 ms. Trace:
I20260617 07:53:22.177433 1862 rpcz_store.cc:276] 0617 07:53:20.018362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.142999 (+124637us) service_pool.cc:224] Handling call
0617 07:53:22.176580 (+2033581us) ts_tablet_manager.cc:1151] Deleting tablet 05de71ea02df48ffacb369caa7f7d3de
0617 07:53:22.176588 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.176670 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2033459}
I20260617 07:53:22.177673 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_11e8915c1fc444049ee51be7f91d14db [id=40dfd0c31d5b4c0c9dcfae02dd246bdb] alter complete (version 2)
I20260617 07:53:22.177868 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 524) took 2033 ms. Trace:
I20260617 07:53:22.177928 1862 rpcz_store.cc:276] 0617 07:53:20.144209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.268989 (+124780us) service_pool.cc:224] Handling call
0617 07:53:22.177703 (+1908714us) ts_tablet_manager.cc:1151] Deleting tablet a1e064b5bc93442f83aeffa88861d818
0617 07:53:22.177786 (+ 83us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.177854 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1908507}
I20260617 07:53:22.178125 1862 tablet_replica.cc:333] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.178330 1862 raft_consensus.cc:2243] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:22.178623 1862 raft_consensus.cc:2272] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.179214 1862 ts_tablet_manager.cc:1916] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.179355 743 tablet_service.cc:1511] Processing CreateTablet for tablet ba4d0d6d8e39416d94ac817a3b116652 (DEFAULT_TABLE table=default.Table_7cf71f8401574af8942dd3ca2655bce9 [id=cad40d26bbe64dbe9f78c64ae3a52065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.179697 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4d0d6d8e39416d94ac817a3b116652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.180768 2653 tablet.cc:1724] T 370c8ddac0c747f6b44926f982233ea9 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:22.181658 2665 tablet.cc:1724] T 370c8ddac0c747f6b44926f982233ea9 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:22.182420 1178 tablet_bootstrap.cc:492] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.182590 1178 ts_tablet_manager.cc:1403] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.000s
I20260617 07:53:22.183317 1178 raft_consensus.cc:359] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.183530 1178 raft_consensus.cc:385] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.183612 1178 raft_consensus.cc:740] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.183876 1178 consensus_queue.cc:260] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.184906 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_50456ce872334470a5d513d6d074b0eb [id=8193bedf37784197bebc39d711a8eb2b] alter complete (version 3)
I20260617 07:53:22.185034 1862 ts_tablet_manager.cc:1929] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:22.185119 1862 log.cc:1199] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/7ca402543247461aa5384abb65fff364
I20260617 07:53:22.185447 1862 ts_tablet_manager.cc:1950] T 7ca402543247461aa5384abb65fff364 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.188019 2086 raft_consensus.cc:493] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.188148 2086 raft_consensus.cc:515] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.188668 2086 leader_election.cc:290] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.189967 2629 raft_consensus.cc:493] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.190143 2629 raft_consensus.cc:515] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.190773 2629 leader_election.cc:290] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:22.192288 2594 consensus_queue.cc:1048] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:22.195624 1172 tablet_bootstrap.cc:492] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.195827 1172 ts_tablet_manager.cc:1403] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260617 07:53:22.196709 1172 raft_consensus.cc:359] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.196930 1172 raft_consensus.cc:385] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.197041 1172 raft_consensus.cc:740] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.197340 1172 consensus_queue.cc:260] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.198032 1172 ts_tablet_manager.cc:1434] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:22.198386 1172 tablet_bootstrap.cc:492] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.201198 1172 tablet_bootstrap.cc:654] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.201380 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe290e33b5145b6a2831de3d37599b9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:22.201913 1046 raft_consensus.cc:2468] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:22.202576 851 leader_election.cc:304] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:22.202796 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 526) took 1984 ms. Trace:
I20260617 07:53:22.202912 2460 raft_consensus.cc:2804] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:22.202984 2460 raft_consensus.cc:493] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:22.203044 2460 raft_consensus.cc:3060] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:22.202942 1862 rpcz_store.cc:276] 0617 07:53:20.218072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.350063 (+131991us) service_pool.cc:224] Handling call
0617 07:53:22.178092 (+1828029us) ts_tablet_manager.cc:1151] Deleting tablet 7ca402543247461aa5384abb65fff364
0617 07:53:22.178098 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.182426 (+ 4328us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.184993 (+ 2567us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.202773 (+ 17780us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1827796}
I20260617 07:53:22.203269 1862 tablet_replica.cc:333] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.203431 1862 raft_consensus.cc:2243] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:22.203650 1862 raft_consensus.cc:2272] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.205113 1178 ts_tablet_manager.cc:1434] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20260617 07:53:22.205432 2460 raft_consensus.cc:515] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.207515 1862 ts_tablet_manager.cc:1916] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.208184 2460 leader_election.cc:290] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.208801 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe290e33b5145b6a2831de3d37599b9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:22.208984 1047 raft_consensus.cc:3060] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:22.211453 1178 tablet_bootstrap.cc:492] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:22.212293 1047 raft_consensus.cc:2468] T 3fe290e33b5145b6a2831de3d37599b9 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:22.212881 851 leader_election.cc:304] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:22.213207 2460 raft_consensus.cc:2804] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:22.213451 2460 raft_consensus.cc:697] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:22.213508 1178 tablet_bootstrap.cc:654] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.214354 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:22.216946 2460 consensus_queue.cc:237] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.218348 1172 tablet_bootstrap.cc:492] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.218508 1172 ts_tablet_manager.cc:1403] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260617 07:53:22.219251 1172 raft_consensus.cc:359] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.219431 1172 raft_consensus.cc:385] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.219426 756 tablet_service.cc:1511] Processing CreateTablet for tablet 5727da1f05244388a085cd43efaf3b6b (DEFAULT_TABLE table=default.Table_4a565d37b37b41ccb4986fa0375d4cca [id=2b0dbcebcba842a3ae7cc9f57ce8c745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.219513 1172 raft_consensus.cc:740] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.219763 1172 consensus_queue.cc:260] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.219983 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5727da1f05244388a085cd43efaf3b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.220408 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_9daebbcfe24743b2a3107921957cb78b [id=683c9be609d948c8b135b8648a820447] alter complete (version 1)
I20260617 07:53:22.220518 1172 ts_tablet_manager.cc:1434] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:22.220846 1172 tablet_bootstrap.cc:492] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.222654 1172 tablet_bootstrap.cc:654] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.225911 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5ec941f083497380896277365be5c9 (DEFAULT_TABLE table=default.Table_8dd1d9e74c1245e1afe42a16f20e57f6 [id=3824f4c443804be49d851e39e23ce3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.226313 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5ec941f083497380896277365be5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.227551 1862 ts_tablet_manager.cc:1929] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:22.227722 1862 log.cc:1199] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/69f5b567da0e4baab53c00c55923e920
I20260617 07:53:22.228538 1862 ts_tablet_manager.cc:1950] T 69f5b567da0e4baab53c00c55923e920 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.229393 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 537) took 1777 ms. Trace:
I20260617 07:53:22.229527 1862 rpcz_store.cc:276] 0617 07:53:20.451820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.556711 (+104891us) service_pool.cc:224] Handling call
0617 07:53:22.203225 (+1646514us) ts_tablet_manager.cc:1151] Deleting tablet 69f5b567da0e4baab53c00c55923e920
0617 07:53:22.203234 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.222934 (+ 19700us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.227501 (+ 4567us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.229374 (+ 1873us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1640471}
I20260617 07:53:22.231714 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 538) took 1056 ms. Trace:
I20260617 07:53:22.232179 1862 rpcz_store.cc:276] 0617 07:53:21.175566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.176121 (+ 555us) service_pool.cc:224] Handling call
0617 07:53:22.231580 (+1055459us) ts_tablet_manager.cc:1151] Deleting tablet 24ba13170e864dfa96cddfb1a76b8c40
0617 07:53:22.231590 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.231697 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1055240}
I20260617 07:53:22.232810 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 539) took 1056 ms. Trace:
I20260617 07:53:22.233402 1862 rpcz_store.cc:276] 0617 07:53:21.176834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.177877 (+ 1043us) service_pool.cc:224] Handling call
0617 07:53:22.232703 (+1054826us) ts_tablet_manager.cc:1151] Deleting tablet ea4c1033487a4dd2a73bd5148d5bb8f9
0617 07:53:22.232713 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.232796 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1054605}
I20260617 07:53:22.233834 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 540) took 1055 ms. Trace:
I20260617 07:53:22.234696 1172 tablet_bootstrap.cc:492] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.234894 1172 ts_tablet_manager.cc:1403] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260617 07:53:22.235703 1172 raft_consensus.cc:359] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.235961 1172 raft_consensus.cc:385] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.236104 1172 raft_consensus.cc:740] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.236415 1172 consensus_queue.cc:260] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.237115 1172 ts_tablet_manager.cc:1434] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:22.237454 1172 tablet_bootstrap.cc:492] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.237744 744 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3648d100164ad7b9778b731658a25e (DEFAULT_TABLE table=default.Table_39d5b904e80841a680a80c122fb5f324 [id=b2b1564c3607432fae60384ceb81d6f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.238240 1862 rpcz_store.cc:276] 0617 07:53:21.178280 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.178501 (+ 221us) service_pool.cc:224] Handling call
0617 07:53:22.233693 (+1055192us) ts_tablet_manager.cc:1151] Deleting tablet d06187aa09fd4776a992a07405a10876
0617 07:53:22.233704 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.233815 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1054869}
I20260617 07:53:22.239408 1172 tablet_bootstrap.cc:654] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.239704 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 541) took 1060 ms. Trace:
I20260617 07:53:22.240492 1862 rpcz_store.cc:276] 0617 07:53:21.178945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.179098 (+ 153us) service_pool.cc:224] Handling call
0617 07:53:22.239605 (+1060507us) ts_tablet_manager.cc:1151] Deleting tablet 561c8bf9e5c840628ab1c8cf91dc2d93
0617 07:53:22.239613 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.239690 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1060240}
I20260617 07:53:22.241297 1862 tablet_replica.cc:333] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.241171 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3648d100164ad7b9778b731658a25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.243432 892 tablet_service.cc:1511] Processing CreateTablet for tablet 97a249e9b81e467a9f7a5bdffc9cf1dd (DEFAULT_TABLE table=default.Table_2e0c8868cecd4508931d50741b88c707 [id=58d4472fe7464f0cbc611e3c7d3960c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.243764 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 18e866278bb64196ba96e7d870195362 with delete_type TABLET_DATA_DELETED (replaced by tablet d53bfc4f1b454613bc05b74ffc7f58ac) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.243922 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a249e9b81e467a9f7a5bdffc9cf1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.244234 887 tablet_service.cc:1511] Processing CreateTablet for tablet e9be16511ec74a7fb5f1c5ee069aadf7 (DEFAULT_TABLE table=default.Table_1de5405081c8481b91216795e6dc49e9 [id=86274f4a209246668dd12077889fb93c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.244545 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9be16511ec74a7fb5f1c5ee069aadf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.250543 887 tablet_service.cc:1511] Processing CreateTablet for tablet 6a108ac251ae42d5a50cca72a83886ea (DEFAULT_TABLE table=default.Table_ca9627895d9a4657b6ada887dc66a04d [id=eb3212a5594a4e419048544939b3f115]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.250936 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a108ac251ae42d5a50cca72a83886ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.250645 1862 raft_consensus.cc:2243] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:22.252877 1862 raft_consensus.cc:2272] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.253104 1178 tablet_bootstrap.cc:492] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.253237 1178 ts_tablet_manager.cc:1403] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.002s
I20260617 07:53:22.253405 1862 ts_tablet_manager.cc:1916] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.254017 1178 raft_consensus.cc:359] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.254184 1178 raft_consensus.cc:385] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.254232 1178 raft_consensus.cc:740] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.254416 1178 consensus_queue.cc:260] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.263535 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 97a249e9b81e467a9f7a5bdffc9cf1dd (DEFAULT_TABLE table=default.Table_2e0c8868cecd4508931d50741b88c707 [id=58d4472fe7464f0cbc611e3c7d3960c2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:22.263830 986 consensus_peers.cc:597] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:22.263972 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a249e9b81e467a9f7a5bdffc9cf1dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.264236 1021 tablet_service.cc:1511] Processing CreateTablet for tablet de62256b5bd748fdb35a589c28d7e024 (DEFAULT_TABLE table=default.Table_62f82c8919c149e1951e96accea98979 [id=5b1e6ece65054c1a901eee7154c1f763]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.264344 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14a3cb5e50b42b18ffda6f38cdfdd73" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.264587 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de62256b5bd748fdb35a589c28d7e024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.264577 1862 ts_tablet_manager.cc:1929] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:22.264673 1862 log.cc:1199] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/b4c9a032007a412e95bbd2b229edd50b
I20260617 07:53:22.264981 1862 ts_tablet_manager.cc:1950] T b4c9a032007a412e95bbd2b229edd50b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.265527 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a900aecf46e4430cb7ccdecd54376193" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.265884 2629 raft_consensus.cc:493] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.266037 2629 raft_consensus.cc:515] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.266566 1862 tablet_replica.cc:333] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.266757 1862 raft_consensus.cc:2243] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:22.266814 2629 leader_election.cc:290] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:22.267114 1862 raft_consensus.cc:2272] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.267875 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 18e866278bb64196ba96e7d870195362 with delete_type TABLET_DATA_DELETED (replaced by tablet d53bfc4f1b454613bc05b74ffc7f58ac) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:22.268344 1019 tablet_service.cc:1511] Processing CreateTablet for tablet e9be16511ec74a7fb5f1c5ee069aadf7 (DEFAULT_TABLE table=default.Table_1de5405081c8481b91216795e6dc49e9 [id=86274f4a209246668dd12077889fb93c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.268774 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 6a108ac251ae42d5a50cca72a83886ea (DEFAULT_TABLE table=default.Table_ca9627895d9a4657b6ada887dc66a04d [id=eb3212a5594a4e419048544939b3f115]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.269114 1171 tablet_bootstrap.cc:492] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:22.269117 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 73ad0a2015854c89b43d8828c1c288f9 (DEFAULT_TABLE table=default.Table_a459934d3ce24abea618034a223e20e2 [id=f22037c097234241bb74d3b5148978b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.269235 1171 ts_tablet_manager.cc:1403] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.149s user 0.002s sys 0.002s
I20260617 07:53:22.269483 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 8506cf31d2bb4fa49924c129b0cfaa33 (DEFAULT_TABLE table=default.Table_a6d78e96f79848dfb63d7525bcd52b5d [id=c9d7d5a1b26f4db7b8aa933b457ac7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.269876 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 14970c67aacc4e499fd6ae705b64e4fa (DEFAULT_TABLE table=default.Table_1ada4b463745460d84c6b2dabddbb8a9 [id=8ee7ccea12994912bf15bd98b5ea925f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.269929 1171 raft_consensus.cc:359] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.270113 1171 raft_consensus.cc:385] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.270170 1171 raft_consensus.cc:740] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.270248 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6859b886ab844645828c938f8c783a29 (DEFAULT_TABLE table=default.Table_f5101e7941a84bc48c82f60e1ffec08e [id=fbaac79e131f4e79a1a7a86b2f85c0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.271157 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9be16511ec74a7fb5f1c5ee069aadf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.271667 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ad0a2015854c89b43d8828c1c288f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.272080 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8506cf31d2bb4fa49924c129b0cfaa33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.272491 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a108ac251ae42d5a50cca72a83886ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.272897 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6859b886ab844645828c938f8c783a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.273205 1178 ts_tablet_manager.cc:1434] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260617 07:53:22.273267 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14970c67aacc4e499fd6ae705b64e4fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.276079 1178 tablet_bootstrap.cc:492] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:22.284596 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 60d1b4975077493eb6919b23d6523d3d (table default.Table_d199dae87e49454e8a74b84f1e0e28df [id=db2d3339eca0486bae7ce80d2f36323b]) successfully deleted
I20260617 07:53:22.285162 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3d33f4de2ef8400f890dd460c137cd88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:22.286926 1178 tablet_bootstrap.cc:654] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.287333 1172 tablet_bootstrap.cc:492] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.287452 1172 ts_tablet_manager.cc:1403] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.004s
I20260617 07:53:22.288041 1170 ts_tablet_manager.cc:1916] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.288115 1172 raft_consensus.cc:359] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.288265 1172 raft_consensus.cc:385] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.288313 1172 raft_consensus.cc:740] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.288542 1172 consensus_queue.cc:260] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.291427 1172 ts_tablet_manager.cc:1434] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:22.291761 1172 tablet_bootstrap.cc:492] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.293761 1172 tablet_bootstrap.cc:654] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:22.294896 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d33f4de2ef8400f890dd460c137cd88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.301232 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 68b448c65e684f49bf142ce2b5084d33 (table default.Table_a5077d1cb030456e91d1a015037c71fc [id=eb9a1f29372d468bb9449eb1b84c87ad]) successfully deleted
W20260617 07:53:22.301512 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 37b36c91191445478055b78830be9450 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37b36c91191445478055b78830be9450 already in progress: creating tablet
W20260617 07:53:22.301777 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 61510f9812e849e388c6c163e9af5f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61510f9812e849e388c6c163e9af5f4f already in progress: creating tablet
I20260617 07:53:22.302848 1846 ts_tablet_manager.cc:1929] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.302947 1846 log.cc:1199] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/7e90ad3b80f24bc7aeb2e92ba5c84b63
I20260617 07:53:22.303290 1846 ts_tablet_manager.cc:1950] T 7e90ad3b80f24bc7aeb2e92ba5c84b63 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:22.303979 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 563) took 3312 ms. Trace:
I20260617 07:53:22.286770 892 tablet_service.cc:1511] Processing CreateTablet for tablet 73ad0a2015854c89b43d8828c1c288f9 (DEFAULT_TABLE table=default.Table_a459934d3ce24abea618034a223e20e2 [id=f22037c097234241bb74d3b5148978b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.306396 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ad0a2015854c89b43d8828c1c288f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.294397 884 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc1ee8656e941e9b15fc05018ebf753 (DEFAULT_TABLE table=default.Table_bdc4153272a245ed8d093b6a029b70ef [id=2a109d573dd94ab88f2086c5076cc93f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.310096 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc1ee8656e941e9b15fc05018ebf753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.294618 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.294754 881 tablet_service.cc:1511] Processing CreateTablet for tablet de62256b5bd748fdb35a589c28d7e024 (DEFAULT_TABLE table=default.Table_62f82c8919c149e1951e96accea98979 [id=5b1e6ece65054c1a901eee7154c1f763]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.293707 886 tablet_service.cc:1511] Processing CreateTablet for tablet 14970c67aacc4e499fd6ae705b64e4fa (DEFAULT_TABLE table=default.Table_1ada4b463745460d84c6b2dabddbb8a9 [id=8ee7ccea12994912bf15bd98b5ea925f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.314158 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de62256b5bd748fdb35a589c28d7e024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.314370 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14970c67aacc4e499fd6ae705b64e4fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.277415 1862 ts_tablet_manager.cc:1916] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.319950 1862 ts_tablet_manager.cc:1929] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:22.297986 888 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3648d100164ad7b9778b731658a25e (DEFAULT_TABLE table=default.Table_39d5b904e80841a680a80c122fb5f324 [id=b2b1564c3607432fae60384ceb81d6f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.320317 1862 log.cc:1199] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/eb75a965740344c2bd0b68a8dda28be5
I20260617 07:53:22.320451 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3648d100164ad7b9778b731658a25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.320847 1862 ts_tablet_manager.cc:1950] T eb75a965740344c2bd0b68a8dda28be5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.322223 1862 tablet_replica.cc:333] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.322403 1862 raft_consensus.cc:2243] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:22.322741 1862 raft_consensus.cc:2272] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.323635 1862 ts_tablet_manager.cc:1916] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.298074 898 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5ec941f083497380896277365be5c9 (DEFAULT_TABLE table=default.Table_8dd1d9e74c1245e1afe42a16f20e57f6 [id=3824f4c443804be49d851e39e23ce3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.297777 880 tablet_service.cc:1511] Processing CreateTablet for tablet d3f843a058bd449796d59b89e2470d8c (DEFAULT_TABLE table=default.Table_ef8f02d7ea8d407898c00619b16844d2 [id=fa62d9f914ca4053b7065f8023603e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.326047 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5ec941f083497380896277365be5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.298177 882 tablet_service.cc:1511] Processing CreateTablet for tablet 5727da1f05244388a085cd43efaf3b6b (DEFAULT_TABLE table=default.Table_4a565d37b37b41ccb4986fa0375d4cca [id=2b0dbcebcba842a3ae7cc9f57ce8c745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.294740 879 tablet_service.cc:1511] Processing CreateTablet for tablet 6859b886ab844645828c938f8c783a29 (DEFAULT_TABLE table=default.Table_f5101e7941a84bc48c82f60e1ffec08e [id=fbaac79e131f4e79a1a7a86b2f85c0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.293301 885 tablet_service.cc:1511] Processing CreateTablet for tablet 8506cf31d2bb4fa49924c129b0cfaa33 (DEFAULT_TABLE table=default.Table_a6d78e96f79848dfb63d7525bcd52b5d [id=c9d7d5a1b26f4db7b8aa933b457ac7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.326311 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5727da1f05244388a085cd43efaf3b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.294503 883 tablet_service.cc:1511] Processing CreateTablet for tablet ba4d0d6d8e39416d94ac817a3b116652 (DEFAULT_TABLE table=default.Table_7cf71f8401574af8942dd3ca2655bce9 [id=cad40d26bbe64dbe9f78c64ae3a52065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.327378 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f843a058bd449796d59b89e2470d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.327725 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8506cf31d2bb4fa49924c129b0cfaa33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.328083 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6859b886ab844645828c938f8c783a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.294838 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c86376216db4788b38bd55248e03f73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.298385 889 tablet_service.cc:1511] Processing CreateTablet for tablet e9a3e4eab60c4119867722e73e9b14bc (DEFAULT_TABLE table=default.Table_758d420011294192a9452766d8318b18 [id=76eac437c6054535b2f72b5e103615cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.330127 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a3e4eab60c4119867722e73e9b14bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.330416 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4d0d6d8e39416d94ac817a3b116652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.271054 1171 consensus_queue.cc:260] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.335947 2629 raft_consensus.cc:493] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.336081 2629 raft_consensus.cc:515] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.336660 2629 leader_election.cc:290] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:22.337549 1015 tablet_service.cc:1511] Processing CreateTablet for tablet ba4d0d6d8e39416d94ac817a3b116652 (DEFAULT_TABLE table=default.Table_7cf71f8401574af8942dd3ca2655bce9 [id=cad40d26bbe64dbe9f78c64ae3a52065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.337952 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4d0d6d8e39416d94ac817a3b116652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.346076 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_f1ff983b5f414960bb16a56ef5f1c082" } modify_external_catalogs: true
I20260617 07:53:22.346271 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_f1ff983b5f414960bb16a56ef5f1c082" } modify_external_catalogs: true
I20260617 07:53:22.347205 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_7428f353a6b44f5a8dccbec3ffa85b60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.347759 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7428f353a6b44f5a8dccbec3ffa85b60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.349159 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_aae2ee49ba404f10a9133db568c68406"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.349647 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aae2ee49ba404f10a9133db568c68406 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.351802 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2d90416672b341028309278d5b5a367c" } new_table_name: "default.Table_3a27cafa0dc14d528e8a5f7c214b14a9" modify_external_catalogs: true
I20260617 07:53:22.353080 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_dfde2dae154b4df6bb65f9a583a971aa" } modify_external_catalogs: true
I20260617 07:53:22.353256 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_dfde2dae154b4df6bb65f9a583a971aa" } modify_external_catalogs: true
I20260617 07:53:22.358681 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b3755d8ef424425f8833079bc13b60f3" } new_table_name: "default.Table_38bf092fcdc64f64ab78017a4a65df87" modify_external_catalogs: true
I20260617 07:53:22.359807 1171 ts_tablet_manager.cc:1434] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.090s user 0.002s sys 0.000s
I20260617 07:53:22.360116 1171 tablet_bootstrap.cc:492] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:22.362857 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 5727da1f05244388a085cd43efaf3b6b (DEFAULT_TABLE table=default.Table_4a565d37b37b41ccb4986fa0375d4cca [id=2b0dbcebcba842a3ae7cc9f57ce8c745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.363039 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:22.363281 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5727da1f05244388a085cd43efaf3b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.364118 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 369442b72f754ee08dc6a484d51f2e99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:16 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:22.362814 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3648d100164ad7b9778b731658a25e (DEFAULT_TABLE table=default.Table_39d5b904e80841a680a80c122fb5f324 [id=b2b1564c3607432fae60384ceb81d6f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.366562 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3648d100164ad7b9778b731658a25e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:22.368956 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 797867621cb94efb8ff9d3689a9d6745 has no consensus state
W20260617 07:53:22.371279 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e48c2b2b8d7246ff8466337e104017f4 consensus state has no leader
I20260617 07:53:22.371896 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c86376216db4788b38bd55248e03f73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:22.372115 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d with delete_type TABLET_DATA_DELETED (replaced by tablet c449d3e251aa4f06a9191114bff0e0e2) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:22.372489 1018 tablet_service.cc:1511] Processing CreateTablet for tablet e9a3e4eab60c4119867722e73e9b14bc (DEFAULT_TABLE table=default.Table_758d420011294192a9452766d8318b18 [id=76eac437c6054535b2f72b5e103615cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.372815 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a3e4eab60c4119867722e73e9b14bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.377556 1014 tablet_service.cc:1511] Processing CreateTablet for tablet d3f843a058bd449796d59b89e2470d8c (DEFAULT_TABLE table=default.Table_ef8f02d7ea8d407898c00619b16844d2 [id=fa62d9f914ca4053b7065f8023603e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.377797 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:22.378006 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f843a058bd449796d59b89e2470d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.378376 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc1ee8656e941e9b15fc05018ebf753 (DEFAULT_TABLE table=default.Table_bdc4153272a245ed8d093b6a029b70ef [id=2a109d573dd94ab88f2086c5076cc93f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.378696 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc1ee8656e941e9b15fc05018ebf753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.382113 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0a8b95e63e0d47cd8b03857112efe394"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.382802 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a8b95e63e0d47cd8b03857112efe394 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.387817 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_836c7fa9740f4820976c85223f980368" } new_table_name: "default.Table_c051617d86bd42ffbe4f600511e96381" modify_external_catalogs: true
W20260617 07:53:22.389029 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet e48c2b2b8d7246ff8466337e104017f4 (table default.Table_38bf092fcdc64f64ab78017a4a65df87 [id=cb3692785248483b9029d99aea7ab463], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e48c2b2b8d7246ff8466337e104017f4 consensus state has no leader
I20260617 07:53:22.392661 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1ba8fcc807224287b958cd9273dd474a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.393151 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ba8fcc807224287b958cd9273dd474a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.399092 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a2d7aa9710d045a6a7a817672113e254"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.399588 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2d7aa9710d045a6a7a817672113e254 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.402812 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a3a4eb2e45ac47a7a0fef33dc402a4c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.403340 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3a4eb2e45ac47a7a0fef33dc402a4c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.405838 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4567ec36d77142efb3f907152dc94596" } new_table_name: "default.Table_a7cfc3ae378d45a6aefe3ef6c2559e4a" modify_external_catalogs: true
W20260617 07:53:22.404263 986 leader_election.cc:343] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:22.407904 986 leader_election.cc:343] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.418021 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_73fb62164ea041f2a6e1e1c5e877605b" } new_table_name: "default.Table_3c3c6cc991ac4b02a65ed05a7b2ac5bc" modify_external_catalogs: true
I20260617 07:53:22.418591 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b26f5c668eb74dc89c5c17173eec4845"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.419145 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b26f5c668eb74dc89c5c17173eec4845 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.419566 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_930c710e3f0d4c7f9f5c5564029c8021"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.420676 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_930c710e3f0d4c7f9f5c5564029c8021 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.421315 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0cc937610f884774b7b7c3d5c1739d85" } modify_external_catalogs: true
I20260617 07:53:22.421496 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0cc937610f884774b7b7c3d5c1739d85" } modify_external_catalogs: true
I20260617 07:53:22.421846 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5ec941f083497380896277365be5c9 (DEFAULT_TABLE table=default.Table_8dd1d9e74c1245e1afe42a16f20e57f6 [id=3824f4c443804be49d851e39e23ce3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.422444 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5ec941f083497380896277365be5c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:22.444456 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61eff078d7074b6f805571b18d59d154 consensus state has no leader
I20260617 07:53:22.461508 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]) successfully deleted
W20260617 07:53:22.461803 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 17c8a945eca643f3b3f4807406e9a24e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17c8a945eca643f3b3f4807406e9a24e already in progress: creating tablet
W20260617 07:53:22.462046 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 67cd66ea6ebc42bda00fbec82da73f16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67cd66ea6ebc42bda00fbec82da73f16 already in progress: creating tablet
W20260617 07:53:22.462246 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet f34a2ee6fa82482db979ab25bc284f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f34a2ee6fa82482db979ab25bc284f8e already in progress: creating tablet
W20260617 07:53:22.462441 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 05de71ea02df48ffacb369caa7f7d3de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05de71ea02df48ffacb369caa7f7d3de already in progress: creating tablet
W20260617 07:53:22.462617 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a1e064b5bc93442f83aeffa88861d818 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e064b5bc93442f83aeffa88861d818 already in progress: creating tablet
I20260617 07:53:22.468104 456 master_service.cc:960] ReplaceTablet: received request to replace tablet f30f0bbfdf404569a417662861b06f73 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:22.477932 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet f30f0bbfdf404569a417662861b06f73
I20260617 07:53:22.479457 456 catalog_manager.cc:6784] ReplaceTablet: tablet f30f0bbfdf404569a417662861b06f73 deleted and replaced by tablet a969954e858843698b07681fd32cd611
I20260617 07:53:22.336489 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdf8f714539449d8862cd2a2336fbe9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.408571 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9618a5c0c9dd4c368f5763c434f70da5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.437448 2644 raft_consensus.cc:493] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.486364 2644 raft_consensus.cc:515] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.486977 2644 leader_election.cc:290] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.447916 2711 raft_consensus.cc:493] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.479045 744 tablet_service.cc:1558] Processing DeleteTablet for tablet f30f0bbfdf404569a417662861b06f73 with delete_type TABLET_DATA_DELETED (replaced by tablet a969954e858843698b07681fd32cd611) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:22.487447 1846 rpcz_store.cc:276] 0617 07:53:18.991843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.994351 (+ 2508us) service_pool.cc:224] Handling call
0617 07:53:21.878497 (+2884146us) ts_tablet_manager.cc:1151] Deleting tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63
0617 07:53:21.878505 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:21.904547 (+ 26042us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.302794 (+398247us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.303961 (+ 1167us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2884053}
I20260617 07:53:22.487748 2711 raft_consensus.cc:515] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.488346 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 7e90ad3b80f24bc7aeb2e92ba5c84b63 (table default.Table_3e98977b52da4e3d825559a506774b17 [id=b7cea59369de444397139db78c303ea5]) successfully deleted
I20260617 07:53:22.488711 2644 raft_consensus.cc:493] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.488840 2644 raft_consensus.cc:515] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.488915 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 568) took 3496 ms. Trace:
I20260617 07:53:22.489391 2644 leader_election.cc:290] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.489013 1846 rpcz_store.cc:276] 0617 07:53:18.992452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.994517 (+ 2065us) service_pool.cc:224] Handling call
0617 07:53:22.488758 (+3494241us) ts_tablet_manager.cc:1151] Deleting tablet 5578fd5cb3724ed5b92b313bd52889ad
0617 07:53:22.488774 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.488895 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3494084}
I20260617 07:53:22.490079 2711 leader_election.cc:290] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:22.490115 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5578fd5cb3724ed5b92b313bd52889ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5578fd5cb3724ed5b92b313bd52889ad already in progress: creating tablet
I20260617 07:53:22.491246 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 566) took 3499 ms. Trace:
I20260617 07:53:22.491382 1846 rpcz_store.cc:276] 0617 07:53:18.992202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.994677 (+ 2475us) service_pool.cc:224] Handling call
0617 07:53:22.489696 (+3495019us) ts_tablet_manager.cc:1151] Deleting tablet 9618a5c0c9dd4c368f5763c434f70da5
0617 07:53:22.491124 (+ 1428us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.491227 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3494902}
W20260617 07:53:22.491914 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9618a5c0c9dd4c368f5763c434f70da5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9618a5c0c9dd4c368f5763c434f70da5 already in progress: creating tablet
I20260617 07:53:22.492338 1846 tablet_replica.cc:333] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:22.492650 1846 raft_consensus.cc:2243] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.492882 1846 raft_consensus.cc:2272] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.493547 1846 ts_tablet_manager.cc:1916] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.501104 1178 tablet_bootstrap.cc:492] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.501304 1178 ts_tablet_manager.cc:1403] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.225s user 0.015s sys 0.031s
I20260617 07:53:22.502132 1178 raft_consensus.cc:359] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.502394 1178 raft_consensus.cc:385] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.502494 1178 raft_consensus.cc:740] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.502849 1178 consensus_queue.cc:260] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.504187 1170 ts_tablet_manager.cc:1929] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.512353 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
I20260617 07:53:22.512629 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]) successfully deleted
I20260617 07:53:22.512801 768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe290e33b5145b6a2831de3d37599b9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:22.512873 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 24ba13170e864dfa96cddfb1a76b8c40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24ba13170e864dfa96cddfb1a76b8c40 already in progress: creating tablet
I20260617 07:53:22.513072 2711 raft_consensus.cc:493] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:22.513093 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ea4c1033487a4dd2a73bd5148d5bb8f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea4c1033487a4dd2a73bd5148d5bb8f9 already in progress: creating tablet
I20260617 07:53:22.513175 2711 raft_consensus.cc:515] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:22.513347 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d06187aa09fd4776a992a07405a10876 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d06187aa09fd4776a992a07405a10876 already in progress: creating tablet
I20260617 07:53:22.513863 2711 leader_election.cc:290] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.514070 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe290e33b5145b6a2831de3d37599b9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.515762 1178 ts_tablet_manager.cc:1434] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260617 07:53:22.522655 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0cbd12d27d174b7d8addf48d4cf581b8" } modify_external_catalogs: true
I20260617 07:53:22.522979 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0cbd12d27d174b7d8addf48d4cf581b8" } modify_external_catalogs: true
I20260617 07:53:22.524786 1862 ts_tablet_manager.cc:1929] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:22.524901 1862 log.cc:1199] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/35120ce002f24f2bb1ea0fdc59fbfc9d
I20260617 07:53:22.525247 1862 ts_tablet_manager.cc:1950] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:22.526392 716 leader_election.cc:343] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 3aa1c1fdede041d28570b85e63c401b7
W20260617 07:53:22.526613 716 leader_election.cc:343] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: d03d6dc473fc4be1a436fd71a06f403e
W20260617 07:53:22.526789 716 leader_election.cc:343] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 66140c5d364f453a8089f143cc96ede8
I20260617 07:53:22.527693 1178 tablet_bootstrap.cc:492] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:22.527896 716 leader_election.cc:343] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 3ae9261c0ac94defaecfc7d14ba1ae61
I20260617 07:53:22.529727 1178 tablet_bootstrap.cc:654] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.534327 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 571) took 1195 ms. Trace:
I20260617 07:53:22.534385 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4dc0a667e5eb4b3892bb190938ea4571"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:22.534485 1862 rpcz_store.cc:276] 0617 07:53:21.338858 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.338913 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:22.322181 (+983268us) ts_tablet_manager.cc:1151] Deleting tablet 35120ce002f24f2bb1ea0fdc59fbfc9d
0617 07:53:22.322192 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.326675 (+ 4483us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.524728 (+198053us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.534303 (+ 9575us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":983095}
I20260617 07:53:22.534806 1862 tablet_replica.cc:333] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:22.535174 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4dc0a667e5eb4b3892bb190938ea4571 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.550235 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_930c710e3f0d4c7f9f5c5564029c8021" } modify_external_catalogs: true
I20260617 07:53:22.550443 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_930c710e3f0d4c7f9f5c5564029c8021" } modify_external_catalogs: true
I20260617 07:53:22.554339 1178 tablet_bootstrap.cc:492] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.554536 1178 ts_tablet_manager.cc:1403] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260617 07:53:22.555545 1178 raft_consensus.cc:359] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.555794 1178 raft_consensus.cc:385] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.555895 1178 raft_consensus.cc:740] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.556120 1171 tablet_bootstrap.cc:654] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.556200 1178 consensus_queue.cc:260] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.562749 1170 log.cc:1199] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/488cc3a082b14dee8f70153e6f2925a4
I20260617 07:53:22.563117 1170 ts_tablet_manager.cc:1950] T 488cc3a082b14dee8f70153e6f2925a4 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:22.509593 986 leader_election.cc:343] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:22.563576 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 54018.2us
W20260617 07:53:22.563779 986 leader_election.cc:343] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.564225 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 379) took 3779 ms. Trace:
I20260617 07:53:22.564303 1170 rpcz_store.cc:276] 0617 07:53:18.784538 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.784590 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:22.151971 (+3367381us) ts_tablet_manager.cc:1151] Deleting tablet 488cc3a082b14dee8f70153e6f2925a4
0617 07:53:22.151980 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.290876 (+138896us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.504123 (+213247us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.564206 (+ 60083us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3367208}
I20260617 07:53:22.564651 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 378) took 3780 ms. Trace:
W20260617 07:53:22.564805 986 consensus_peers.cc:597] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:22.565759 713 leader_election.cc:343] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: d03d6dc473fc4be1a436fd71a06f403e
I20260617 07:53:22.565893 713 leader_election.cc:304] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:22.566344 713 leader_election.cc:343] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 3aa1c1fdede041d28570b85e63c401b7
I20260617 07:53:22.566445 713 leader_election.cc:304] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
W20260617 07:53:22.566805 713 leader_election.cc:343] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 66140c5d364f453a8089f143cc96ede8
I20260617 07:53:22.566879 713 leader_election.cc:304] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:22.567183 2629 raft_consensus.cc:493] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.567307 2629 raft_consensus.cc:515] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.568073 2629 leader_election.cc:290] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:22.568542 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet f30f0bbfdf404569a417662861b06f73 with delete_type TABLET_DATA_DELETED (replaced by tablet a969954e858843698b07681fd32cd611) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:22.568938 1178 ts_tablet_manager.cc:1434] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260617 07:53:22.569124 2644 raft_consensus.cc:2749] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.569283 2644 raft_consensus.cc:2749] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.569334 1172 tablet_bootstrap.cc:492] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.569394 2644 raft_consensus.cc:2749] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.569445 1172 ts_tablet_manager.cc:1403] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.278s user 0.036s sys 0.057s
I20260617 07:53:22.571832 1862 raft_consensus.cc:2243] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.571981 1862 raft_consensus.cc:2272] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.572590 1862 ts_tablet_manager.cc:1916] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.574144 1178 tablet_bootstrap.cc:492] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:22.575677 1178 tablet_bootstrap.cc:654] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.577214 456 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet a864e276dfc1439e8d1086475d8d6d3a
I20260617 07:53:22.578258 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 488cc3a082b14dee8f70153e6f2925a4 (table default.Table_43f3f6d0ce9c485d90bac2d86ec29f39 [id=ab7b996d094f49df9532f308d8615d08]) successfully deleted
I20260617 07:53:22.580291 1172 raft_consensus.cc:359] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.580549 1172 raft_consensus.cc:385] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.580665 1172 raft_consensus.cc:740] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.580623 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14a3cb5e50b42b18ffda6f38cdfdd73" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:22.581024 1172 consensus_queue.cc:260] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.581149 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770a5216299842b890d483ca37b0ee86" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.581985 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a900aecf46e4430cb7ccdecd54376193" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:22.583586 1862 ts_tablet_manager.cc:1929] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.583673 1862 log.cc:1199] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/eba5976fcadd4add9c671300b431617b
I20260617 07:53:22.583963 1862 ts_tablet_manager.cc:1950] T eba5976fcadd4add9c671300b431617b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.584285 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdf8f714539449d8862cd2a2336fbe9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:22.584784 986 leader_election.cc:343] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.584841 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9618a5c0c9dd4c368f5763c434f70da5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:22.589295 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770a5216299842b890d483ca37b0ee86" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:22.590216 1172 ts_tablet_manager.cc:1434] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260617 07:53:22.598080 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 572) took 1259 ms. Trace:
I20260617 07:53:22.598634 1862 rpcz_store.cc:276] 0617 07:53:21.338961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.339132 (+ 171us) service_pool.cc:224] Handling call
0617 07:53:22.534754 (+1195622us) ts_tablet_manager.cc:1151] Deleting tablet eba5976fcadd4add9c671300b431617b
0617 07:53:22.534765 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.575615 (+ 40850us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.583539 (+ 7924us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.598058 (+ 14519us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36785,"tablet-delete.queue_time_us":1195465}
I20260617 07:53:22.599737 1178 tablet_bootstrap.cc:492] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.599927 1178 ts_tablet_manager.cc:1403] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.002s
W20260617 07:53:22.603392 713 leader_election.cc:343] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 3ae9261c0ac94defaecfc7d14ba1ae61
I20260617 07:53:22.603600 713 leader_election.cc:304] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:22.604671 2715 raft_consensus.cc:2749] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.611440 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_138f2e00f28c4300b2ac9c69b77c2cfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:22.612394 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c7c85ec02b084cebbe2e437afa71f3e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:22.613816 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_73a149c5190c4fe38934f947932e0d6c" } new_table_name: "default.Table_dedabee714284438970630039e5ab9b3" modify_external_catalogs: true
I20260617 07:53:22.604393 1172 tablet_bootstrap.cc:492] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.615640 1172 tablet_bootstrap.cc:654] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.625762 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_d0e5b3d77c244306b561180dd78f6fa2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:22.630360 1178 raft_consensus.cc:359] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.630605 1178 raft_consensus.cc:385] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.630657 1846 ts_tablet_manager.cc:1929] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.630858 1846 log.cc:1199] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/de030009192748118b388eec555d90da
I20260617 07:53:22.631265 1846 ts_tablet_manager.cc:1950] T de030009192748118b388eec555d90da P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:22.630694 1178 raft_consensus.cc:740] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.631655 1178 consensus_queue.cc:260] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:22.600402 852 leader_election.cc:343] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.632797 1178 ts_tablet_manager.cc:1434] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.033s user 0.000s sys 0.002s
I20260617 07:53:22.632898 1862 tablet_replica.cc:333] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.635550 1178 tablet_bootstrap.cc:492] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:22.637428 1178 tablet_bootstrap.cc:654] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:22.633015 852 leader_election.cc:343] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.641700 1862 raft_consensus.cc:2243] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:22.641929 1862 pending_rounds.cc:70] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:22.641993 1862 pending_rounds.cc:77] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772757190930432 op_type: NO_OP noop_request { }
I20260617 07:53:22.642083 1862 raft_consensus.cc:2889] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:22.642156 1862 raft_consensus.cc:2272] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:22.642465 852 leader_election.cc:343] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:22.642827 852 leader_election.cc:343] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.642948 1862 ts_tablet_manager.cc:1916] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.635278 1171 tablet_bootstrap.cc:492] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:22.645893 1171 ts_tablet_manager.cc:1403] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.286s user 0.003s sys 0.007s
I20260617 07:53:22.646525 1171 raft_consensus.cc:359] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.646741 1171 raft_consensus.cc:385] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.646782 1171 raft_consensus.cc:740] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.646955 1171 consensus_queue.cc:260] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.647333 1171 ts_tablet_manager.cc:1434] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 07:53:22.647567 1171 tablet_bootstrap.cc:492] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:22.649015 1171 tablet_bootstrap.cc:654] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:22.650688 988 leader_election.cc:343] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.650835 988 leader_election.cc:304] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:22.651234 988 leader_election.cc:343] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.651324 988 leader_election.cc:304] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:22.651655 2629 raft_consensus.cc:2749] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.651849 2629 raft_consensus.cc:2749] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.654959 2708 raft_consensus.cc:493] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.655090 2708 raft_consensus.cc:515] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.655730 2708 leader_election.cc:290] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.660503 882 tablet_service.cc:1558] Processing DeleteTablet for tablet f30f0bbfdf404569a417662861b06f73 with delete_type TABLET_DATA_DELETED (replaced by tablet a969954e858843698b07681fd32cd611) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.668445 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d4662c1ccdd2449f84a550db4c839b28" } new_table_name: "default.Table_0a3622a666594847848eb4982fd1316a" modify_external_catalogs: true
W20260617 07:53:22.669876 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_138f2e00f28c4300b2ac9c69b77c2cfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:22.671262 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7c85ec02b084cebbe2e437afa71f3e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:22.570353 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 561c8bf9e5c840628ab1c8cf91dc2d93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 561c8bf9e5c840628ab1c8cf91dc2d93 already in progress: creating tablet
W20260617 07:53:22.672503 448 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 102131us
W20260617 07:53:22.672785 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 843c2afd54ee451a948cc8b92c556a31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 843c2afd54ee451a948cc8b92c556a31 already in progress: creating tablet
W20260617 07:53:22.673055 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e9bed1de333b4944a9a72ae26a9f8542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9bed1de333b4944a9a72ae26a9f8542 already in progress: creating tablet
W20260617 07:53:22.673286 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e793cbccf5774e95a8316d6298d4646f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e793cbccf5774e95a8316d6298d4646f already in progress: creating tablet
I20260617 07:53:22.675007 1171 tablet_bootstrap.cc:492] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:22.675196 1171 ts_tablet_manager.cc:1403] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
I20260617 07:53:22.676010 1171 raft_consensus.cc:359] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.676239 1171 raft_consensus.cc:385] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.676342 1171 raft_consensus.cc:740] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.676581 1171 consensus_queue.cc:260] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.677330 422 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu pid 1856
I20260617 07:53:22.677840 1171 ts_tablet_manager.cc:1434] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:22.678143 1171 tablet_bootstrap.cc:492] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:22.682682 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1382fc75785e4b07bf1688fa5385500a consensus state has no leader
I20260617 07:53:22.684322 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5364dfe28b8d4042941c8d8d4d1cf503" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.693609 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet b4c9a032007a412e95bbd2b229edd50b (table default.Table_94149217b8fd42f3a46ed6df137e9f82 [id=251c405acf1c444ca8d6817889ffeed5]) successfully deleted
W20260617 07:53:22.694474 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because the tablet was not found. No further retry: Not found: Tablet not found: 98f7c3f6260c4db690de1a5081bb2493
W20260617 07:53:22.695524 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 49f0f68dcef34228a1b2a018e8aa329e because the tablet was not found. No further retry: Not found: Tablet not found: 49f0f68dcef34228a1b2a018e8aa329e
I20260617 07:53:22.696391 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]) successfully deleted
I20260617 07:53:22.697410 1171 tablet_bootstrap.cc:654] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:22.698127 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 60d1b4975077493eb6919b23d6523d3d because the tablet was not found. No further retry: Not found: Tablet not found: 60d1b4975077493eb6919b23d6523d3d
W20260617 07:53:22.699436 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 421ad54782ac4ea1bef756a0129b3f21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 421ad54782ac4ea1bef756a0129b3f21 already in progress: creating tablet
I20260617 07:53:22.701341 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 35120ce002f24f2bb1ea0fdc59fbfc9d (table default.Table_8cb4ea8e1a39478fa0b788e049009950 [id=c1fbbdf211d24d72bc0673e2ab662d23]) successfully deleted
W20260617 07:53:22.702965 852 leader_election.cc:343] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.707835 2710 raft_consensus.cc:493] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.708004 2710 raft_consensus.cc:515] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.708743 2710 leader_election.cc:290] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.708987 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet eba5976fcadd4add9c671300b431617b (table default.Table_b6be9e1dd8ce4fdcbe94cb8a7b2f1abb [id=ee23302b46474cb096ae93bc49011eeb]) successfully deleted
I20260617 07:53:22.710176 1862 ts_tablet_manager.cc:1929] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:22.710359 1862 log.cc:1199] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/e9488e8a501e404f85540fb045d8916f
W20260617 07:53:22.709573 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0e5b3d77c244306b561180dd78f6fa2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.711162 2715 raft_consensus.cc:493] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.711349 2715 raft_consensus.cc:515] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.711767 1172 tablet_bootstrap.cc:492] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.711972 1172 ts_tablet_manager.cc:1403] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.108s user 0.001s sys 0.004s
I20260617 07:53:22.712776 1172 raft_consensus.cc:359] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.712961 1172 raft_consensus.cc:385] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.713016 1172 raft_consensus.cc:740] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:22.712996 716 leader_election.cc:343] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 6f2d9e473fd444efa6ab63cc51dbb2bd
I20260617 07:53:22.713271 1172 consensus_queue.cc:260] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.713495 2715 leader_election.cc:290] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.716063 1862 ts_tablet_manager.cc:1950] T e9488e8a501e404f85540fb045d8916f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.564761 1170 rpcz_store.cc:276] 0617 07:53:18.784457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.784659 (+ 202us) service_pool.cc:224] Handling call
0617 07:53:22.564553 (+3779894us) ts_tablet_manager.cc:1151] Deleting tablet 63bf519b83c445798bddda3120b542ce
0617 07:53:22.564563 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.564636 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3779744}
I20260617 07:53:22.716536 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 573) took 1377 ms. Trace:
I20260617 07:53:22.716666 1862 rpcz_store.cc:276] 0617 07:53:21.339048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.339310 (+ 262us) service_pool.cc:224] Handling call
0617 07:53:22.632853 (+1293543us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:22.632863 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.674938 (+ 42075us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.710108 (+ 35170us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.716525 (+ 6417us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1293424}
I20260617 07:53:22.717131 1862 tablet_replica.cc:333] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.717372 1862 raft_consensus.cc:2243] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:22.720177 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 63bf519b83c445798bddda3120b542ce because the tablet was not found. No further retry: Not found: Tablet not found: 63bf519b83c445798bddda3120b542ce
I20260617 07:53:22.721161 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet e9488e8a501e404f85540fb045d8916f (table default.Table_bd56bbbe6c6146e0aed7c57090a64d9a [id=5a246dffaba54437a4400032419c5354]) successfully deleted
I20260617 07:53:22.724745 1170 tablet_replica.cc:333] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:22.725121 1171 tablet_bootstrap.cc:492] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:22.726372 1170 raft_consensus.cc:2243] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.726548 1170 raft_consensus.cc:2272] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.726804 1171 ts_tablet_manager.cc:1403] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.001s
I20260617 07:53:22.728089 1170 ts_tablet_manager.cc:1916] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:22.728940 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 77706.3us
I20260617 07:53:22.730353 1862 raft_consensus.cc:2272] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.730916 1862 ts_tablet_manager.cc:1916] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:22.731444 988 leader_election.cc:343] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.731937 1171 raft_consensus.cc:359] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.732532 988 leader_election.cc:304] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:22.732743 1178 tablet_bootstrap.cc:492] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.732952 1178 ts_tablet_manager.cc:1403] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.098s user 0.001s sys 0.003s
W20260617 07:53:22.733170 988 leader_election.cc:343] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.733587 1171 raft_consensus.cc:385] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.733824 1171 raft_consensus.cc:740] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.733829 1178 raft_consensus.cc:359] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.734100 1178 raft_consensus.cc:385] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.734212 1178 raft_consensus.cc:740] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.734481 1178 consensus_queue.cc:260] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.734879 1171 consensus_queue.cc:260] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.739027 988 leader_election.cc:304] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:22.739243 988 raft_consensus.cc:2686] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260617 07:53:22.739708 988 leader_election.cc:343] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.739880 988 leader_election.cc:304] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:22.740990 1171 ts_tablet_manager.cc:1434] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260617 07:53:22.741302 1171 tablet_bootstrap.cc:492] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:22.741842 2629 raft_consensus.cc:2749] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.742066 2629 consensus_queue.cc:1048] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:22.742583 2629 raft_consensus.cc:2749] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:22.744836 1171 tablet_bootstrap.cc:654] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.753803 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8f144d04af4ea18f99aee3b82f4a28" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.769775 1172 ts_tablet_manager.cc:1434] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.058s user 0.001s sys 0.002s
I20260617 07:53:22.771917 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2cd3859046ff474fa0cd1bdc9145099c" } new_table_name: "default.Table_677aba508baf46ab8247a3d1b109fb23" modify_external_catalogs: true
I20260617 07:53:22.773473 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f72d36eff72c4d83b7930336185143de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:22.773624 2708 raft_consensus.cc:493] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.773787 2708 raft_consensus.cc:515] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:22.774315 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f72d36eff72c4d83b7930336185143de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.774351 2708 leader_election.cc:290] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.777309 1178 ts_tablet_manager.cc:1434] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.044s user 0.002s sys 0.000s
I20260617 07:53:22.777798 1178 tablet_bootstrap.cc:492] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:22.780252 1178 tablet_bootstrap.cc:654] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.785072 1172 tablet_bootstrap.cc:492] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.794602 2629 raft_consensus.cc:493] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.794759 2629 raft_consensus.cc:515] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.834251 2629 leader_election.cc:290] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:22.839591 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c3bf1860c34ee3821bf273234cb0a4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.840179 1178 tablet_bootstrap.cc:492] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.840324 1178 ts_tablet_manager.cc:1403] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.001s
I20260617 07:53:22.841043 1178 raft_consensus.cc:359] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.841213 1178 raft_consensus.cc:385] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.841261 1178 raft_consensus.cc:740] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.841452 1178 consensus_queue.cc:260] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.841965 1178 ts_tablet_manager.cc:1434] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:22.841933 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55d63a25a2845dbbcce20e560361007" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:22.842583 1178 tablet_bootstrap.cc:492] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:22.842738 986 leader_election.cc:343] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.844048 1178 tablet_bootstrap.cc:654] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.845862 2719 raft_consensus.cc:493] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.846024 2719 raft_consensus.cc:515] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.847076 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9ebb0aa425c346c8a16082be1e0d84d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.847702 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ebb0aa425c346c8a16082be1e0d84d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.853958 2719 leader_election.cc:290] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:22.854511 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369442b72f754ee08dc6a484d51f2e99" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:22.855048 986 leader_election.cc:343] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.858906 1172 tablet_bootstrap.cc:654] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.859216 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 530) took 3833 ms. Trace:
I20260617 07:53:22.859342 1846 rpcz_store.cc:276] 0617 07:53:18.988107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.988149 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:22.492280 (+3504131us) ts_tablet_manager.cc:1151] Deleting tablet de030009192748118b388eec555d90da
0617 07:53:22.492293 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.591561 (+ 99268us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.630597 (+ 39036us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.821689 (+191092us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3440213}
W20260617 07:53:22.860801 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 121088us
I20260617 07:53:22.862067 1171 tablet_bootstrap.cc:492] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:22.862221 1171 ts_tablet_manager.cc:1403] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.121s user 0.017s sys 0.012s
I20260617 07:53:22.862911 1171 raft_consensus.cc:359] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.863101 1171 raft_consensus.cc:385] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.863168 1171 raft_consensus.cc:740] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.863384 1171 consensus_queue.cc:260] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.863879 1171 ts_tablet_manager.cc:1434] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260617 07:53:22.872751 986 consensus_peers.cc:597] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:22.877118 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 571) took 3884 ms. Trace:
I20260617 07:53:22.877328 1846 rpcz_store.cc:276] 0617 07:53:18.992790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.061393 (+ 68603us) service_pool.cc:224] Handling call
0617 07:53:22.876973 (+3815580us) ts_tablet_manager.cc:1151] Deleting tablet 68b448c65e684f49bf142ce2b5084d33
0617 07:53:22.876986 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.877096 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3815360}
I20260617 07:53:22.877926 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 573) took 3816 ms. Trace:
I20260617 07:53:22.878079 1846 rpcz_store.cc:276] 0617 07:53:19.061633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.061670 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:22.877806 (+3816136us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:22.877817 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.877907 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3815969}
I20260617 07:53:22.878192 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_bb35b478e847496f90b3ddb167a02383"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:22.878427 1846 tablet_replica.cc:333] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:22.878623 1846 raft_consensus.cc:2243] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.878772 1846 raft_consensus.cc:2272] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:22.878819 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb35b478e847496f90b3ddb167a02383 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.879348 1846 ts_tablet_manager.cc:1916] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.879429 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5364dfe28b8d4042941c8d8d4d1cf503" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:22.879594 1052 raft_consensus.cc:2468] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:22.880354 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0ef664bf28d1471db39370a9172cc5b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.881042 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ef664bf28d1471db39370a9172cc5b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.881374 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ac940c0f5a9d49babeff827981e9d7d3" } new_table_name: "default.Table_66e18dae23c5456d8125c43c3c21fbac" modify_external_catalogs: true
I20260617 07:53:22.893178 2729 raft_consensus.cc:493] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.893347 2729 raft_consensus.cc:515] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.894043 2729 leader_election.cc:290] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:22.894840 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5053b7c24964dee880890fbb803ce7b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:22.895556 986 leader_election.cc:343] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:22.901612 852 leader_election.cc:343] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.907300 1172 tablet_bootstrap.cc:492] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.907483 1172 ts_tablet_manager.cc:1403] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.123s user 0.009s sys 0.001s
I20260617 07:53:22.908143 1172 raft_consensus.cc:359] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.908318 1172 raft_consensus.cc:385] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.908370 1172 raft_consensus.cc:740] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.908591 1172 consensus_queue.cc:260] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.911321 1170 ts_tablet_manager.cc:1929] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.911479 1170 log.cc:1199] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/9618a5c0c9dd4c368f5763c434f70da5
I20260617 07:53:22.911509 1178 tablet_bootstrap.cc:492] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:22.911651 1178 ts_tablet_manager.cc:1403] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.000s
I20260617 07:53:22.911957 1170 ts_tablet_manager.cc:1950] T 9618a5c0c9dd4c368f5763c434f70da5 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:22.912381 1178 raft_consensus.cc:359] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.912570 1178 raft_consensus.cc:385] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.912629 1178 raft_consensus.cc:740] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.912809 1178 consensus_queue.cc:260] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.915529 452 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:22.915781 452 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:22.918200 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 377) took 4133 ms. Trace:
I20260617 07:53:22.918283 1170 rpcz_store.cc:276] 0617 07:53:18.784379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.784593 (+ 214us) service_pool.cc:224] Handling call
0617 07:53:22.724695 (+3940102us) ts_tablet_manager.cc:1151] Deleting tablet 9618a5c0c9dd4c368f5763c434f70da5
0617 07:53:22.724706 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.887733 (+163027us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.910300 (+ 22567us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.918185 (+ 7885us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3939803}
I20260617 07:53:22.918459 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:22.918709 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 9618a5c0c9dd4c368f5763c434f70da5 (table default.Table_1f40cdfe73f54202b6223af377958372 [id=347683dc11c24e8e9f2e9eff1d671045]) successfully deleted
I20260617 07:53:22.920890 851 leader_election.cc:304] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
W20260617 07:53:22.921041 459 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:46601 (request call id 232) took 785 ms (client timeout 1000 ms). Trace:
W20260617 07:53:22.921142 459 rpcz_store.cc:269] 0617 07:53:22.135156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.279459 (+144303us) service_pool.cc:224] Handling call
0617 07:53:22.920983 (+641524us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":9}
I20260617 07:53:22.921232 2710 raft_consensus.cc:2804] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:22.921308 2710 raft_consensus.cc:493] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:22.921372 2710 raft_consensus.cc:3060] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:22.923396 852 leader_election.cc:343] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.924886 2710 raft_consensus.cc:515] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.925860 1170 tablet_replica.cc:333] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:22.926196 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet de030009192748118b388eec555d90da (table default.Table_a562036b19dd4c99a8981180a617b865 [id=22c75406c0674d11b3f9fd39af55cca8]) successfully deleted
W20260617 07:53:22.926911 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 68b448c65e684f49bf142ce2b5084d33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68b448c65e684f49bf142ce2b5084d33 already in progress: creating tablet
I20260617 07:53:22.925952 880 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.926275 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d with delete_type TABLET_DATA_DELETED (replaced by tablet c449d3e251aa4f06a9191114bff0e0e2) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.926505 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 5364dfe28b8d4042941c8d8d4d1cf503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:22.926704 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 with delete_type TABLET_DATA_DELETED (replaced by tablet f395f963a5a5400a966a8d4cc62aadf1) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:22.927497 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e9488e8a501e404f85540fb045d8916f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9488e8a501e404f85540fb045d8916f already in progress: creating tablet
I20260617 07:53:22.925705 2710 leader_election.cc:290] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:22.914947 1172 ts_tablet_manager.cc:1434] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:22.915341 2729 raft_consensus.cc:493] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:22.927850 2729 raft_consensus.cc:515] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.915925 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c3bf1860c34ee3821bf273234cb0a4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:22.928890 1047 raft_consensus.cc:2468] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:22.928927 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11794aa70824476e9751a41ab305cc80" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:22.929488 986 leader_election.cc:343] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:22.932018 2729 leader_election.cc:290] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:22.932191 1170 raft_consensus.cc:2243] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.932543 1170 raft_consensus.cc:2272] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.933104 1170 ts_tablet_manager.cc:1916] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:22.928927 713 leader_election.cc:343] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 6f2d9e473fd444efa6ab63cc51dbb2bd
I20260617 07:53:22.934185 1172 tablet_bootstrap.cc:492] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.934770 889 tablet_service.cc:1511] Processing CreateTablet for tablet 6c585b1531264ed2aee9d7e2626e7087 (DEFAULT_TABLE table=default.Table_ef9bd7437e0247ff91a297900a69d739 [id=3f2053f059f34c769615079988d55eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.935318 898 tablet_service.cc:1511] Processing CreateTablet for tablet 1f74171ee2674ec7922bb77c13050d93 (DEFAULT_TABLE table=default.Table_ce78660edab64a4d973c183fa5f3e33e [id=f6349cfbe5264985a80d42829e97ebbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.935568 1172 tablet_bootstrap.cc:654] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.935930 882 tablet_service.cc:1511] Processing CreateTablet for tablet d09307157e5d4794aca50faccafa6004 (DEFAULT_TABLE table=default.Table_b6a829d6282344d28e1edc117789070d [id=b4ca582233ea46c0af982ce428325869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.936194 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 6c585b1531264ed2aee9d7e2626e7087 (DEFAULT_TABLE table=default.Table_ef9bd7437e0247ff91a297900a69d739 [id=3f2053f059f34c769615079988d55eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.936568 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c585b1531264ed2aee9d7e2626e7087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.933914 713 leader_election.cc:304] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:22.937424 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55d63a25a2845dbbcce20e560361007" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:22.938058 1171 tablet_bootstrap.cc:492] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:22.940835 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369442b72f754ee08dc6a484d51f2e99" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:22.941340 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c585b1531264ed2aee9d7e2626e7087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.945906 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f74171ee2674ec7922bb77c13050d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.948278 1862 ts_tablet_manager.cc:1929] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.948387 1862 log.cc:1199] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/65bf5384ec244d36ba3d4e781c5eb8a3
I20260617 07:53:22.948694 1862 ts_tablet_manager.cc:1950] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:22.950016 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09307157e5d4794aca50faccafa6004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.950250 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8dbb24d4baa74d3ead856d3868c80b58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:22.950848 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dbb24d4baa74d3ead856d3868c80b58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.952302 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4aca29909fcd4a02bcc1120e759db2c4" } new_table_name: "default.Table_c8dd3b348f2c4e7080c88df6828cd2db" modify_external_catalogs: true
I20260617 07:53:22.954728 1021 tablet_service.cc:1511] Processing CreateTablet for tablet d09307157e5d4794aca50faccafa6004 (DEFAULT_TABLE table=default.Table_b6a829d6282344d28e1edc117789070d [id=b4ca582233ea46c0af982ce428325869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.955224 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09307157e5d4794aca50faccafa6004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.958020 1171 tablet_bootstrap.cc:654] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:22.958068 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 345770b456d64fedba27347674a70900 (DEFAULT_TABLE table=default.Table_23f74c07c322499982b3fcbc0ce236ce [id=c0634ea0ff174ad7b033d399c7ba414c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.958426 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345770b456d64fedba27347674a70900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.958853 1170 ts_tablet_manager.cc:1929] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.958940 1170 log.cc:1199] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/11794aa70824476e9751a41ab305cc80
I20260617 07:53:22.959239 1170 ts_tablet_manager.cc:1950] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:22.959646 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 376) took 4175 ms. Trace:
I20260617 07:53:22.959721 1170 rpcz_store.cc:276] 0617 07:53:18.784286 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.784842 (+ 556us) service_pool.cc:224] Handling call
0617 07:53:22.925814 (+4140972us) ts_tablet_manager.cc:1151] Deleting tablet 11794aa70824476e9751a41ab305cc80
0617 07:53:22.925823 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.932438 (+ 6615us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x616000113854. stack: 00007f0ee639d086 00007f0ee639ce40 00007f0ee53563ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f0ef23d17e0 00007f0ef371d933 00007f0ef62e0ae7 00007f0ef6313bb4 00007f0ef62f45d0 00007f0ef62f435d 0000000000aa681c 00007f0ee63e2f6f 00007f0ee63e628b 00007f0ee63e6108
0617 07:53:22.943944 (+ 11506us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.958803 (+ 14859us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.959630 (+ 827us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13887744,"tablet-delete.queue_time_us":4140841}
I20260617 07:53:22.960980 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 574) took 1621 ms. Trace:
I20260617 07:53:22.961069 1862 rpcz_store.cc:276] 0617 07:53:21.339139 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.339521 (+ 382us) service_pool.cc:224] Handling call
0617 07:53:22.717091 (+1377570us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:22.717100 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.737640 (+ 20540us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.948226 (+210586us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.960956 (+ 12730us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12766,"tablet-delete.queue_time_us":1377349}
I20260617 07:53:22.961545 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 579) took 1368 ms. Trace:
I20260617 07:53:22.961621 1862 rpcz_store.cc:276] 0617 07:53:21.592869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.592918 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:22.961396 (+1368478us) ts_tablet_manager.cc:1151] Deleting tablet 5f4a8b06f77643dcb28f0c3136510253
0617 07:53:22.961408 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.961527 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1368288}
I20260617 07:53:22.962013 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 580) took 1368 ms. Trace:
I20260617 07:53:22.962013 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 797867621cb94efb8ff9d3689a9d6745 (DEFAULT_TABLE table=default.Table_3a27cafa0dc14d528e8a5f7c214b14a9 [id=198d450ba28b44a5abc506eeccd394ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.962085 1862 rpcz_store.cc:276] 0617 07:53:21.593254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.593300 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:22.961900 (+1368600us) ts_tablet_manager.cc:1151] Deleting tablet 6343f3d909ac4438b882283ab2b25a6d
0617 07:53:22.961909 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.961998 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1368472}
I20260617 07:53:22.962340 1862 tablet_replica.cc:333] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:22.962373 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797867621cb94efb8ff9d3689a9d6745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.962529 1862 raft_consensus.cc:2243] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:22.962796 1862 raft_consensus.cc:2272] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.963339 1862 ts_tablet_manager.cc:1916] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.964742 1172 tablet_bootstrap.cc:492] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:22.964857 1172 ts_tablet_manager.cc:1403] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.001s
I20260617 07:53:22.965495 1172 raft_consensus.cc:359] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.965631 1172 raft_consensus.cc:385] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:22.965751 1172 raft_consensus.cc:740] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:22.954736 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 2372cb9ae6e343be945b1e8d2db86894 (DEFAULT_TABLE table=default.Table_0cc937610f884774b7b7c3d5c1739d85 [id=5d617c837f1746238fd385037793a0dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.965956 1172 consensus_queue.cc:260] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:22.966131 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2372cb9ae6e343be945b1e8d2db86894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.967818 880 tablet_service.cc:1511] Processing CreateTablet for tablet 797867621cb94efb8ff9d3689a9d6745 (DEFAULT_TABLE table=default.Table_3a27cafa0dc14d528e8a5f7c214b14a9 [id=198d450ba28b44a5abc506eeccd394ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.968147 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797867621cb94efb8ff9d3689a9d6745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.969061 1172 ts_tablet_manager.cc:1434] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:22.969317 1172 tablet_bootstrap.cc:492] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:22.970803 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 65bf5384ec244d36ba3d4e781c5eb8a3 (table default.Table_0b705f18dfe34487821e76d515b4a2be [id=d3c16f845bc84f5f916ae4a5cf3e8254]) successfully deleted
I20260617 07:53:22.970893 1172 tablet_bootstrap.cc:654] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:22.971210 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 5f4a8b06f77643dcb28f0c3136510253 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f4a8b06f77643dcb28f0c3136510253 already in progress: creating tablet
I20260617 07:53:22.973999 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 1f74171ee2674ec7922bb77c13050d93 (DEFAULT_TABLE table=default.Table_ce78660edab64a4d973c183fa5f3e33e [id=f6349cfbe5264985a80d42829e97ebbb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:22.977926 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6343f3d909ac4438b882283ab2b25a6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6343f3d909ac4438b882283ab2b25a6d already in progress: creating tablet
I20260617 07:53:22.978628 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f74171ee2674ec7922bb77c13050d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.978971 882 tablet_service.cc:1511] Processing CreateTablet for tablet 2372cb9ae6e343be945b1e8d2db86894 (DEFAULT_TABLE table=default.Table_0cc937610f884774b7b7c3d5c1739d85 [id=5d617c837f1746238fd385037793a0dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.979187 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 11794aa70824476e9751a41ab305cc80 (table default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]) successfully deleted
I20260617 07:53:22.980098 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2372cb9ae6e343be945b1e8d2db86894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.985919 1170 tablet_replica.cc:333] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:22.986214 1170 raft_consensus.cc:2243] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.986438 1170 raft_consensus.cc:2272] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:22.987051 1170 ts_tablet_manager.cc:1916] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:22.989481 1846 ts_tablet_manager.cc:1929] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:22.980464 898 tablet_service.cc:1511] Processing CreateTablet for tablet 345770b456d64fedba27347674a70900 (DEFAULT_TABLE table=default.Table_23f74c07c322499982b3fcbc0ce236ce [id=c0634ea0ff174ad7b033d399c7ba414c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:22.994185 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345770b456d64fedba27347674a70900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:22.999197 1846 log.cc:1199] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/0fd8cedb539748dc917128511325bbcc
I20260617 07:53:22.999624 1846 ts_tablet_manager.cc:1950] T 0fd8cedb539748dc917128511325bbcc P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:23.000445 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ed31a6d0c55a4a94a78094d742064d5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.001142 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed31a6d0c55a4a94a78094d742064d5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.003862 1170 ts_tablet_manager.cc:1929] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:23.005100 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_11b717f1db3545778db3e785dec6d463"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.005808 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11b717f1db3545778db3e785dec6d463 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:22.996416 880 tablet_service.cc:1511] Processing CreateTablet for tablet 8dead95cfb624c3ca99069465813fea6 (DEFAULT_TABLE table=default.Table_c2b4123400f94ed9b7d9c4de82728499 [id=fed468f65d2746c88671637d0199846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.007918 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dead95cfb624c3ca99069465813fea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.009671 460 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:23.010061 460 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 2 got 0
I20260617 07:53:23.010413 460 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]). Expected version 1 got 0
I20260617 07:53:23.019019 1170 log.cc:1199] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/eb75a965740344c2bd0b68a8dda28be5
I20260617 07:53:23.019649 1170 ts_tablet_manager.cc:1950] T eb75a965740344c2bd0b68a8dda28be5 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:23.022055 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 383) took 4224 ms. Trace:
I20260617 07:53:23.022712 1170 rpcz_store.cc:276] 0617 07:53:18.797254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.797310 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:22.985860 (+4188550us) ts_tablet_manager.cc:1151] Deleting tablet eb75a965740344c2bd0b68a8dda28be5
0617 07:53:22.985875 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.993104 (+ 7229us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.003799 (+ 10695us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.022036 (+ 18237us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4188345}
I20260617 07:53:23.026183 1170 tablet_replica.cc:333] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:23.026494 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet eb75a965740344c2bd0b68a8dda28be5 (table default.Table_a50118b40547426eaf2f40d1b0cfb2e1 [id=ba294aac4e6b4461a2b993764f836732]) successfully deleted
I20260617 07:53:23.026851 1170 raft_consensus.cc:2243] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:22.997126 2743 tablet.cc:1724] T 58ba8963530d49a89fe4eb626225377d P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.027992 1170 raft_consensus.cc:2272] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.028807 1862 ts_tablet_manager.cc:1929] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 07:53:23.029114 1862 log.cc:1199] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/cc4d21f9ad9543b0b90fc66f1a6e3b13
I20260617 07:53:23.029129 1170 ts_tablet_manager.cc:1916] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.029817 1862 ts_tablet_manager.cc:1950] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:23.031246 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 146d1b46891a416aafe55aa740e1569e
I20260617 07:53:23.033253 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 146d1b46891a416aafe55aa740e1569e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.033672 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 582) took 1435 ms. Trace:
I20260617 07:53:23.035496 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 89fe6f819bed46c189951747fc2a9560 (DEFAULT_TABLE table=default.Table_9f1c5148c98f470a88b93558ee1c10bc [id=60ba41520ab04ce5a11fc3f8a133d978]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.036319 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fe6f819bed46c189951747fc2a9560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.035869 2708 raft_consensus.cc:493] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.039484 2708 raft_consensus.cc:515] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.039636 2729 raft_consensus.cc:493] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.039750 2729 raft_consensus.cc:515] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.040109 2708 leader_election.cc:290] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.040280 2729 leader_election.cc:290] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:23.040984 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be19ece3a0a4a51abad7b8e2f3b2420" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.041664 889 tablet_service.cc:1511] Processing CreateTablet for tablet 89fe6f819bed46c189951747fc2a9560 (DEFAULT_TABLE table=default.Table_9f1c5148c98f470a88b93558ee1c10bc [id=60ba41520ab04ce5a11fc3f8a133d978]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.042094 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fe6f819bed46c189951747fc2a9560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.042460 1862 rpcz_store.cc:276] 0617 07:53:21.597895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.597950 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:22.962296 (+1364346us) ts_tablet_manager.cc:1151] Deleting tablet cc4d21f9ad9543b0b90fc66f1a6e3b13
0617 07:53:22.962305 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.007241 (+ 44936us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.028754 (+ 21513us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.033655 (+ 4901us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364165}
I20260617 07:53:23.043289 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_8dd1d9e74c1245e1afe42a16f20e57f6 [id=3824f4c443804be49d851e39e23ce3f7]) successfully deleted
W20260617 07:53:23.046164 986 leader_election.cc:343] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.047079 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ccca21d62d364154831f9ccd2cfd2c1d" } modify_external_catalogs: true
I20260617 07:53:23.047263 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ccca21d62d364154831f9ccd2cfd2c1d" } modify_external_catalogs: true
I20260617 07:53:23.049115 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 591) took 1418 ms. Trace:
I20260617 07:53:23.049526 1862 rpcz_store.cc:276] 0617 07:53:21.630476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.630547 (+ 71us) service_pool.cc:224] Handling call
0617 07:53:23.049003 (+1418456us) ts_tablet_manager.cc:1151] Deleting tablet f249a9d29de54c959dbae1751501daee
0617 07:53:23.049013 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.049097 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1418265}
W20260617 07:53:23.051599 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet f249a9d29de54c959dbae1751501daee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f249a9d29de54c959dbae1751501daee already in progress: creating tablet
I20260617 07:53:23.051548 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 592) took 1420 ms. Trace:
I20260617 07:53:23.052007 1862 rpcz_store.cc:276] 0617 07:53:21.631058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.631113 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:23.051441 (+1420328us) ts_tablet_manager.cc:1151] Deleting tablet 83878d63683d49a6836ed0f925397e61
0617 07:53:23.051450 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.051533 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1420156}
W20260617 07:53:23.052428 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 83878d63683d49a6836ed0f925397e61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83878d63683d49a6836ed0f925397e61 already in progress: creating tablet
I20260617 07:53:23.053390 1862 tablet_replica.cc:333] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:23.054432 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1
I20260617 07:53:23.056252 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.056016 1862 raft_consensus.cc:2243] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.056701 1862 raft_consensus.cc:2272] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.057189 1862 ts_tablet_manager.cc:1916] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.058473 2715 raft_consensus.cc:2749] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:23.058507 713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 129585us
I20260617 07:53:23.059042 1178 ts_tablet_manager.cc:1434] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.147s user 0.001s sys 0.001s
I20260617 07:53:23.059391 1178 tablet_bootstrap.cc:492] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:23.060088 851 leader_election.cc:343] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 6d8f144d04af4ea18f99aee3b82f4a28
I20260617 07:53:23.060197 851 leader_election.cc:304] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:23.060184 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5364dfe28b8d4042941c8d8d4d1cf503" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:23.060762 2709 raft_consensus.cc:2749] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.060887 744 tablet_service.cc:1511] Processing CreateTablet for tablet 6c585b1531264ed2aee9d7e2626e7087 (DEFAULT_TABLE table=default.Table_ef9bd7437e0247ff91a297900a69d739 [id=3f2053f059f34c769615079988d55eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.061079 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 572) took 3999 ms. Trace:
I20260617 07:53:23.061260 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c585b1531264ed2aee9d7e2626e7087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.061154 1846 rpcz_store.cc:276] 0617 07:53:19.061503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.061959 (+ 456us) service_pool.cc:224] Handling call
0617 07:53:22.878382 (+3816423us) ts_tablet_manager.cc:1151] Deleting tablet 0fd8cedb539748dc917128511325bbcc
0617 07:53:22.878392 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:22.952630 (+ 74238us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:22.989428 (+ 36798us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.061062 (+ 71634us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59538,"tablet-delete.queue_time_us":3815237}
I20260617 07:53:23.061476 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 574) took 3998 ms. Trace:
I20260617 07:53:23.061645 1178 tablet_bootstrap.cc:654] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.061550 1846 rpcz_store.cc:276] 0617 07:53:19.063008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.063054 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:23.061380 (+3998326us) ts_tablet_manager.cc:1151] Deleting tablet 18f9bace06e34602acc7fcd7501b3671
0617 07:53:23.061388 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.061463 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3998175}
I20260617 07:53:23.061928 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 575) took 3998 ms. Trace:
I20260617 07:53:23.062000 1846 rpcz_store.cc:276] 0617 07:53:19.063155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.063197 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:23.061840 (+3998643us) ts_tablet_manager.cc:1151] Deleting tablet eb75a965740344c2bd0b68a8dda28be5
0617 07:53:23.061848 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.061915 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3998507}
I20260617 07:53:23.062265 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 576) took 3999 ms. Trace:
I20260617 07:53:23.062345 1846 rpcz_store.cc:276] 0617 07:53:19.063267 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.063306 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:23.062174 (+3998868us) ts_tablet_manager.cc:1151] Deleting tablet 6d8f144d04af4ea18f99aee3b82f4a28
0617 07:53:23.062181 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.062249 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3998744}
I20260617 07:53:23.062534 2670 raft_consensus.cc:493] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.062638 2670 raft_consensus.cc:515] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.062742 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 577) took 3999 ms. Trace:
I20260617 07:53:23.062816 1846 rpcz_store.cc:276] 0617 07:53:19.063366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.063403 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:23.062567 (+3999164us) ts_tablet_manager.cc:1151] Deleting tablet 49f0f68dcef34228a1b2a018e8aa329e
0617 07:53:23.062577 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.062726 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3999015}
I20260617 07:53:23.063133 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 578) took 3999 ms. Trace:
I20260617 07:53:23.063146 2670 leader_election.cc:290] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.063202 1846 rpcz_store.cc:276] 0617 07:53:19.063507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.063572 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:23.063039 (+3999467us) ts_tablet_manager.cc:1151] Deleting tablet 739cadc7ad124e229441333de949f2c6
0617 07:53:23.063049 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.063118 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3999291}
I20260617 07:53:23.063474 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 579) took 3999 ms. Trace:
I20260617 07:53:23.063547 1846 rpcz_store.cc:276] 0617 07:53:19.063615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.063658 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:23.063374 (+3999716us) ts_tablet_manager.cc:1151] Deleting tablet 596ef68705c84791b54f07e03b219b4c
0617 07:53:23.063384 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.063459 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3999558}
I20260617 07:53:23.063840 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 580) took 4000 ms. Trace:
I20260617 07:53:23.063891 1846 rpcz_store.cc:276] 0617 07:53:19.063725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.063783 (+ 58us) service_pool.cc:224] Handling call
0617 07:53:23.063771 (+3999988us) ts_tablet_manager.cc:1151] Deleting tablet 4de8df5e15cb43c0b95ec5af3110db66
0617 07:53:23.063778 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.063830 (+ 52us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3999854}
I20260617 07:53:23.064092 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 581) took 3880 ms. Trace:
I20260617 07:53:23.064139 1846 rpcz_store.cc:276] 0617 07:53:19.184138 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.184198 (+ 60us) service_pool.cc:224] Handling call
0617 07:53:23.064031 (+3879833us) ts_tablet_manager.cc:1151] Deleting tablet 98f7c3f6260c4db690de1a5081bb2493
0617 07:53:23.064037 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.064083 (+ 46us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3879613}
I20260617 07:53:23.064345 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 583) took 3879 ms. Trace:
I20260617 07:53:23.064392 1846 rpcz_store.cc:276] 0617 07:53:19.184450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.184485 (+ 35us) service_pool.cc:224] Handling call
0617 07:53:23.064286 (+3879801us) ts_tablet_manager.cc:1151] Deleting tablet 70610822c57e45c7add7e1f5ce96d889
0617 07:53:23.064292 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.064337 (+ 45us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3879637}
I20260617 07:53:23.064605 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 582) took 3880 ms. Trace:
I20260617 07:53:23.064653 1846 rpcz_store.cc:276] 0617 07:53:19.184307 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.184515 (+ 208us) service_pool.cc:224] Handling call
0617 07:53:23.064532 (+3880017us) ts_tablet_manager.cc:1151] Deleting tablet 4d9ace137c4e496fafac4e729718577f
0617 07:53:23.064538 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.064585 (+ 47us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3879824}
I20260617 07:53:23.064854 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 584) took 3880 ms. Trace:
I20260617 07:53:23.064900 1846 rpcz_store.cc:276] 0617 07:53:19.184554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.184681 (+ 127us) service_pool.cc:224] Handling call
0617 07:53:23.064794 (+3880113us) ts_tablet_manager.cc:1151] Deleting tablet 1f6264adc3994c22864ea73106ba2320
0617 07:53:23.064800 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.064846 (+ 46us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3879988}
I20260617 07:53:23.065095 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 585) took 3880 ms. Trace:
I20260617 07:53:23.065142 1846 rpcz_store.cc:276] 0617 07:53:19.184657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.184843 (+ 186us) service_pool.cc:224] Handling call
0617 07:53:23.065036 (+3880193us) ts_tablet_manager.cc:1151] Deleting tablet 3fcf87953dc14bf190ac74101547e52f
0617 07:53:23.065042 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.065086 (+ 44us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3880079}
I20260617 07:53:23.065255 2729 consensus_queue.cc:1048] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:23.065300 756 tablet_service.cc:1511] Processing CreateTablet for tablet 1f74171ee2674ec7922bb77c13050d93 (DEFAULT_TABLE table=default.Table_ce78660edab64a4d973c183fa5f3e33e [id=f6349cfbe5264985a80d42829e97ebbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.065634 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f74171ee2674ec7922bb77c13050d93. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.065898 988 leader_election.cc:343] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.065997 988 leader_election.cc:304] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.065992 754 tablet_service.cc:1511] Processing CreateTablet for tablet d09307157e5d4794aca50faccafa6004 (DEFAULT_TABLE table=default.Table_b6a829d6282344d28e1edc117789070d [id=b4ca582233ea46c0af982ce428325869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.066218 2729 raft_consensus.cc:2749] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.066404 743 tablet_service.cc:1511] Processing CreateTablet for tablet 345770b456d64fedba27347674a70900 (DEFAULT_TABLE table=default.Table_23f74c07c322499982b3fcbc0ce236ce [id=c0634ea0ff174ad7b033d399c7ba414c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:23.066540 988 leader_election.cc:343] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.066619 988 leader_election.cc:304] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.066797 2729 raft_consensus.cc:2749] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.066797 745 tablet_service.cc:1511] Processing CreateTablet for tablet 89fe6f819bed46c189951747fc2a9560 (DEFAULT_TABLE table=default.Table_9f1c5148c98f470a88b93558ee1c10bc [id=60ba41520ab04ce5a11fc3f8a133d978]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.067181 2729 consensus_queue.cc:1048] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:23.068240 852 leader_election.cc:343] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.068306 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5053b7c24964dee880890fbb803ce7b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:23.069979 755 tablet_service.cc:1511] Processing CreateTablet for tablet 2372cb9ae6e343be945b1e8d2db86894 (DEFAULT_TABLE table=default.Table_0cc937610f884774b7b7c3d5c1739d85 [id=5d617c837f1746238fd385037793a0dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.070395 751 tablet_service.cc:1511] Processing CreateTablet for tablet 797867621cb94efb8ff9d3689a9d6745 (DEFAULT_TABLE table=default.Table_3a27cafa0dc14d528e8a5f7c214b14a9 [id=198d450ba28b44a5abc506eeccd394ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.070756 750 tablet_service.cc:1511] Processing CreateTablet for tablet 8dead95cfb624c3ca99069465813fea6 (DEFAULT_TABLE table=default.Table_c2b4123400f94ed9b7d9c4de82728499 [id=fed468f65d2746c88671637d0199846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.070977 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 146d1b46891a416aafe55aa740e1569e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.071002 763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770a5216299842b890d483ca37b0ee86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.071151 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.071225 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 0fd8cedb539748dc917128511325bbcc (table default.Table_1dc0449b6b954c8c9b7bb09011250560 [id=9edba52661f941a387f42fad199f9860]) successfully deleted
W20260617 07:53:23.071478 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 18f9bace06e34602acc7fcd7501b3671 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18f9bace06e34602acc7fcd7501b3671 already in progress: creating tablet
W20260617 07:53:23.071677 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet eb75a965740344c2bd0b68a8dda28be5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb75a965740344c2bd0b68a8dda28be5 already in progress: creating tablet
W20260617 07:53:23.071877 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6d8f144d04af4ea18f99aee3b82f4a28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8f144d04af4ea18f99aee3b82f4a28 already in progress: creating tablet
W20260617 07:53:23.072041 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 49f0f68dcef34228a1b2a018e8aa329e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49f0f68dcef34228a1b2a018e8aa329e already in progress: creating tablet
W20260617 07:53:23.072327 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 596ef68705c84791b54f07e03b219b4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596ef68705c84791b54f07e03b219b4c already in progress: creating tablet
W20260617 07:53:23.072494 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4de8df5e15cb43c0b95ec5af3110db66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4de8df5e15cb43c0b95ec5af3110db66 already in progress: creating tablet
I20260617 07:53:23.072463 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02dbb70eec84932917ef282fdae0bd7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:23.072674 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 98f7c3f6260c4db690de1a5081bb2493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f7c3f6260c4db690de1a5081bb2493 already in progress: creating tablet
W20260617 07:53:23.072830 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70610822c57e45c7add7e1f5ce96d889 already in progress: creating tablet
W20260617 07:53:23.073015 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 4d9ace137c4e496fafac4e729718577f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d9ace137c4e496fafac4e729718577f already in progress: creating tablet
W20260617 07:53:23.073182 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 1f6264adc3994c22864ea73106ba2320 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f6264adc3994c22864ea73106ba2320 already in progress: creating tablet
I20260617 07:53:23.073474 2711 raft_consensus.cc:493] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.073580 2711 raft_consensus.cc:515] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.075268 2711 leader_election.cc:290] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:23.076058 852 leader_election.cc:343] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.065312 1846 tablet_replica.cc:333] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:23.076363 852 leader_election.cc:343] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.078054 2629 raft_consensus.cc:493] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.078230 2629 raft_consensus.cc:515] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.078918 2629 leader_election.cc:290] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
W20260617 07:53:23.080675 986 consensus_peers.cc:597] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:23.076617 713 leader_election.cc:343] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 5dcfb101cf51487692ef9a6a17f40804
I20260617 07:53:23.080065 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f8492f127243eca07b2ffbabddded5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.081525 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09307157e5d4794aca50faccafa6004. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.081651 986 leader_election.cc:343] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.082055 1846 raft_consensus.cc:2243] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.082239 1846 raft_consensus.cc:2272] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.082777 1846 ts_tablet_manager.cc:1916] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.086663 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345770b456d64fedba27347674a70900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.092262 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fe6f819bed46c189951747fc2a9560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.096263 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2372cb9ae6e343be945b1e8d2db86894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.097465 2755 tablet.cc:1724] T 58ba8963530d49a89fe4eb626225377d P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260617 07:53:23.098807 716 leader_election.cc:343] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 5dcfb101cf51487692ef9a6a17f40804
I20260617 07:53:23.098960 716 leader_election.cc:304] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:23.099498 2711 raft_consensus.cc:2749] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.101331 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797867621cb94efb8ff9d3689a9d6745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.106021 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dead95cfb624c3ca99069465813fea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.110566 2754 tablet.cc:1724] T 7a4a3aea221f46d3a7265bd757616bfe P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.113212 2744 tablet.cc:1724] T 7a4a3aea221f46d3a7265bd757616bfe P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.116742 2755 tablet.cc:1724] T ee5ddac997834e97a2d6c9b1855ee4e8 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 07:53:23.119057 1846 ts_tablet_manager.cc:1929] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.119216 1846 log.cc:1199] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/3aa1c1fdede041d28570b85e63c401b7
I20260617 07:53:23.119582 1846 ts_tablet_manager.cc:1950] T 3aa1c1fdede041d28570b85e63c401b7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:23.120363 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 587) took 3935 ms. Trace:
I20260617 07:53:23.120507 1846 rpcz_store.cc:276] 0617 07:53:19.184875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.184984 (+ 109us) service_pool.cc:224] Handling call
0617 07:53:23.065282 (+3880298us) ts_tablet_manager.cc:1151] Deleting tablet 3aa1c1fdede041d28570b85e63c401b7
0617 07:53:23.065288 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.102113 (+ 36825us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.119006 (+ 16893us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.120348 (+ 1342us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3880115}
I20260617 07:53:23.126510 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 146d1b46891a416aafe55aa740e1569e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.127400 2743 tablet.cc:1724] T ee5ddac997834e97a2d6c9b1855ee4e8 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 07:53:23.127831 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 3aa1c1fdede041d28570b85e63c401b7 (table default.Table_a419ba4ac7ca4fb583f6da5781f87dba [id=3c8502b6e5ae4248a661ea0050889c53]) successfully deleted
I20260617 07:53:23.131413 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 589) took 3946 ms. Trace:
I20260617 07:53:23.131568 1846 rpcz_store.cc:276] 0617 07:53:19.185103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.185199 (+ 96us) service_pool.cc:224] Handling call
0617 07:53:23.131283 (+3946084us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:23.131293 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.131389 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3945905}
W20260617 07:53:23.132282 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a02dbb70eec84932917ef282fdae0bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a02dbb70eec84932917ef282fdae0bd7 already in progress: creating tablet
I20260617 07:53:23.135694 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 591) took 3950 ms. Trace:
I20260617 07:53:23.136040 1846 rpcz_store.cc:276] 0617 07:53:19.185322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.185404 (+ 82us) service_pool.cc:224] Handling call
0617 07:53:23.135578 (+3950174us) ts_tablet_manager.cc:1151] Deleting tablet 52af94bd46c941b8a27136ca0506e744
0617 07:53:23.135588 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.135675 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3949994}
I20260617 07:53:23.136457 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 593) took 3950 ms. Trace:
I20260617 07:53:23.136596 1846 rpcz_store.cc:276] 0617 07:53:19.185532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.185620 (+ 88us) service_pool.cc:224] Handling call
0617 07:53:23.136354 (+3950734us) ts_tablet_manager.cc:1151] Deleting tablet 1f14f40ea66b4c8aa0ae7d46e4981dd3
0617 07:53:23.136362 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.136443 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3950542}
W20260617 07:53:23.137290 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 52af94bd46c941b8a27136ca0506e744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52af94bd46c941b8a27136ca0506e744 already in progress: creating tablet
I20260617 07:53:23.137437 1846 tablet_replica.cc:333] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:23.137611 1846 raft_consensus.cc:2243] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.137794 1846 raft_consensus.cc:2272] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:23.137796 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 69629.6us
I20260617 07:53:23.138151 851 leader_election.cc:304] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.138813 2710 raft_consensus.cc:2804] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:23.139071 2710 raft_consensus.cc:493] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:23.139147 2710 raft_consensus.cc:3060] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.139557 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11794aa70824476e9751a41ab305cc80" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:23.140270 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be19ece3a0a4a51abad7b8e2f3b2420" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:23.148061 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 8dead95cfb624c3ca99069465813fea6 (DEFAULT_TABLE table=default.Table_c2b4123400f94ed9b7d9c4de82728499 [id=fed468f65d2746c88671637d0199846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.148799 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dead95cfb624c3ca99069465813fea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.150894 1172 tablet_bootstrap.cc:492] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:23.151033 1172 ts_tablet_manager.cc:1403] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.182s user 0.013s sys 0.003s
I20260617 07:53:23.152817 456 master_service.cc:960] ReplaceTablet: received request to replace tablet f5053b7c24964dee880890fbb803ce7b from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:23.154793 1019 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.155206 1014 tablet_service.cc:1511] Processing CreateTablet for tablet e7b92f23a30643fbbce8d317717da0d7 (DEFAULT_TABLE table=default.Table_f47806c047a34b93a384080784ec392d [id=78b9ead861ae4a81a8b05dbe74687f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.155551 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b92f23a30643fbbce8d317717da0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.158140 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5364dfe28b8d4042941c8d8d4d1cf503" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:23.158380 1046 raft_consensus.cc:3060] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.158792 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 45ec77478d3046d3af44f23b5835f49f (DEFAULT_TABLE table=default.Table_d79c4d8bf3004df6b2883bf337b7ba59 [id=ed360d7c6c374187be9e1994d77f3d06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.159119 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ec77478d3046d3af44f23b5835f49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.161383 1170 ts_tablet_manager.cc:1929] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.161495 1170 log.cc:1199] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/4d9ace137c4e496fafac4e729718577f
I20260617 07:53:23.158509 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 68554a2f271b4e39bdb3171a30a9d563 (DEFAULT_TABLE table=default.Table_4c2c33710d4a4141833994f4cbef2ce4 [id=0a9874c7fda6449385a164b4cda4aa0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.161789 2719 raft_consensus.cc:493] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.161834 1170 ts_tablet_manager.cc:1950] T 4d9ace137c4e496fafac4e729718577f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:23.161868 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.162047 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68554a2f271b4e39bdb3171a30a9d563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.141705 2710 raft_consensus.cc:515] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.162616 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 384) took 4365 ms. Trace:
I20260617 07:53:23.162698 1170 rpcz_store.cc:276] 0617 07:53:18.797387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.797548 (+ 161us) service_pool.cc:224] Handling call
0617 07:53:23.026119 (+4228571us) ts_tablet_manager.cc:1151] Deleting tablet 4d9ace137c4e496fafac4e729718577f
0617 07:53:23.026133 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.032381 (+ 6248us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.161342 (+128961us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.162599 (+ 1257us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4228410}
I20260617 07:53:23.163077 2710 leader_election.cc:290] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:23.163116 986 consensus_peers.cc:597] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:23.149837 2753 tablet.cc:1724] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.154393 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f8492f127243eca07b2ffbabddded5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:23.138804 2751 tablet.cc:1724] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.149936 756 tablet_service.cc:1511] Processing CreateTablet for tablet e7b92f23a30643fbbce8d317717da0d7 (DEFAULT_TABLE table=default.Table_f47806c047a34b93a384080784ec392d [id=78b9ead861ae4a81a8b05dbe74687f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.163733 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b92f23a30643fbbce8d317717da0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.161890 2719 raft_consensus.cc:515] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.164288 2719 leader_election.cc:290] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:23.164309 1846 ts_tablet_manager.cc:1916] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.170002 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 20e00f6f14c44c3a860139495bc29aa6 (DEFAULT_TABLE table=default.Table_2d28753af2b849528f0bd51b9b878119 [id=18774155d3214ef1b969771a4310a933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.170368 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e00f6f14c44c3a860139495bc29aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.155470 744 tablet_service.cc:1511] Processing CreateTablet for tablet 45ec77478d3046d3af44f23b5835f49f (DEFAULT_TABLE table=default.Table_d79c4d8bf3004df6b2883bf337b7ba59 [id=ed360d7c6c374187be9e1994d77f3d06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.171440 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ec77478d3046d3af44f23b5835f49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.173346 889 tablet_service.cc:1511] Processing CreateTablet for tablet 20e00f6f14c44c3a860139495bc29aa6 (DEFAULT_TABLE table=default.Table_2d28753af2b849528f0bd51b9b878119 [id=18774155d3214ef1b969771a4310a933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.173738 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e00f6f14c44c3a860139495bc29aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.173755 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e55be5f28740fba65c1199a571d97a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:05 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.174145 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 385) took 4376 ms. Trace:
I20260617 07:53:23.174230 1170 rpcz_store.cc:276] 0617 07:53:18.797477 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.797758 (+ 281us) service_pool.cc:224] Handling call
0617 07:53:23.174051 (+4376293us) ts_tablet_manager.cc:1151] Deleting tablet 3fcf87953dc14bf190ac74101547e52f
0617 07:53:23.174060 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.174126 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4376151}
I20260617 07:53:23.175140 1170 tablet_replica.cc:333] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:23.175308 1170 raft_consensus.cc:2243] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.175429 1170 raft_consensus.cc:2272] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.175652 1862 ts_tablet_manager.cc:1929] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.175740 1862 log.cc:1199] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/4681e8e3f1174b299d89ec541ca8e6b3
I20260617 07:53:23.175901 1170 ts_tablet_manager.cc:1916] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.176036 1862 ts_tablet_manager.cc:1950] T 4681e8e3f1174b299d89ec541ca8e6b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:23.176713 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 595) took 1544 ms. Trace:
I20260617 07:53:23.156925 745 tablet_service.cc:1511] Processing CreateTablet for tablet 68554a2f271b4e39bdb3171a30a9d563 (DEFAULT_TABLE table=default.Table_4c2c33710d4a4141833994f4cbef2ce4 [id=0a9874c7fda6449385a164b4cda4aa0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.177189 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68554a2f271b4e39bdb3171a30a9d563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.177644 460 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_912b307c6f95423883dad501646529f4" } new_table_name: "default.Table_174e0c810fcb4a19bfe0339d9d8eaea7" modify_external_catalogs: true
I20260617 07:53:23.178277 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 4d9ace137c4e496fafac4e729718577f (table default.Table_688e63c9bbf3476c8925bd08ca801213 [id=7738095992784d1e80554f9f554fb1cd]) successfully deleted
I20260617 07:53:23.158298 755 tablet_service.cc:1511] Processing CreateTablet for tablet 20e00f6f14c44c3a860139495bc29aa6 (DEFAULT_TABLE table=default.Table_2d28753af2b849528f0bd51b9b878119 [id=18774155d3214ef1b969771a4310a933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.182025 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e00f6f14c44c3a860139495bc29aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.182217 455 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:23.182582 455 catalog_manager.cc:5696] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:23.183000 455 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:23.183331 455 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 2 got 0
I20260617 07:53:23.183774 892 tablet_service.cc:1511] Processing CreateTablet for tablet b71b839b9a2d4514935bde982191dc05 (DEFAULT_TABLE table=default.Table_4b4f883d15d0470eb3031e2d963eac96 [id=a5859b187e83408783c9a250ce285985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.184105 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71b839b9a2d4514935bde982191dc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.187691 1846 ts_tablet_manager.cc:1929] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.188900 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 2372cb9ae6e343be945b1e8d2db86894
I20260617 07:53:23.190842 898 tablet_service.cc:1511] Processing CreateTablet for tablet 68554a2f271b4e39bdb3171a30a9d563 (DEFAULT_TABLE table=default.Table_4c2c33710d4a4141833994f4cbef2ce4 [id=0a9874c7fda6449385a164b4cda4aa0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.191212 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68554a2f271b4e39bdb3171a30a9d563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.192970 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2372cb9ae6e343be945b1e8d2db86894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.161669 1046 raft_consensus.cc:2468] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:23.151732 1172 raft_consensus.cc:359] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.197162 1172 raft_consensus.cc:385] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.197230 1172 raft_consensus.cc:740] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.198047 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02dbb70eec84932917ef282fdae0bd7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.198207 1047 raft_consensus.cc:2468] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:23.203276 1172 consensus_queue.cc:260] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.203763 1172 ts_tablet_manager.cc:1434] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.053s user 0.001s sys 0.001s
I20260617 07:53:23.163005 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c3bf1860c34ee3821bf273234cb0a4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:23.206048 1846 log.cc:1199] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/99ec78c123d448329b8442a0de0140d3
I20260617 07:53:23.188692 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804126f8451e42748b26c43e31a2a1c4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.206442 1846 ts_tablet_manager.cc:1950] T 99ec78c123d448329b8442a0de0140d3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:23.208395 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 7ca7af3d86d741f482a1f5f97de9c767
I20260617 07:53:23.193994 744 tablet_service.cc:1511] Processing CreateTablet for tablet b71b839b9a2d4514935bde982191dc05 (DEFAULT_TABLE table=default.Table_4b4f883d15d0470eb3031e2d963eac96 [id=a5859b187e83408783c9a250ce285985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.209750 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71b839b9a2d4514935bde982191dc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.197855 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 2372cb9ae6e343be945b1e8d2db86894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:23.212260 986 leader_election.cc:343] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.212512 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ca7af3d86d741f482a1f5f97de9c767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:23.212571 852 leader_election.cc:343] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.213243 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770a5216299842b890d483ca37b0ee86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.213464 1046 raft_consensus.cc:2468] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:23.213753 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 586) took 4023 ms. Trace:
I20260617 07:53:23.213830 1846 rpcz_store.cc:276] 0617 07:53:19.184750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.185831 (+ 1081us) service_pool.cc:224] Handling call
0617 07:53:23.137399 (+3951568us) ts_tablet_manager.cc:1151] Deleting tablet 99ec78c123d448329b8442a0de0140d3
0617 07:53:23.137407 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.169864 (+ 32457us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.187643 (+ 17779us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.208460 (+ 20817us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3951388}
I20260617 07:53:23.214238 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 99ec78c123d448329b8442a0de0140d3 (table default.Table_fc5f3ba5ab8a45c7bab81747fe42b662 [id=e65c9a5f1a1f479ea1804dfe806a2926]) successfully deleted
I20260617 07:53:23.217074 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 594) took 4031 ms. Trace:
I20260617 07:53:23.217181 1846 rpcz_store.cc:276] 0617 07:53:19.185691 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.185922 (+ 231us) service_pool.cc:224] Handling call
0617 07:53:23.216947 (+4031025us) ts_tablet_manager.cc:1151] Deleting tablet dac3dc9d7da447cb8fdca84fdac0dc39
0617 07:53:23.216957 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.217059 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4030895}
W20260617 07:53:23.217665 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet dac3dc9d7da447cb8fdca84fdac0dc39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dac3dc9d7da447cb8fdca84fdac0dc39 already in progress: creating tablet
I20260617 07:53:23.218158 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 595) took 4032 ms. Trace:
I20260617 07:53:23.219053 1846 rpcz_store.cc:276] 0617 07:53:19.185809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.186078 (+ 269us) service_pool.cc:224] Handling call
0617 07:53:23.218026 (+4031948us) ts_tablet_manager.cc:1151] Deleting tablet d2304939c17648a6962f702524aa9b76
0617 07:53:23.218050 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.218139 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4031797}
W20260617 07:53:23.219599 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d2304939c17648a6962f702524aa9b76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2304939c17648a6962f702524aa9b76 already in progress: creating tablet
I20260617 07:53:23.220016 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ca7af3d86d741f482a1f5f97de9c767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.220527 1846 tablet_replica.cc:333] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:23.220829 1846 raft_consensus.cc:2243] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.221057 1846 raft_consensus.cc:2272] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.221271 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 52af94bd46c941b8a27136ca0506e744 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:23.221482 1170 ts_tablet_manager.cc:1929] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.221606 1170 log.cc:1199] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/77c3bf1860c34ee3821bf273234cb0a4
I20260617 07:53:23.222079 889 tablet_service.cc:1511] Processing CreateTablet for tablet ef67fe2d23444f77bf415fc9aad1db62 (DEFAULT_TABLE table=default.Table_af6270e3aac64c5f83403a481f16f0fc [id=56de473097864e78b4aa5d9527dbf89a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.222445 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef67fe2d23444f77bf415fc9aad1db62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.226603 1846 ts_tablet_manager.cc:1916] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.221382 756 tablet_service.cc:1511] Processing CreateTablet for tablet ef67fe2d23444f77bf415fc9aad1db62 (DEFAULT_TABLE table=default.Table_af6270e3aac64c5f83403a481f16f0fc [id=56de473097864e78b4aa5d9527dbf89a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.227846 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef67fe2d23444f77bf415fc9aad1db62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.228492 1170 ts_tablet_manager.cc:1950] T 77c3bf1860c34ee3821bf273234cb0a4 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:23.233150 2710 raft_consensus.cc:493] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.233314 2710 raft_consensus.cc:515] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.234508 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58bbdbf59c7426c8adbbbe3f0aafaed" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.234709 2710 leader_election.cc:290] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.176789 1862 rpcz_store.cc:276] 0617 07:53:21.632767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.632808 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:23.053348 (+1420540us) ts_tablet_manager.cc:1151] Deleting tablet 4681e8e3f1174b299d89ec541ca8e6b3
0617 07:53:23.053357 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.160555 (+107198us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.175604 (+ 15049us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.176694 (+ 1090us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1420354}
I20260617 07:53:23.235436 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 388) took 4437 ms. Trace:
I20260617 07:53:23.235577 1170 rpcz_store.cc:276] 0617 07:53:18.797768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.798005 (+ 237us) service_pool.cc:224] Handling call
0617 07:53:23.175100 (+4377095us) ts_tablet_manager.cc:1151] Deleting tablet 77c3bf1860c34ee3821bf273234cb0a4
0617 07:53:23.175109 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.194964 (+ 19855us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.221424 (+ 26460us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.235417 (+ 13993us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4376937}
I20260617 07:53:23.236064 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 386) took 4438 ms. Trace:
I20260617 07:53:23.236208 1170 rpcz_store.cc:276] 0617 07:53:18.797561 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.798229 (+ 668us) service_pool.cc:224] Handling call
0617 07:53:23.235946 (+4437717us) ts_tablet_manager.cc:1151] Deleting tablet 3aa1c1fdede041d28570b85e63c401b7
0617 07:53:23.235959 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.236047 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4437591}
I20260617 07:53:23.236387 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 77c3bf1860c34ee3821bf273234cb0a4 (table default.Table_539fd5773b6749b7aa922ab7ba5250ad [id=4d565f22e74c4c9d97a5b367e2b016b4]) successfully deleted
W20260617 07:53:23.235167 852 leader_election.cc:343] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.237005 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 4681e8e3f1174b299d89ec541ca8e6b3 (table default.Table_25ce7515adee4a9bb9f50098d1fb2050 [id=5f6831ba0db34c3ea0b2f240925cd4d9]) successfully deleted
I20260617 07:53:23.237332 1862 tablet_replica.cc:333] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:23.237550 1862 raft_consensus.cc:2243] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.238484 1862 raft_consensus.cc:2272] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.238617 745 tablet_service.cc:1511] Processing CreateTablet for tablet f87c0e33e3824298bc36efa98a68f7ce (DEFAULT_TABLE table=default.Table_3b0a6c4136014884b620452ccd92d8b4 [id=83ad66452e334cd98b836df8592668ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.238983 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87c0e33e3824298bc36efa98a68f7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.240111 1862 ts_tablet_manager.cc:1916] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.240876 1846 ts_tablet_manager.cc:1929] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.240869 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ef8f02d7ea8d407898c00619b16844d2" } new_table_name: "default.Table_291781c0e1684d12b62096ae0017b212" modify_external_catalogs: true
I20260617 07:53:23.241308 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 393) took 4443 ms. Trace:
I20260617 07:53:23.241389 1170 rpcz_store.cc:276] 0617 07:53:18.798269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.798405 (+ 136us) service_pool.cc:224] Handling call
0617 07:53:23.241207 (+4442802us) ts_tablet_manager.cc:1151] Deleting tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1
0617 07:53:23.241216 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.241295 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4442645}
I20260617 07:53:23.241603 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 2372cb9ae6e343be945b1e8d2db86894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.236810 1020 tablet_service.cc:1511] Processing CreateTablet for tablet ef67fe2d23444f77bf415fc9aad1db62 (DEFAULT_TABLE table=default.Table_af6270e3aac64c5f83403a481f16f0fc [id=56de473097864e78b4aa5d9527dbf89a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.241878 1170 tablet_replica.cc:333] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:23.242111 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef67fe2d23444f77bf415fc9aad1db62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.242125 1170 raft_consensus.cc:2243] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:23.243352 1170 pending_rounds.cc:70] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:23.243394 1170 pending_rounds.cc:77] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772753235402752 op_type: NO_OP noop_request { }
I20260617 07:53:23.243468 1170 raft_consensus.cc:2889] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:23.243547 1170 raft_consensus.cc:2272] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.243515 892 tablet_service.cc:1511] Processing CreateTablet for tablet ee4a2f3a22d1482eab85d44310c8a176 (DEFAULT_TABLE table=default.Table_a760668e4e954d438ebe1331c429627f [id=3d306a3bde784759bd8e3a45fa8cddec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.243876 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4a2f3a22d1482eab85d44310c8a176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.244011 1170 ts_tablet_manager.cc:1916] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.244905 2756 raft_consensus.cc:493] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.245018 2756 raft_consensus.cc:515] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.245971 1172 tablet_bootstrap.cc:492] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:23.246578 2756 leader_election.cc:290] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:23.246937 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3aa1c1fdede041d28570b85e63c401b7 because the tablet was not found. No further retry: Not found: Tablet not found: 3aa1c1fdede041d28570b85e63c401b7
W20260617 07:53:23.247318 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 already in progress: creating tablet
I20260617 07:53:23.254092 1018 tablet_service.cc:1511] Processing CreateTablet for tablet f87c0e33e3824298bc36efa98a68f7ce (DEFAULT_TABLE table=default.Table_3b0a6c4136014884b620452ccd92d8b4 [id=83ad66452e334cd98b836df8592668ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.255228 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87c0e33e3824298bc36efa98a68f7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.239320 1019 tablet_service.cc:1511] Processing CreateTablet for tablet b71b839b9a2d4514935bde982191dc05 (DEFAULT_TABLE table=default.Table_4b4f883d15d0470eb3031e2d963eac96 [id=a5859b187e83408783c9a250ce285985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.239473 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ca7af3d86d741f482a1f5f97de9c767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:22 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.256916 1014 tablet_service.cc:1511] Processing CreateTablet for tablet ee4a2f3a22d1482eab85d44310c8a176 (DEFAULT_TABLE table=default.Table_a760668e4e954d438ebe1331c429627f [id=3d306a3bde784759bd8e3a45fa8cddec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.261471 1170 ts_tablet_manager.cc:1929] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:23.261583 1170 log.cc:1199] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/bbc3d13d519843a9bc38e97dc85b67c8
W20260617 07:53:23.261562 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66bd830c11b4412ba5a88afec7c9384a consensus state has no leader
I20260617 07:53:23.265673 892 tablet_service.cc:1511] Processing CreateTablet for tablet b76bc02f75964cfdb5eda9f928884500 (DEFAULT_TABLE table=default.Table_b0e2a57a3f144fa9a96d787075d34640 [id=481d277e2c2d4a6e98c25b8bb9bfb861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.266076 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76bc02f75964cfdb5eda9f928884500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.268306 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71b839b9a2d4514935bde982191dc05. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.269043 852 consensus_peers.cc:597] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:23.270056 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4a2f3a22d1482eab85d44310c8a176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.273550 1172 tablet_bootstrap.cc:654] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.274783 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58bbdbf59c7426c8adbbbe3f0aafaed" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.274960 1050 raft_consensus.cc:2468] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:23.275204 988 leader_election.cc:343] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.275302 988 leader_election.cc:304] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.275525 2756 raft_consensus.cc:2749] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:23.275689 988 leader_election.cc:343] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.275777 988 leader_election.cc:304] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:23.275914 988 raft_consensus.cc:2686] T 11794aa70824476e9751a41ab305cc80 P dc3bec007846459a9da0c7b8211e477b: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260617 07:53:23.276427 988 leader_election.cc:343] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.276521 988 leader_election.cc:304] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.276865 2756 raft_consensus.cc:2749] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.277904 2719 consensus_queue.cc:1048] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:23.278991 889 tablet_service.cc:1511] Processing CreateTablet for tablet f87c0e33e3824298bc36efa98a68f7ce (DEFAULT_TABLE table=default.Table_3b0a6c4136014884b620452ccd92d8b4 [id=83ad66452e334cd98b836df8592668ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.281009 1021 tablet_service.cc:1511] Processing CreateTablet for tablet b76bc02f75964cfdb5eda9f928884500 (DEFAULT_TABLE table=default.Table_b0e2a57a3f144fa9a96d787075d34640 [id=481d277e2c2d4a6e98c25b8bb9bfb861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.281483 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76bc02f75964cfdb5eda9f928884500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.281411 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_774c024c17f54bcaa0c35e69f911a6f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.280839 883 tablet_service.cc:1511] Processing CreateTablet for tablet 86be3ae74b6c4fc0ad7559c373c01054 (DEFAULT_TABLE table=default.Table_ec89beb01ab24e39a452439e1b445844 [id=fc3e6b3e05de4201978dac84e162b26a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.281996 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86be3ae74b6c4fc0ad7559c373c01054. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.282239 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_774c024c17f54bcaa0c35e69f911a6f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.245926 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b93b31475c4f29a7fdc387ffbff0cd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.285136 1846 log.cc:1199] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d657fbccb4af40558033a971aab7f3e4
I20260617 07:53:23.246548 755 tablet_service.cc:1511] Processing CreateTablet for tablet ee4a2f3a22d1482eab85d44310c8a176 (DEFAULT_TABLE table=default.Table_a760668e4e954d438ebe1331c429627f [id=3d306a3bde784759bd8e3a45fa8cddec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.285992 1846 ts_tablet_manager.cc:1950] T d657fbccb4af40558033a971aab7f3e4 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:23.286186 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4a2f3a22d1482eab85d44310c8a176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.286715 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 592) took 4101 ms. Trace:
I20260617 07:53:23.286806 1846 rpcz_store.cc:276] 0617 07:53:19.185431 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.185837 (+ 406us) service_pool.cc:224] Handling call
0617 07:53:23.220488 (+4034651us) ts_tablet_manager.cc:1151] Deleting tablet d657fbccb4af40558033a971aab7f3e4
0617 07:53:23.220496 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.238238 (+ 17742us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.240836 (+ 2598us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.286696 (+ 45860us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4034088}
I20260617 07:53:23.287096 1846 tablet_replica.cc:333] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:23.287271 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d657fbccb4af40558033a971aab7f3e4 (table default.Table_de275810487f4911a911f2d6e00a8963 [id=1f208e21034e47a8a25e0e9988e5b156]) successfully deleted
I20260617 07:53:23.287395 1846 raft_consensus.cc:2243] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.287520 1846 raft_consensus.cc:2272] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.287946 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87c0e33e3824298bc36efa98a68f7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.288002 1846 ts_tablet_manager.cc:1916] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:23.285557 986 leader_election.cc:343] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.295902 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 86be3ae74b6c4fc0ad7559c373c01054 (DEFAULT_TABLE table=default.Table_ec89beb01ab24e39a452439e1b445844 [id=fc3e6b3e05de4201978dac84e162b26a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.299053 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9032f8129cb543819393109437d5beab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.299094 755 tablet_service.cc:1511] Processing CreateTablet for tablet d53bfc4f1b454613bc05b74ffc7f58ac (DEFAULT_TABLE table=default.Table_2d9822f4cc9f41dbbbe65fe0b30fc2a5 [id=534b2735159a4ac8b7ecee572f406f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.299530 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53bfc4f1b454613bc05b74ffc7f58ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.299588 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9032f8129cb543819393109437d5beab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.303056 2710 raft_consensus.cc:493] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.303203 2710 raft_consensus.cc:515] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.303849 2710 leader_election.cc:290] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.304621 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8602b87a20455884c16196a901d335" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:23.305163 852 leader_election.cc:343] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.305518 756 tablet_service.cc:1511] Processing CreateTablet for tablet 86be3ae74b6c4fc0ad7559c373c01054 (DEFAULT_TABLE table=default.Table_ec89beb01ab24e39a452439e1b445844 [id=fc3e6b3e05de4201978dac84e162b26a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.305927 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86be3ae74b6c4fc0ad7559c373c01054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.306402 883 tablet_service.cc:1511] Processing CreateTablet for tablet d53bfc4f1b454613bc05b74ffc7f58ac (DEFAULT_TABLE table=default.Table_2d9822f4cc9f41dbbbe65fe0b30fc2a5 [id=534b2735159a4ac8b7ecee572f406f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.307191 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53bfc4f1b454613bc05b74ffc7f58ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.311692 988 leader_election.cc:343] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.311823 988 leader_election.cc:304] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.312027 2756 raft_consensus.cc:2749] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.313895 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804126f8451e42748b26c43e31a2a1c4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:23.315042 880 tablet_service.cc:1511] Processing CreateTablet for tablet e7b92f23a30643fbbce8d317717da0d7 (DEFAULT_TABLE table=default.Table_f47806c047a34b93a384080784ec392d [id=78b9ead861ae4a81a8b05dbe74687f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.315460 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b92f23a30643fbbce8d317717da0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.316879 1862 ts_tablet_manager.cc:1929] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.317005 1862 log.cc:1199] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/18f9bace06e34602acc7fcd7501b3671
I20260617 07:53:23.317355 1862 ts_tablet_manager.cc:1950] T 18f9bace06e34602acc7fcd7501b3671 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:23.318084 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 586) took 1692 ms. Trace:
I20260617 07:53:23.318194 1862 rpcz_store.cc:276] 0617 07:53:21.625173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.703405 (+ 78232us) service_pool.cc:224] Handling call
0617 07:53:23.237281 (+1533876us) ts_tablet_manager.cc:1151] Deleting tablet 18f9bace06e34602acc7fcd7501b3671
0617 07:53:23.237292 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.252556 (+ 15264us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.316835 (+ 64279us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.318040 (+ 1205us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1533605}
I20260617 07:53:23.318737 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 18f9bace06e34602acc7fcd7501b3671 (table default.Table_494d237d1c1a4ab8b4939b39873d9793 [id=ac5919d00ecb484db9c6428a472f080e]) successfully deleted
I20260617 07:53:23.319186 1862 tablet_replica.cc:333] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:23.319471 1862 raft_consensus.cc:2243] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:23.320334 1862 raft_consensus.cc:2272] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.320904 1015 tablet_service.cc:1511] Processing CreateTablet for tablet d53bfc4f1b454613bc05b74ffc7f58ac (DEFAULT_TABLE table=default.Table_2d9822f4cc9f41dbbbe65fe0b30fc2a5 [id=534b2735159a4ac8b7ecee572f406f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.321357 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53bfc4f1b454613bc05b74ffc7f58ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.327198 745 tablet_service.cc:1511] Processing CreateTablet for tablet b76bc02f75964cfdb5eda9f928884500 (DEFAULT_TABLE table=default.Table_b0e2a57a3f144fa9a96d787075d34640 [id=481d277e2c2d4a6e98c25b8bb9bfb861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.327728 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76bc02f75964cfdb5eda9f928884500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.328672 1178 tablet_bootstrap.cc:492] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:23.328938 1178 ts_tablet_manager.cc:1403] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.270s user 0.009s sys 0.001s
I20260617 07:53:23.329660 1862 ts_tablet_manager.cc:1916] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.334677 1172 tablet_bootstrap.cc:492] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:23.334897 1172 ts_tablet_manager.cc:1403] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.000s
I20260617 07:53:23.335767 1172 raft_consensus.cc:359] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.335960 1172 raft_consensus.cc:385] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.336007 1172 raft_consensus.cc:740] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.336198 1172 consensus_queue.cc:260] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.341116 851 leader_election.cc:304] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.341498 2710 raft_consensus.cc:2804] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:23.341621 2710 raft_consensus.cc:697] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:23.341876 2710 consensus_queue.cc:237] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.342891 1862 ts_tablet_manager.cc:1929] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:23.346210 1172 ts_tablet_manager.cc:1434] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260617 07:53:23.348281 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86be3ae74b6c4fc0ad7559c373c01054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.348554 851 leader_election.cc:304] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.349422 851 leader_election.cc:304] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.319430 882 tablet_service.cc:1511] Processing CreateTablet for tablet 45ec77478d3046d3af44f23b5835f49f (DEFAULT_TABLE table=default.Table_d79c4d8bf3004df6b2883bf337b7ba59 [id=ed360d7c6c374187be9e1994d77f3d06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.349884 2670 raft_consensus.cc:2804] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:23.349952 1172 tablet_bootstrap.cc:492] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:23.349967 2670 raft_consensus.cc:493] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:23.350034 2670 raft_consensus.cc:3060] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.351049 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_14b61f2fed0246169c36d16dc9f4a70f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.351423 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b93b31475c4f29a7fdc387ffbff0cd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:23.351742 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14b61f2fed0246169c36d16dc9f4a70f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.352559 2670 raft_consensus.cc:515] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.353152 2670 leader_election.cc:290] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.353293 2670 raft_consensus.cc:2804] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:23.353360 2670 raft_consensus.cc:493] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:23.353416 2670 raft_consensus.cc:3060] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.359988 1170 ts_tablet_manager.cc:1950] T bbc3d13d519843a9bc38e97dc85b67c8 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:23.361505 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02dbb70eec84932917ef282fdae0bd7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:23.361608 851 leader_election.cc:343] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 77c3bf1860c34ee3821bf273234cb0a4
I20260617 07:53:23.361765 851 leader_election.cc:304] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:23.362267 851 leader_election.cc:304] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.362380 2460 raft_consensus.cc:2749] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.362641 2460 raft_consensus.cc:2804] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:23.362711 2460 raft_consensus.cc:493] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:23.362782 2460 raft_consensus.cc:3060] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:23.362946 852 leader_election.cc:343] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.365453 2670 raft_consensus.cc:515] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.365705 2460 raft_consensus.cc:515] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.366648 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770a5216299842b890d483ca37b0ee86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:23.366838 2460 leader_election.cc:290] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.367105 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58bbdbf59c7426c8adbbbe3f0aafaed" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:23.367219 852 leader_election.cc:343] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:23.367683 852 leader_election.cc:343] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.366684 2670 leader_election.cc:290] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.367993 1862 log.cc:1199] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/d8b83fda0ce74779b4cca2ffd2a9b903
I20260617 07:53:23.349892 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ec77478d3046d3af44f23b5835f49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.368467 1862 ts_tablet_manager.cc:1950] T d8b83fda0ce74779b4cca2ffd2a9b903 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:23.377167 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 596) took 1609 ms. Trace:
I20260617 07:53:23.377328 1862 rpcz_store.cc:276] 0617 07:53:21.767993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.768067 (+ 74us) service_pool.cc:224] Handling call
0617 07:53:23.319037 (+1550970us) ts_tablet_manager.cc:1151] Deleting tablet d8b83fda0ce74779b4cca2ffd2a9b903
0617 07:53:23.319147 (+ 110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.337142 (+ 17995us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.342843 (+ 5701us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.377143 (+ 34300us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1550791}
I20260617 07:53:23.377863 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]) successfully deleted
I20260617 07:53:23.378217 1862 tablet_replica.cc:333] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:23.378427 1862 raft_consensus.cc:2243] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:23.378906 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet a0f7775846454e96a9f433e84e90a229
I20260617 07:53:23.379084 1862 raft_consensus.cc:2272] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.379654 889 tablet_service.cc:1558] Processing DeleteTablet for tablet a0f7775846454e96a9f433e84e90a229 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.380189 756 tablet_service.cc:1558] Processing DeleteTablet for tablet a0f7775846454e96a9f433e84e90a229 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.380550 1862 ts_tablet_manager.cc:1916] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.327939 1171 tablet_bootstrap.cc:492] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:23.382654 1171 ts_tablet_manager.cc:1403] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.445s user 0.007s sys 0.015s
I20260617 07:53:23.383307 1171 raft_consensus.cc:359] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.383467 1171 raft_consensus.cc:385] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.383518 1171 raft_consensus.cc:740] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.383903 1171 consensus_queue.cc:260] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.384428 1171 ts_tablet_manager.cc:1434] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 07:53:23.384697 1171 tablet_bootstrap.cc:492] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:23.388320 1846 ts_tablet_manager.cc:1929] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 07:53:23.390717 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 5e3b87f00ff04525974e942bb1570738 (table default.Table_ef6ae2b996d941d688299d061c4d4989 [id=f1de8373fa3646a3b8881f8bb02007cb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5e3b87f00ff04525974e942bb1570738 consensus state has no leader
I20260617 07:53:23.393385 1846 log.cc:1199] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d03d6dc473fc4be1a436fd71a06f403e
I20260617 07:53:23.394008 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_33ad6f8c7d1e46f1aa88a583c7479e28" } new_table_name: "default.Table_3bb3cd93c81a4ba78923a72b92b95558" modify_external_catalogs: true
I20260617 07:53:23.394143 1846 ts_tablet_manager.cc:1950] T d03d6dc473fc4be1a436fd71a06f403e P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:23.395052 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 588) took 4210 ms. Trace:
I20260617 07:53:23.395149 1846 rpcz_store.cc:276] 0617 07:53:19.184971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.186419 (+ 1448us) service_pool.cc:224] Handling call
0617 07:53:23.287051 (+4100632us) ts_tablet_manager.cc:1151] Deleting tablet d03d6dc473fc4be1a436fd71a06f403e
0617 07:53:23.287062 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.368379 (+ 81317us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.388266 (+ 19887us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.395017 (+ 6751us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4100478}
I20260617 07:53:23.395658 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 590) took 4210 ms. Trace:
I20260617 07:53:23.395750 1846 rpcz_store.cc:276] 0617 07:53:19.185202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.186240 (+ 1038us) service_pool.cc:224] Handling call
0617 07:53:23.395502 (+4209262us) ts_tablet_manager.cc:1151] Deleting tablet 77c3bf1860c34ee3821bf273234cb0a4
0617 07:53:23.395515 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.395642 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185,"tablet-delete.queue_time_us":4209088}
I20260617 07:53:23.395929 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d03d6dc473fc4be1a436fd71a06f403e (table default.Table_ffd2c46b97334436a592c497f3a8fa2a [id=af6a6625d89c41feac726918675fcbf5]) successfully deleted
I20260617 07:53:23.396127 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 596) took 4210 ms. Trace:
W20260617 07:53:23.396227 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 77c3bf1860c34ee3821bf273234cb0a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77c3bf1860c34ee3821bf273234cb0a4 already in progress: creating tablet
I20260617 07:53:23.396201 1846 rpcz_store.cc:276] 0617 07:53:19.411714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.411917 (+ 203us) service_pool.cc:224] Handling call
0617 07:53:23.396028 (+3984111us) ts_tablet_manager.cc:1151] Deleting tablet 306742b9da81497991d58947bf3c1ebb
0617 07:53:23.396038 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.396112 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3938362}
I20260617 07:53:23.396525 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 597) took 3943 ms. Trace:
I20260617 07:53:23.396617 1846 rpcz_store.cc:276] 0617 07:53:19.452901 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.452964 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:23.396429 (+3943465us) ts_tablet_manager.cc:1151] Deleting tablet 44b06e32039e4ad28924f5173035820a
0617 07:53:23.396439 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.396511 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3935577}
I20260617 07:53:23.396919 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 598) took 3937 ms. Trace:
I20260617 07:53:23.396991 1846 rpcz_store.cc:276] 0617 07:53:19.459378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.459422 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:23.396831 (+3937409us) ts_tablet_manager.cc:1151] Deleting tablet 752b6cf345384750bf9b62158ae50f26
0617 07:53:23.396838 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.396900 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3915330}
I20260617 07:53:23.397207 1846 tablet_replica.cc:333] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:23.397370 1846 raft_consensus.cc:2243] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.397495 1846 raft_consensus.cc:2272] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.392454 1178 raft_consensus.cc:359] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.397830 1178 raft_consensus.cc:385] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.397919 1178 raft_consensus.cc:740] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.398149 1178 consensus_queue.cc:260] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.398698 1178 ts_tablet_manager.cc:1434] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.069s user 0.001s sys 0.000s
W20260617 07:53:23.401896 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 306742b9da81497991d58947bf3c1ebb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 306742b9da81497991d58947bf3c1ebb already in progress: creating tablet
W20260617 07:53:23.402163 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 44b06e32039e4ad28924f5173035820a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44b06e32039e4ad28924f5173035820a already in progress: creating tablet
W20260617 07:53:23.402347 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 752b6cf345384750bf9b62158ae50f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 752b6cf345384750bf9b62158ae50f26 already in progress: creating tablet
W20260617 07:53:23.405326 460 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b85d49f255940eeaf343bfcf71e00e9 consensus state has no leader
I20260617 07:53:23.411028 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 381) took 4613 ms. Trace:
I20260617 07:53:23.411124 1170 rpcz_store.cc:276] 0617 07:53:18.797094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.798601 (+ 1507us) service_pool.cc:224] Handling call
0617 07:53:23.241827 (+4443226us) ts_tablet_manager.cc:1151] Deleting tablet bbc3d13d519843a9bc38e97dc85b67c8
0617 07:53:23.241838 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.258394 (+ 16556us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.261425 (+ 3031us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.411006 (+149581us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4443060}
I20260617 07:53:23.413970 1178 tablet_bootstrap.cc:492] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:23.414000 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_50024b66fbc145d990cf71324a0afe35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.414551 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 392) took 4616 ms. Trace:
W20260617 07:53:23.414620 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50024b66fbc145d990cf71324a0afe35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.414600 2760 tablet.cc:1724] T 7a4a3aea221f46d3a7265bd757616bfe P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.416715 1178 tablet_bootstrap.cc:654] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.414844 2762 tablet.cc:1724] T 58ba8963530d49a89fe4eb626225377d P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.417198 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet bbc3d13d519843a9bc38e97dc85b67c8 (table default.Table_9e163236fd4f4a23b074e860f9688936 [id=bfdf05bf71594f8a9eb9d4c4898c2e23]) successfully deleted
I20260617 07:53:23.415257 2763 tablet.cc:1724] T ee5ddac997834e97a2d6c9b1855ee4e8 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 07:53:23.419469 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet a0f7775846454e96a9f433e84e90a229 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.416152 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8602b87a20455884c16196a901d335" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.414644 1170 rpcz_store.cc:276] 0617 07:53:18.798179 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.798683 (+ 504us) service_pool.cc:224] Handling call
0617 07:53:23.411374 (+4612691us) ts_tablet_manager.cc:1151] Deleting tablet 706373f1f5d44edf81ed04183a8bdf89
0617 07:53:23.411382 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.414527 (+ 3145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4612548}
I20260617 07:53:23.420030 1052 raft_consensus.cc:2468] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:23.420257 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 389) took 4622 ms. Trace:
I20260617 07:53:23.420320 1170 rpcz_store.cc:276] 0617 07:53:18.797861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.798841 (+ 980us) service_pool.cc:224] Handling call
0617 07:53:23.420174 (+4621333us) ts_tablet_manager.cc:1151] Deleting tablet b7c5ff28367b42d3a3922d2b789bc7ec
0617 07:53:23.420183 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.420244 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4621184}
I20260617 07:53:23.420603 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 380) took 4623 ms. Trace:
I20260617 07:53:23.420665 1170 rpcz_store.cc:276] 0617 07:53:18.796955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.799090 (+ 2135us) service_pool.cc:224] Handling call
0617 07:53:23.420514 (+4621424us) ts_tablet_manager.cc:1151] Deleting tablet adbbe7eb5181431290f57ed9128181a3
0617 07:53:23.420521 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.420592 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4621286}
W20260617 07:53:23.421001 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 706373f1f5d44edf81ed04183a8bdf89 because the tablet was not found. No further retry: Not found: Tablet not found: 706373f1f5d44edf81ed04183a8bdf89
W20260617 07:53:23.421391 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet adbbe7eb5181431290f57ed9128181a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbbe7eb5181431290f57ed9128181a3 already in progress: creating tablet
I20260617 07:53:23.426846 1846 ts_tablet_manager.cc:1916] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.427294 1170 tablet_replica.cc:333] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:23.427806 1170 raft_consensus.cc:2243] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.430095 1170 raft_consensus.cc:2272] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.430359 1172 tablet_bootstrap.cc:654] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.430751 1170 ts_tablet_manager.cc:1916] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.431394 453 master_service.cc:960] ReplaceTablet: received request to replace tablet 12727ad13f0747ce8d9710a71ba2c075 from {username='slave'} at 127.0.0.1:33390
W20260617 07:53:23.441818 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 107705us
I20260617 07:53:23.442865 2269 generic_service.cc:196] Checking for leaks (request via RPC)
I20260617 07:53:23.457969 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02dbb70eec84932917ef282fdae0bd7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:23.458518 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770a5216299842b890d483ca37b0ee86" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:23.458678 1047 raft_consensus.cc:3060] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.460538 1171 tablet_bootstrap.cc:654] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.461282 1047 raft_consensus.cc:2468] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:23.464681 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58bbdbf59c7426c8adbbbe3f0aafaed" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:23.465092 1047 raft_consensus.cc:3060] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.473393 2460 consensus_queue.cc:1048] T 3fe290e33b5145b6a2831de3d37599b9 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:23.473706 1862 ts_tablet_manager.cc:1929] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 07:53:23.473824 1862 log.cc:1199] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a6f90a0d37cb483faa540451bf4dbe85
I20260617 07:53:23.475323 851 leader_election.cc:304] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
W20260617 07:53:23.476387 851 leader_election.cc:343] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:23.476483 851 leader_election.cc:304] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:23.476797 851 leader_election.cc:304] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.477356 2594 raft_consensus.cc:2804] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:23.477424 2594 raft_consensus.cc:493] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:23.477486 2594 raft_consensus.cc:3060] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:23.477576 988 leader_election.cc:343] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.477926 2760 tablet.cc:1724] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.480300 2594 raft_consensus.cc:515] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.480887 2594 leader_election.cc:290] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.480995 1171 tablet_bootstrap.cc:492] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:23.481210 1171 ts_tablet_manager.cc:1403] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.097s user 0.002s sys 0.002s
I20260617 07:53:23.481326 2594 raft_consensus.cc:2749] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.481479 2594 raft_consensus.cc:2804] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:23.481559 2594 raft_consensus.cc:697] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:23.481801 1047 raft_consensus.cc:2468] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:23.482074 1171 raft_consensus.cc:359] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.482213 1171 raft_consensus.cc:385] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.482263 1171 raft_consensus.cc:740] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.475528 2753 tablet.cc:1724] T 361845f7627b4b9f8481b4a66bc53e9c P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.482481 1171 consensus_queue.cc:260] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.482754 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet f5053b7c24964dee880890fbb803ce7b
I20260617 07:53:23.483043 1171 ts_tablet_manager.cc:1434] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:23.483245 456 catalog_manager.cc:6784] ReplaceTablet: tablet f5053b7c24964dee880890fbb803ce7b deleted and replaced by tablet 49732dea2ce842b5b0aa1fe7b87501e4
I20260617 07:53:23.483289 1171 tablet_bootstrap.cc:492] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:23.485140 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3f843a058bd449796d59b89e2470d8c consensus state has no leader
I20260617 07:53:23.485374 459 master_service.cc:960] ReplaceTablet: received request to replace tablet d3f843a058bd449796d59b89e2470d8c from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:23.485615 1171 tablet_bootstrap.cc:654] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.486334 2629 raft_consensus.cc:493] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.486460 2629 raft_consensus.cc:515] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.487073 2629 leader_election.cc:290] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:23.488035 880 tablet_service.cc:1558] Processing DeleteTablet for tablet f5053b7c24964dee880890fbb803ce7b with delete_type TABLET_DATA_DELETED (replaced by tablet 49732dea2ce842b5b0aa1fe7b87501e4) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.490468 1170 ts_tablet_manager.cc:1929] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.492287 2594 consensus_queue.cc:237] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.500801 1862 ts_tablet_manager.cc:1950] T a6f90a0d37cb483faa540451bf4dbe85 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:23.502606 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b71de673a2c349cabc0d9ddc6bc8af38 consensus state has no leader
I20260617 07:53:23.502892 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 597) took 1679 ms. Trace:
I20260617 07:53:23.502991 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_fd7a3773d74242fcbdc4ee8f0794fd21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.503249 1170 log.cc:1199] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a02dbb70eec84932917ef282fdae0bd7
I20260617 07:53:23.503575 1170 ts_tablet_manager.cc:1950] T a02dbb70eec84932917ef282fdae0bd7 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:23.503615 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd7a3773d74242fcbdc4ee8f0794fd21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.504176 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1f40145baeb646d5923f0718f3dcfd0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.504340 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 387) took 4706 ms. Trace:
I20260617 07:53:23.504406 1170 rpcz_store.cc:276] 0617 07:53:18.797643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.798821 (+ 1178us) service_pool.cc:224] Handling call
0617 07:53:23.426895 (+4628074us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:23.427249 (+ 354us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.486677 (+ 59428us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.490416 (+ 3739us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.504323 (+ 13907us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4625887}
W20260617 07:53:23.504650 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f40145baeb646d5923f0718f3dcfd0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.477684 988 leader_election.cc:304] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.504917 2629 raft_consensus.cc:2749] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.502969 1862 rpcz_store.cc:276] 0617 07:53:21.823737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.823789 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:23.378167 (+1554378us) ts_tablet_manager.cc:1151] Deleting tablet a6f90a0d37cb483faa540451bf4dbe85
0617 07:53:23.378177 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.384457 (+ 6280us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.473655 (+ 89198us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.502872 (+ 29217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1554193}
I20260617 07:53:23.505352 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_393005a135094d7fb79b604c25778597" } modify_external_catalogs: true
I20260617 07:53:23.505551 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_393005a135094d7fb79b604c25778597" } modify_external_catalogs: true
W20260617 07:53:23.505545 988 leader_election.cc:343] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.505661 988 leader_election.cc:304] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.505910 2629 raft_consensus.cc:2749] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.505939 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3608b494fe704c4eb01d58181b1f7c83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.506381 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3608b494fe704c4eb01d58181b1f7c83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.507587 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c1da4f33f8394dbd9c74652813300630" } new_table_name: "default.Table_866b6000aff54fe5a3bc4aa8acdde216" modify_external_catalogs: true
I20260617 07:53:23.508329 2760 tablet.cc:1724] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:23.509162 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a6f90a0d37cb483faa540451bf4dbe85 (table default.Table_a760668e4e954d438ebe1331c429627f [id=3d306a3bde784759bd8e3a45fa8cddec]) successfully deleted
I20260617 07:53:23.510934 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 598) took 1659 ms. Trace:
I20260617 07:53:23.512082 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a02dbb70eec84932917ef282fdae0bd7 (table default.Table_fceae19017b24062acf8baff4d043ec9 [id=1a61bbe203b44d6d89dbc71a84fc3917]) successfully deleted
I20260617 07:53:23.512421 1862 rpcz_store.cc:276] 0617 07:53:21.851787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.851851 (+ 64us) service_pool.cc:224] Handling call
0617 07:53:23.510796 (+1658945us) ts_tablet_manager.cc:1151] Deleting tablet 2c60d917996341109ae66b9af24f6cb4
0617 07:53:23.510808 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.510914 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1640941}
I20260617 07:53:23.501662 1172 tablet_bootstrap.cc:492] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
W20260617 07:53:23.513541 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2c60d917996341109ae66b9af24f6cb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c60d917996341109ae66b9af24f6cb4 already in progress: creating tablet
I20260617 07:53:23.513898 1172 ts_tablet_manager.cc:1403] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.164s user 0.005s sys 0.005s
I20260617 07:53:23.514349 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 599) took 1643 ms. Trace:
I20260617 07:53:23.514885 1172 raft_consensus.cc:359] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.515101 1172 raft_consensus.cc:385] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.514947 1862 rpcz_store.cc:276] 0617 07:53:21.870817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.870862 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:23.513947 (+1643085us) ts_tablet_manager.cc:1151] Deleting tablet ed5563cfe75940168702bf237d8647cd
0617 07:53:23.513959 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.514332 (+ 373us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1642928}
W20260617 07:53:23.516215 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ed5563cfe75940168702bf237d8647cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed5563cfe75940168702bf237d8647cd already in progress: creating tablet
I20260617 07:53:23.516691 1862 tablet_replica.cc:333] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:23.516956 851 leader_election.cc:304] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.517320 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de5420edefc47ed9dcdf1eea02a22fa" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:23.517609 2594 raft_consensus.cc:2804] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:23.517922 2594 raft_consensus.cc:697] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:23.518230 2594 consensus_queue.cc:237] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.518741 2753 tablet.cc:1724] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:23.515184 1172 raft_consensus.cc:740] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.520875 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet f5053b7c24964dee880890fbb803ce7b with delete_type TABLET_DATA_DELETED (replaced by tablet 49732dea2ce842b5b0aa1fe7b87501e4) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.521449 1172 consensus_queue.cc:260] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.522728 2760 tablet.cc:1724] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:23.523866 1172 ts_tablet_manager.cc:1434] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260617 07:53:23.524102 1172 tablet_bootstrap.cc:492] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:23.525344 1172 tablet_bootstrap.cc:654] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.529101 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8602b87a20455884c16196a901d335" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:23.529310 1046 raft_consensus.cc:3060] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:23.530398 988 leader_election.cc:343] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.431711 1178 tablet_bootstrap.cc:492] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:23.536870 1178 ts_tablet_manager.cc:1403] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.123s user 0.002s sys 0.002s
I20260617 07:53:23.475376 2711 raft_consensus.cc:493] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.537853 2711 raft_consensus.cc:515] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.538511 2711 leader_election.cc:290] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.539373 1178 raft_consensus.cc:359] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.539588 1178 raft_consensus.cc:385] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.539664 1178 raft_consensus.cc:740] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.539862 1178 consensus_queue.cc:260] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.540472 1178 ts_tablet_manager.cc:1434] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:23.540835 1178 tablet_bootstrap.cc:492] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:23.543228 1171 tablet_bootstrap.cc:492] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:23.543357 1171 ts_tablet_manager.cc:1403] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.000s
I20260617 07:53:23.544096 1171 raft_consensus.cc:359] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.544245 1171 raft_consensus.cc:385] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.544301 1171 raft_consensus.cc:740] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.545507 1862 raft_consensus.cc:2243] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:23.545830 1862 raft_consensus.cc:2272] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.546388 1862 ts_tablet_manager.cc:1916] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.544471 1171 consensus_queue.cc:260] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.546784 1171 ts_tablet_manager.cc:1434] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:23.547011 1171 tablet_bootstrap.cc:492] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:23.549513 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.550417 1178 tablet_bootstrap.cc:654] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.486953 745 tablet_service.cc:1558] Processing DeleteTablet for tablet f5053b7c24964dee880890fbb803ce7b with delete_type TABLET_DATA_DELETED (replaced by tablet 49732dea2ce842b5b0aa1fe7b87501e4) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.488279 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8602b87a20455884c16196a901d335" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:23.489177 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de5420edefc47ed9dcdf1eea02a22fa" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:23.552601 852 leader_election.cc:343] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:23.552973 986 leader_election.cc:343] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.553102 986 leader_election.cc:304] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.553601 2719 raft_consensus.cc:2749] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.553959 1171 tablet_bootstrap.cc:654] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.557396 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 92d1398b4b604f75be1a3b46e5ac9b77 from {username='slave'} at 127.0.0.1:33390
W20260617 07:53:23.557976 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca6c265c771745fa8eac4b5c410b5f7b consensus state has no leader
I20260617 07:53:23.563323 1171 tablet_bootstrap.cc:492] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:23.563537 1171 ts_tablet_manager.cc:1403] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260617 07:53:23.564754 1171 raft_consensus.cc:359] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.564985 1171 raft_consensus.cc:385] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.565070 1171 raft_consensus.cc:740] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.567237 1171 consensus_queue.cc:260] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.568207 1171 ts_tablet_manager.cc:1434] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 07:53:23.568581 1171 tablet_bootstrap.cc:492] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:23.571494 1171 tablet_bootstrap.cc:654] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.572417 1862 ts_tablet_manager.cc:1929] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:23.572597 1862 log.cc:1199] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/56c70f5c41e04ad0b913c15aa315353f
I20260617 07:53:23.573035 1862 ts_tablet_manager.cc:1950] T 56c70f5c41e04ad0b913c15aa315353f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:23.574115 716 leader_election.cc:343] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: cbc79cfa11e342bd87da1aa03847c3cb
I20260617 07:53:23.574251 716 leader_election.cc:304] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:23.574599 2711 raft_consensus.cc:2749] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.575573 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 600) took 1542 ms. Trace:
I20260617 07:53:23.576014 1862 rpcz_store.cc:276] 0617 07:53:22.033028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.033072 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:23.516630 (+1483558us) ts_tablet_manager.cc:1151] Deleting tablet 56c70f5c41e04ad0b913c15aa315353f
0617 07:53:23.516640 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.550581 (+ 33941us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.572367 (+ 21786us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.575556 (+ 3189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1477660}
I20260617 07:53:23.576483 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 601) took 1543 ms. Trace:
I20260617 07:53:23.576598 1862 rpcz_store.cc:276] 0617 07:53:22.033298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.033345 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:23.576372 (+1543027us) ts_tablet_manager.cc:1151] Deleting tablet 543fd8173b174946830d6228e47b2caa
0617 07:53:23.576381 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.576467 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1537353}
I20260617 07:53:23.576928 1862 tablet_replica.cc:333] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:23.577144 1862 raft_consensus.cc:2243] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:23.577421 1862 raft_consensus.cc:2272] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.578302 1862 ts_tablet_manager.cc:1916] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.579496 2719 raft_consensus.cc:493] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.579687 2719 raft_consensus.cc:515] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.580716 2719 leader_election.cc:290] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:23.581324 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e757e6f4ce4c6eb8223c4b6955245e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:23.582038 986 leader_election.cc:343] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.582295 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]) successfully deleted
W20260617 07:53:23.582592 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 543fd8173b174946830d6228e47b2caa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 543fd8173b174946830d6228e47b2caa already in progress: creating tablet
I20260617 07:53:23.583276 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e757e6f4ce4c6eb8223c4b6955245e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:23.583850 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 395) took 4785 ms. Trace:
I20260617 07:53:23.583940 1170 rpcz_store.cc:276] 0617 07:53:18.798485 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.798541 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:23.583724 (+4785183us) ts_tablet_manager.cc:1151] Deleting tablet 5942eea42c7541349ad7b6560e6777c8
0617 07:53:23.583734 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.583829 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4782564}
W20260617 07:53:23.584450 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5942eea42c7541349ad7b6560e6777c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5942eea42c7541349ad7b6560e6777c8 already in progress: creating tablet
I20260617 07:53:23.584853 1171 tablet_bootstrap.cc:492] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:23.584856 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 390) took 4786 ms. Trace:
I20260617 07:53:23.585044 1171 ts_tablet_manager.cc:1403] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.002s
I20260617 07:53:23.584946 1170 rpcz_store.cc:276] 0617 07:53:18.797977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.799259 (+ 1282us) service_pool.cc:224] Handling call
0617 07:53:23.584731 (+4785472us) ts_tablet_manager.cc:1151] Deleting tablet 8db4fdde370e4d30bbf14285923644a1
0617 07:53:23.584743 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.584837 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4783549}
W20260617 07:53:23.585618 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 8db4fdde370e4d30bbf14285923644a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8db4fdde370e4d30bbf14285923644a1 already in progress: creating tablet
I20260617 07:53:23.586007 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 394) took 4787 ms. Trace:
I20260617 07:53:23.585978 1171 raft_consensus.cc:359] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.586128 1170 rpcz_store.cc:276] 0617 07:53:18.798358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.799040 (+ 682us) service_pool.cc:224] Handling call
0617 07:53:23.585892 (+4786852us) ts_tablet_manager.cc:1151] Deleting tablet 737e9344fc824714a2c2596170637158
0617 07:53:23.585904 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.585994 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4784545}
I20260617 07:53:23.586269 1171 raft_consensus.cc:385] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.586432 1171 raft_consensus.cc:740] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:23.586571 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 737e9344fc824714a2c2596170637158 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 737e9344fc824714a2c2596170637158 already in progress: creating tablet
I20260617 07:53:23.586678 1171 consensus_queue.cc:260] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.586918 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 391) took 4788 ms. Trace:
I20260617 07:53:23.587025 1170 rpcz_store.cc:276] 0617 07:53:18.798072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.799066 (+ 994us) service_pool.cc:224] Handling call
0617 07:53:23.586831 (+4787765us) ts_tablet_manager.cc:1151] Deleting tablet 52af94bd46c941b8a27136ca0506e744
0617 07:53:23.586839 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.586904 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4785337}
I20260617 07:53:23.587250 1171 ts_tablet_manager.cc:1434] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260617 07:53:23.587455 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 52af94bd46c941b8a27136ca0506e744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52af94bd46c941b8a27136ca0506e744 already in progress: creating tablet
I20260617 07:53:23.587566 1171 tablet_bootstrap.cc:492] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:23.587821 1170 tablet_replica.cc:333] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:23.588397 1170 raft_consensus.cc:2243] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.592515 1862 ts_tablet_manager.cc:1929] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:23.592693 1862 log.cc:1199] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/df5bbdbcf3044128a4cb274f83d5d29b
I20260617 07:53:23.593125 1862 ts_tablet_manager.cc:1950] T df5bbdbcf3044128a4cb274f83d5d29b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:23.594039 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 603) took 1462 ms. Trace:
I20260617 07:53:23.594168 1862 rpcz_store.cc:276] 0617 07:53:22.131482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.135543 (+ 4061us) service_pool.cc:224] Handling call
0617 07:53:23.576889 (+1441346us) ts_tablet_manager.cc:1151] Deleting tablet df5bbdbcf3044128a4cb274f83d5d29b
0617 07:53:23.576898 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.589528 (+ 12630us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.592468 (+ 2940us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.594020 (+ 1552us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1441140}
I20260617 07:53:23.594538 1862 tablet_replica.cc:333] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:23.594767 1862 raft_consensus.cc:2243] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.594800 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet df5bbdbcf3044128a4cb274f83d5d29b (table default.Table_aab2b789b2dc48719838e0704687a406 [id=e42c6141367a4922ace753fd8ccf8463]) successfully deleted
I20260617 07:53:23.595106 1178 tablet_bootstrap.cc:492] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:23.595242 1178 ts_tablet_manager.cc:1403] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.002s
I20260617 07:53:23.595463 1862 raft_consensus.cc:2272] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.596004 1862 ts_tablet_manager.cc:1916] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.596341 1178 raft_consensus.cc:359] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.596570 1178 raft_consensus.cc:385] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.596668 1178 raft_consensus.cc:740] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.596946 1178 consensus_queue.cc:260] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.597678 1178 ts_tablet_manager.cc:1434] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:23.598023 1178 tablet_bootstrap.cc:492] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:23.598428 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_44474dc1c911457d832d458ce32ec14c" } modify_external_catalogs: true
I20260617 07:53:23.598637 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_44474dc1c911457d832d458ce32ec14c" } modify_external_catalogs: true
I20260617 07:53:23.599663 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3dc653e501984d0b9ab8f960d94fb7a3" } modify_external_catalogs: true
I20260617 07:53:23.599828 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3dc653e501984d0b9ab8f960d94fb7a3" } modify_external_catalogs: true
I20260617 07:53:23.600435 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3d33f4de2ef8400f890dd460c137cd88" } modify_external_catalogs: true
I20260617 07:53:23.592926 2719 raft_consensus.cc:493] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:23.600580 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3d33f4de2ef8400f890dd460c137cd88" } modify_external_catalogs: true
I20260617 07:53:23.600668 2719 raft_consensus.cc:515] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:23.600018 988 leader_election.cc:343] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.601281 2719 leader_election.cc:290] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:23.600881 988 leader_election.cc:304] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.601701 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.602164 766 raft_consensus.cc:2468] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:23.602305 2719 raft_consensus.cc:2749] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.602679 986 leader_election.cc:304] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:23.602921 2719 raft_consensus.cc:2804] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 07:53:23.600479 1046 raft_consensus.cc:2468] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:23.603004 2719 raft_consensus.cc:493] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:23.603070 2719 raft_consensus.cc:3060] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:23.603407 851 leader_election.cc:304] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.603777 2594 raft_consensus.cc:2804] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:23.603884 2594 raft_consensus.cc:697] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:23.604082 2594 consensus_queue.cc:237] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.605475 2719 raft_consensus.cc:515] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.606495 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:23.606640 766 raft_consensus.cc:3060] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 2
W20260617 07:53:23.609187 988 leader_election.cc:343] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: cbc79cfa11e342bd87da1aa03847c3cb
I20260617 07:53:23.609215 766 raft_consensus.cc:2468] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 2.
I20260617 07:53:23.609875 986 leader_election.cc:304] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:23.610309 2719 leader_election.cc:290] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:23.610550 2719 raft_consensus.cc:2804] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Leader election won for term 2
I20260617 07:53:23.610790 2719 raft_consensus.cc:697] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:23.611052 2719 consensus_queue.cc:237] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:23.612942 988 leader_election.cc:343] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: cbc79cfa11e342bd87da1aa03847c3cb
I20260617 07:53:23.613428 1170 raft_consensus.cc:2272] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.614122 1172 tablet_bootstrap.cc:492] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:23.614313 1172 ts_tablet_manager.cc:1403] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.090s user 0.003s sys 0.000s
I20260617 07:53:23.615164 1172 raft_consensus.cc:359] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.615430 1172 raft_consensus.cc:385] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.615540 1172 raft_consensus.cc:740] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.616122 1172 consensus_queue.cc:260] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.616266 2711 raft_consensus.cc:493] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.616401 2711 raft_consensus.cc:515] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.616904 1172 ts_tablet_manager.cc:1434] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:23.616976 2711 leader_election.cc:290] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.617195 1172 tablet_bootstrap.cc:492] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:23.618305 716 leader_election.cc:343] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 92e55be5f28740fba65c1199a571d97a
I20260617 07:53:23.618639 1172 tablet_bootstrap.cc:654] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.618799 1862 ts_tablet_manager.cc:1929] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 07:53:23.618912 713 leader_election.cc:343] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 92e55be5f28740fba65c1199a571d97a
I20260617 07:53:23.619014 713 leader_election.cc:304] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:23.619241 1170 ts_tablet_manager.cc:1916] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.619335 2711 raft_consensus.cc:2749] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.628489 1846 ts_tablet_manager.cc:1929] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.621582 2775 raft_consensus.cc:493] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.635814 2775 raft_consensus.cc:515] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.637116 2775 leader_election.cc:290] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.637300 1862 log.cc:1199] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/3fcf87953dc14bf190ac74101547e52f
I20260617 07:53:23.637648 1862 ts_tablet_manager.cc:1950] T 3fcf87953dc14bf190ac74101547e52f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:23.638157 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0ff0f0426440fba477a3dc4d1644e0" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.638402 1046 raft_consensus.cc:2468] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:23.638833 851 leader_election.cc:304] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:23.639060 2775 raft_consensus.cc:2804] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:23.639148 2775 raft_consensus.cc:493] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:23.639209 2775 raft_consensus.cc:3060] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.641866 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet b7d4fc81456445518c1158f912dd2f8f (table default.Table_acb19b0a19f54fe9a4be9d22be8f44b7 [id=18b40cd6665e42f793ddb27a1dacbe73]). Expected version 1 got 0
I20260617 07:53:23.642190 1846 log.cc:1199] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/5dcfb101cf51487692ef9a6a17f40804
I20260617 07:53:23.642196 456 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 8cf4025a0f784cc6868950e51a45da2e (table default.Table_162d3b6e1d5749068f166f820520acc0 [id=bf143b9baca647f0b25452d16dff2ae6]). Expected version 1 got 0
I20260617 07:53:23.642532 1846 ts_tablet_manager.cc:1950] T 5dcfb101cf51487692ef9a6a17f40804 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:23.642890 2775 raft_consensus.cc:515] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.643477 2775 leader_election.cc:290] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.643545 455 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_c051617d86bd42ffbe4f600511e96381 [id=4e86a2cea5304843b61370201d4d13b6] alter complete (version 2)
I20260617 07:53:23.644941 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0ff0f0426440fba477a3dc4d1644e0" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:23.644897 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_5caf6314d3724712839ea92d5e377ef6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.645004 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 606) took 1494 ms. Trace:
I20260617 07:53:23.645087 1046 raft_consensus.cc:3060] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.645080 1862 rpcz_store.cc:276] 0617 07:53:22.144038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.152586 (+ 8548us) service_pool.cc:224] Handling call
0617 07:53:23.594497 (+1441911us) ts_tablet_manager.cc:1151] Deleting tablet 3fcf87953dc14bf190ac74101547e52f
0617 07:53:23.594505 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.599335 (+ 4830us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.618739 (+ 19404us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.638457 (+ 19718us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1441749}
W20260617 07:53:23.645445 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5caf6314d3724712839ea92d5e377ef6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.645843 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0ff0f0426440fba477a3dc4d1644e0" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:23.646291 852 leader_election.cc:343] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.646513 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 3fcf87953dc14bf190ac74101547e52f (table default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]) successfully deleted
I20260617 07:53:23.646737 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f8602b87a20455884c16196a901d335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.647068 882 tablet_service.cc:1558] Processing DeleteTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.647244 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.647564 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 609) took 1403 ms. Trace:
I20260617 07:53:23.647668 1862 rpcz_store.cc:276] 0617 07:53:22.243655 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.243703 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:23.647454 (+1403751us) ts_tablet_manager.cc:1151] Deleting tablet 18e866278bb64196ba96e7d870195362
0617 07:53:23.647464 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.647549 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1403571}
W20260617 07:53:23.648192 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 18e866278bb64196ba96e7d870195362 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18e866278bb64196ba96e7d870195362 already in progress: creating tablet
I20260617 07:53:23.649012 880 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.649333 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 619) took 1354 ms. Trace:
I20260617 07:53:23.649771 1862 rpcz_store.cc:276] 0617 07:53:22.294516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.294563 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:23.648125 (+1353562us) ts_tablet_manager.cc:1151] Deleting tablet 6a6e2bb6577648d2ab958cfaa6f4a948
0617 07:53:23.649210 (+ 1085us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.649318 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1334243}
W20260617 07:53:23.650339 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a6e2bb6577648d2ab958cfaa6f4a948 already in progress: creating tablet
I20260617 07:53:23.650961 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 620) took 1356 ms. Trace:
I20260617 07:53:23.651682 1862 rpcz_store.cc:276] 0617 07:53:22.294721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.294787 (+ 66us) service_pool.cc:224] Handling call
0617 07:53:23.650785 (+1355998us) ts_tablet_manager.cc:1151] Deleting tablet 9c86376216db4788b38bd55248e03f73
0617 07:53:23.650794 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.650946 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321062}
I20260617 07:53:23.651885 1046 raft_consensus.cc:2468] T cb0ff0f0426440fba477a3dc4d1644e0 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:23.629292 1178 tablet_bootstrap.cc:654] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.636886 766 raft_consensus.cc:3060] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:23.652956 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 9c86376216db4788b38bd55248e03f73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c86376216db4788b38bd55248e03f73 already in progress: creating tablet
I20260617 07:53:23.653040 745 tablet_service.cc:1511] Processing CreateTablet for tablet 87583f583c13496a816062a70f62905b (DEFAULT_TABLE table=default.Table_11b717f1db3545778db3e785dec6d463 [id=3751ad4779a8418f813a8198a73976e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.653264 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 92d1398b4b604f75be1a3b46e5ac9b77
I20260617 07:53:23.653417 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87583f583c13496a816062a70f62905b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.653853 461 catalog_manager.cc:6784] ReplaceTablet: tablet 92d1398b4b604f75be1a3b46e5ac9b77 deleted and replaced by tablet af26f5e478af43eea21094621879d95c
W20260617 07:53:23.654611 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet f30f0bbfdf404569a417662861b06f73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f30f0bbfdf404569a417662861b06f73 already in progress: creating tablet
I20260617 07:53:23.655150 851 leader_election.cc:304] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.655429 2775 raft_consensus.cc:2804] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:23.637682 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0ff0f0426440fba477a3dc4d1644e0" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.655596 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 92d1398b4b604f75be1a3b46e5ac9b77 with delete_type TABLET_DATA_DELETED (replaced by tablet af26f5e478af43eea21094621879d95c) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.655968 2775 raft_consensus.cc:697] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:23.656098 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 0b479c2984934852a864699b66416538
I20260617 07:53:23.656081 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 92d1398b4b604f75be1a3b46e5ac9b77 with delete_type TABLET_DATA_DELETED (replaced by tablet af26f5e478af43eea21094621879d95c) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.656351 2775 consensus_queue.cc:237] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.657605 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 8d58c09bfda64ad2aa42ecfbd413c6ef
I20260617 07:53:23.657649 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b479c2984934852a864699b66416538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.658746 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b479c2984934852a864699b66416538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.658886 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 92d1398b4b604f75be1a3b46e5ac9b77 with delete_type TABLET_DATA_DELETED (replaced by tablet af26f5e478af43eea21094621879d95c) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.658980 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.659054 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:23.659627 852 leader_election.cc:343] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.659665 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.659946 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b479c2984934852a864699b66416538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.660610 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 8607c3a4744a4eeb882f1e913875ee1f
I20260617 07:53:23.661698 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 8607c3a4744a4eeb882f1e913875ee1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.661966 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 8607c3a4744a4eeb882f1e913875ee1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.662364 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 8607c3a4744a4eeb882f1e913875ee1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.662870 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 12727ad13f0747ce8d9710a71ba2c075
W20260617 07:53:23.662935 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e9488e8a501e404f85540fb045d8916f because the tablet was not found. No further retry: Not found: Tablet not found: e9488e8a501e404f85540fb045d8916f
I20260617 07:53:23.663436 1862 tablet_replica.cc:333] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:23.663425 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 213d76d2aa1a41d5951aa093d09d9ce6
I20260617 07:53:23.663544 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 12727ad13f0747ce8d9710a71ba2c075 with delete_type TABLET_DATA_DELETED (replaced by tablet 23f8d24fe94b4b48acd0030c4276944e) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.663692 1862 raft_consensus.cc:2243] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:23.663939 1862 pending_rounds.cc:70] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:23.663914 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 12727ad13f0747ce8d9710a71ba2c075 with delete_type TABLET_DATA_DELETED (replaced by tablet 23f8d24fe94b4b48acd0030c4276944e) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.664498 453 catalog_manager.cc:6784] ReplaceTablet: tablet 12727ad13f0747ce8d9710a71ba2c075 deleted and replaced by tablet 23f8d24fe94b4b48acd0030c4276944e
I20260617 07:53:23.664793 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3e620975807b4d4a895271b6fadd9c5a" } modify_external_catalogs: true
I20260617 07:53:23.666096 1172 tablet_bootstrap.cc:492] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:23.666286 1172 ts_tablet_manager.cc:1403] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20260617 07:53:23.667043 1172 raft_consensus.cc:359] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.667449 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_da921136077749c8bf90acd3f0394183" } new_table_name: "default.Table_e644a9b3fc894230be9890dac8017a23" modify_external_catalogs: true
I20260617 07:53:23.667785 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 599) took 4196 ms. Trace:
I20260617 07:53:23.668017 1172 raft_consensus.cc:385] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.667925 1846 rpcz_store.cc:276] 0617 07:53:19.471604 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.471917 (+ 313us) service_pool.cc:224] Handling call
0617 07:53:23.397171 (+3925254us) ts_tablet_manager.cc:1151] Deleting tablet 5dcfb101cf51487692ef9a6a17f40804
0617 07:53:23.397178 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.569355 (+172177us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.628425 (+ 59070us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.667768 (+ 39343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3911206}
I20260617 07:53:23.668164 1172 raft_consensus.cc:740] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.664300 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 12727ad13f0747ce8d9710a71ba2c075 with delete_type TABLET_DATA_DELETED (replaced by tablet 23f8d24fe94b4b48acd0030c4276944e) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.668563 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 600) took 4193 ms. Trace:
I20260617 07:53:23.668630 1846 rpcz_store.cc:276] 0617 07:53:19.475527 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.476239 (+ 712us) service_pool.cc:224] Handling call
0617 07:53:23.668438 (+4192199us) ts_tablet_manager.cc:1151] Deleting tablet 630e540a77374c11895ab5a0e394b3bb
0617 07:53:23.668448 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.668547 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4181511}
I20260617 07:53:23.668780 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 213d76d2aa1a41d5951aa093d09d9ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.669945 1846 tablet_replica.cc:333] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:23.670001 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_92c75dbb95d641cdb2ca3d3b2841e7c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.670125 1846 raft_consensus.cc:2243] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.670251 1846 raft_consensus.cc:2272] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.670547 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3e620975807b4d4a895271b6fadd9c5a" } modify_external_catalogs: true
I20260617 07:53:23.670791 1846 ts_tablet_manager.cc:1916] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.670816 1172 consensus_queue.cc:260] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.671113 2719 raft_consensus.cc:493] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.671218 2594 raft_consensus.cc:493] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.671226 2719 raft_consensus.cc:515] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.671337 2594 raft_consensus.cc:515] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.671880 2719 leader_election.cc:290] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:23.672043 2594 leader_election.cc:290] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.672238 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 213d76d2aa1a41d5951aa093d09d9ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.672617 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d965aa4e8dc244cdb93dd15cdee9070c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.672588 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 87583f583c13496a816062a70f62905b (DEFAULT_TABLE table=default.Table_11b717f1db3545778db3e785dec6d463 [id=3751ad4779a8418f813a8198a73976e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.672935 1172 ts_tablet_manager.cc:1434] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260617 07:53:23.673161 2711 raft_consensus.cc:493] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.673139 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d965aa4e8dc244cdb93dd15cdee9070c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:23.673239 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d because the tablet was not found. No further retry: Not found: Tablet not found: 35120ce002f24f2bb1ea0fdc59fbfc9d
I20260617 07:53:23.673270 2711 raft_consensus.cc:515] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.673830 2711 leader_election.cc:290] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.673960 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 213d76d2aa1a41d5951aa093d09d9ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.672982 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87583f583c13496a816062a70f62905b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.674191 1172 tablet_bootstrap.cc:492] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:23.674559 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 5dcfb101cf51487692ef9a6a17f40804 (table default.Table_34fb38a5ef96468bbf08872ea10e8a5f [id=01a22a92af6f4e8ba076834cad8ba182]) successfully deleted
W20260617 07:53:23.675212 716 leader_election.cc:343] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 63de833f7aa740b0b5bf2494b78aca5c
W20260617 07:53:23.675341 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 630e540a77374c11895ab5a0e394b3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 630e540a77374c11895ab5a0e394b3bb already in progress: creating tablet
I20260617 07:53:23.675410 745 tablet_service.cc:1511] Processing CreateTablet for tablet 3d248d3bce0c4c19a9c07e94f875730a (DEFAULT_TABLE table=default.Table_ed31a6d0c55a4a94a78094d742064d5b [id=24cb031e9bfc4064a51fd7c61c254622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.675503 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55d63a25a2845dbbcce20e560361007" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.675760 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d248d3bce0c4c19a9c07e94f875730a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.676260 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63de833f7aa740b0b5bf2494b78aca5c" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.676329 880 tablet_service.cc:1511] Processing CreateTablet for tablet 87583f583c13496a816062a70f62905b (DEFAULT_TABLE table=default.Table_11b717f1db3545778db3e785dec6d463 [id=3751ad4779a8418f813a8198a73976e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.676679 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87583f583c13496a816062a70f62905b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.679760 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 2c120eba06a549ef88ffa19998ab0f3d from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:23.673513 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55d63a25a2845dbbcce20e560361007" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.680806 1046 raft_consensus.cc:2468] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:23.673790 988 leader_election.cc:343] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:23.681218 852 leader_election.cc:343] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:23.681275 986 leader_election.cc:343] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.681665 986 leader_election.cc:304] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.682310 2719 raft_consensus.cc:2749] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.682587 851 leader_election.cc:304] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.683578 1170 ts_tablet_manager.cc:1929] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.686147 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0b8d9a982e3f4e32b0be803ba561fde3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.687224 1170 log.cc:1199] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/e9488e8a501e404f85540fb045d8916f
W20260617 07:53:23.687381 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92c75dbb95d641cdb2ca3d3b2841e7c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.687923 1170 ts_tablet_manager.cc:1950] T e9488e8a501e404f85540fb045d8916f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:23.688751 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b8d9a982e3f4e32b0be803ba561fde3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.689687 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 382) took 4892 ms. Trace:
I20260617 07:53:23.694574 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:23.694777 713 leader_election.cc:304] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:23.694932 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:23.695752 2711 raft_consensus.cc:2749] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.696244 2710 raft_consensus.cc:2804] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:23.696360 2710 raft_consensus.cc:493] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:23.696453 2710 raft_consensus.cc:3060] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.696419 458 catalog_manager.cc:5696] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:23.696827 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]). Expected version 2 got 0
I20260617 07:53:23.696419 1170 rpcz_store.cc:276] 0617 07:53:18.797178 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.798795 (+ 1617us) service_pool.cc:224] Handling call
0617 07:53:23.587779 (+4788984us) ts_tablet_manager.cc:1151] Deleting tablet e9488e8a501e404f85540fb045d8916f
0617 07:53:23.587788 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.633566 (+ 45778us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.683531 (+ 49965us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.689668 (+ 6137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4786191}
I20260617 07:53:23.697599 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet e9488e8a501e404f85540fb045d8916f (table default.Table_bd56bbbe6c6146e0aed7c57090a64d9a [id=5a246dffaba54437a4400032419c5354]) successfully deleted
I20260617 07:53:23.698400 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 396) took 4897 ms. Trace:
I20260617 07:53:23.700868 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 3d248d3bce0c4c19a9c07e94f875730a (DEFAULT_TABLE table=default.Table_ed31a6d0c55a4a94a78094d742064d5b [id=24cb031e9bfc4064a51fd7c61c254622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.701774 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d248d3bce0c4c19a9c07e94f875730a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.702212 755 tablet_service.cc:1511] Processing CreateTablet for tablet b1f095603e54419784d5a30a687da8b4 (DEFAULT_TABLE table=default.Table_8dbb24d4baa74d3ead856d3868c80b58 [id=23b241d571ce48e7927c051c09d36110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.702538 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f095603e54419784d5a30a687da8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.706609 1014 tablet_service.cc:1511] Processing CreateTablet for tablet b1f095603e54419784d5a30a687da8b4 (DEFAULT_TABLE table=default.Table_8dbb24d4baa74d3ead856d3868c80b58 [id=23b241d571ce48e7927c051c09d36110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.706954 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f095603e54419784d5a30a687da8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.708784 1015 tablet_service.cc:1511] Processing CreateTablet for tablet fe52884fb6784b10a7da0bbb1b667031 (DEFAULT_TABLE table=default.Table_0ef664bf28d1471db39370a9172cc5b7 [id=a9c2ec17a15b4cfdbb91647a1366ae10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.709102 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe52884fb6784b10a7da0bbb1b667031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.714195 1172 tablet_bootstrap.cc:654] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.718397 756 tablet_service.cc:1511] Processing CreateTablet for tablet fe52884fb6784b10a7da0bbb1b667031 (DEFAULT_TABLE table=default.Table_0ef664bf28d1471db39370a9172cc5b7 [id=a9c2ec17a15b4cfdbb91647a1366ae10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.718896 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe52884fb6784b10a7da0bbb1b667031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.721772 744 tablet_service.cc:1511] Processing CreateTablet for tablet 50c294315a9443aab142c876f4c07f71 (DEFAULT_TABLE table=default.Table_9ebb0aa425c346c8a16082be1e0d84d1 [id=31f9a606ae9a4cbda5b79b3a638b411e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.722131 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c294315a9443aab142c876f4c07f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.723663 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_dedabee714284438970630039e5ab9b3 [id=5cbacc3e094b4c6184605bc50566e275] alter complete (version 4)
I20260617 07:53:23.723968 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 50c294315a9443aab142c876f4c07f71 (DEFAULT_TABLE table=default.Table_9ebb0aa425c346c8a16082be1e0d84d1 [id=31f9a606ae9a4cbda5b79b3a638b411e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.724315 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c294315a9443aab142c876f4c07f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.724890 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_37fb232762ab44cdb03ff6b8cb54866f" } new_table_name: "default.Table_4ff583bf5ea445799ee33a2608a696fb" modify_external_catalogs: true
I20260617 07:53:23.725503 1170 rpcz_store.cc:276] 0617 07:53:18.800771 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.801614 (+ 843us) service_pool.cc:224] Handling call
0617 07:53:23.698261 (+4896647us) ts_tablet_manager.cc:1151] Deleting tablet ce7cb453c7b647f298a6ebe20fd0e45b
0617 07:53:23.698274 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.698380 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4896508}
I20260617 07:53:23.726019 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 398) took 4921 ms. Trace:
I20260617 07:53:23.726148 1170 rpcz_store.cc:276] 0617 07:53:18.804385 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.804430 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:23.725908 (+4921478us) ts_tablet_manager.cc:1151] Deleting tablet df5224716de249e9be9d7239407579a9
0617 07:53:23.725916 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.726005 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4921333}
I20260617 07:53:23.726193 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_162d3b6e1d5749068f166f820520acc0" } new_table_name: "default.Table_d36bea18179d4ba992d8795ee73dc19a" modify_external_catalogs: true
I20260617 07:53:23.726647 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 397) took 4923 ms. Trace:
I20260617 07:53:23.726759 1170 rpcz_store.cc:276] 0617 07:53:18.803670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.806533 (+ 2863us) service_pool.cc:224] Handling call
0617 07:53:23.726467 (+4919934us) ts_tablet_manager.cc:1151] Deleting tablet 71e8f7118aaf4c6a9b9caab5abc030fa
0617 07:53:23.726476 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.726632 (+ 156us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4919777}
I20260617 07:53:23.727093 1170 tablet_replica.cc:333] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:23.727309 1170 raft_consensus.cc:2243] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.727433 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d3f843a058bd449796d59b89e2470d8c
I20260617 07:53:23.727515 1170 raft_consensus.cc:2272] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.727838 459 catalog_manager.cc:6784] ReplaceTablet: tablet d3f843a058bd449796d59b89e2470d8c deleted and replaced by tablet 3580774486c94811987370d563951284
I20260617 07:53:23.728184 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_269e9513ae2943ddaf7ee4ecc2a21ab2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.728694 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_269e9513ae2943ddaf7ee4ecc2a21ab2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.736323 1846 ts_tablet_manager.cc:1929] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:23.736430 1846 log.cc:1199] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/3bee4c9cd9f2415ca54b8e85dbd326a7
I20260617 07:53:23.736730 1846 ts_tablet_manager.cc:1950] T 3bee4c9cd9f2415ca54b8e85dbd326a7 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:23.738435 1170 ts_tablet_manager.cc:1916] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.742892 1172 tablet_bootstrap.cc:492] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:23.743017 1172 ts_tablet_manager.cc:1403] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.000s
I20260617 07:53:23.743710 1172 raft_consensus.cc:359] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.743870 1172 raft_consensus.cc:385] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.743923 1172 raft_consensus.cc:740] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.744145 1172 consensus_queue.cc:260] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.747138 1172 ts_tablet_manager.cc:1434] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:23.747388 1172 tablet_bootstrap.cc:492] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:23.748679 1172 tablet_bootstrap.cc:654] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.748932 765 raft_consensus.cc:3060] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.749508 751 tablet_service.cc:1511] Processing CreateTablet for tablet 98c1fe5e5dcd433c8a61cd612c7f0964 (DEFAULT_TABLE table=default.Table_7428f353a6b44f5a8dccbec3ffa85b60 [id=09982f2ac5694303b363936a3e73cae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.749969 754 tablet_service.cc:1511] Processing CreateTablet for tablet d54e89cceebf4196b9c77572ed11caca (DEFAULT_TABLE table=default.Table_b26f5c668eb74dc89c5c17173eec4845 [id=94b5465598234b7eb42e41cf9e20f704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.750015 880 tablet_service.cc:1511] Processing CreateTablet for tablet 3d248d3bce0c4c19a9c07e94f875730a (DEFAULT_TABLE table=default.Table_ed31a6d0c55a4a94a78094d742064d5b [id=24cb031e9bfc4064a51fd7c61c254622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.750316 750 tablet_service.cc:1511] Processing CreateTablet for tablet a969954e858843698b07681fd32cd611 (DEFAULT_TABLE table=default.Table_b307d9b7a2d4490c8a53ab98064af6ee [id=d2d387734e9c423e98ce53ee2ee54483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.750401 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d248d3bce0c4c19a9c07e94f875730a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.750641 743 tablet_service.cc:1511] Processing CreateTablet for tablet 30df54937d31467ba48e5008225fcf12 (DEFAULT_TABLE table=default.Table_4dc0a667e5eb4b3892bb190938ea4571 [id=0eca6169b2354a04b53867fe95af8e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.751024 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c1fe5e5dcd433c8a61cd612c7f0964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.751791 2710 raft_consensus.cc:515] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:23.753082 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ce7cb453c7b647f298a6ebe20fd0e45b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce7cb453c7b647f298a6ebe20fd0e45b already in progress: creating tablet
I20260617 07:53:23.753104 747 tablet_service.cc:1511] Processing CreateTablet for tablet 1c269e5f94494e8fbc023b62d8614917 (DEFAULT_TABLE table=default.Table_a2d7aa9710d045a6a7a817672113e254 [id=2f1db75eef344b3d94d89f8b9349cdde]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:23.753315 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet df5224716de249e9be9d7239407579a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df5224716de249e9be9d7239407579a9 already in progress: creating tablet
W20260617 07:53:23.753487 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 71e8f7118aaf4c6a9b9caab5abc030fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71e8f7118aaf4c6a9b9caab5abc030fa already in progress: creating tablet
I20260617 07:53:23.754200 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c269e5f94494e8fbc023b62d8614917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.754756 1021 tablet_service.cc:1511] Processing CreateTablet for tablet d0e7cdd768ed418bacafeaf0ad5467d4 (DEFAULT_TABLE table=default.Table_f72d36eff72c4d83b7930336185143de [id=ff323df1810c477d9a95b4a88d844754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.755081 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e7cdd768ed418bacafeaf0ad5467d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.755121 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 98c1fe5e5dcd433c8a61cd612c7f0964 (DEFAULT_TABLE table=default.Table_7428f353a6b44f5a8dccbec3ffa85b60 [id=09982f2ac5694303b363936a3e73cae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.755395 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c1fe5e5dcd433c8a61cd612c7f0964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.755539 1016 tablet_service.cc:1511] Processing CreateTablet for tablet a969954e858843698b07681fd32cd611 (DEFAULT_TABLE table=default.Table_b307d9b7a2d4490c8a53ab98064af6ee [id=d2d387734e9c423e98ce53ee2ee54483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.756121 889 tablet_service.cc:1511] Processing CreateTablet for tablet b1f095603e54419784d5a30a687da8b4 (DEFAULT_TABLE table=default.Table_8dbb24d4baa74d3ead856d3868c80b58 [id=23b241d571ce48e7927c051c09d36110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.756469 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f095603e54419784d5a30a687da8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.756804 887 tablet_service.cc:1511] Processing CreateTablet for tablet d54e89cceebf4196b9c77572ed11caca (DEFAULT_TABLE table=default.Table_b26f5c668eb74dc89c5c17173eec4845 [id=94b5465598234b7eb42e41cf9e20f704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.756875 884 tablet_service.cc:1511] Processing CreateTablet for tablet a969954e858843698b07681fd32cd611 (DEFAULT_TABLE table=default.Table_b307d9b7a2d4490c8a53ab98064af6ee [id=d2d387734e9c423e98ce53ee2ee54483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.757938 898 tablet_service.cc:1511] Processing CreateTablet for tablet d0e7cdd768ed418bacafeaf0ad5467d4 (DEFAULT_TABLE table=default.Table_f72d36eff72c4d83b7930336185143de [id=ff323df1810c477d9a95b4a88d844754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.757939 1018 tablet_service.cc:1511] Processing CreateTablet for tablet d54e89cceebf4196b9c77572ed11caca (DEFAULT_TABLE table=default.Table_b26f5c668eb74dc89c5c17173eec4845 [id=94b5465598234b7eb42e41cf9e20f704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.758147 882 tablet_service.cc:1511] Processing CreateTablet for tablet fe52884fb6784b10a7da0bbb1b667031 (DEFAULT_TABLE table=default.Table_0ef664bf28d1471db39370a9172cc5b7 [id=a9c2ec17a15b4cfdbb91647a1366ae10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.758255 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54e89cceebf4196b9c77572ed11caca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.758416 879 tablet_service.cc:1511] Processing CreateTablet for tablet 8607c3a4744a4eeb882f1e913875ee1f (DEFAULT_TABLE table=default.Table_3d33f4de2ef8400f890dd460c137cd88 [id=90ccbc2a2b5f467bb19b3905e5bb7703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.758580 892 tablet_service.cc:1511] Processing CreateTablet for tablet 50c294315a9443aab142c876f4c07f71 (DEFAULT_TABLE table=default.Table_9ebb0aa425c346c8a16082be1e0d84d1 [id=31f9a606ae9a4cbda5b79b3a638b411e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.758873 885 tablet_service.cc:1511] Processing CreateTablet for tablet 98c1fe5e5dcd433c8a61cd612c7f0964 (DEFAULT_TABLE table=default.Table_7428f353a6b44f5a8dccbec3ffa85b60 [id=09982f2ac5694303b363936a3e73cae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.758905 883 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f843a058bd449796d59b89e2470d8c with delete_type TABLET_DATA_DELETED (replaced by tablet 3580774486c94811987370d563951284) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.759274 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 30df54937d31467ba48e5008225fcf12 (DEFAULT_TABLE table=default.Table_4dc0a667e5eb4b3892bb190938ea4571 [id=0eca6169b2354a04b53867fe95af8e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.759407 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f843a058bd449796d59b89e2470d8c with delete_type TABLET_DATA_DELETED (replaced by tablet 3580774486c94811987370d563951284) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.759564 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30df54937d31467ba48e5008225fcf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.759774 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 8607c3a4744a4eeb882f1e913875ee1f (DEFAULT_TABLE table=default.Table_3d33f4de2ef8400f890dd460c137cd88 [id=90ccbc2a2b5f467bb19b3905e5bb7703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.759859 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a969954e858843698b07681fd32cd611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.760110 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c1fe5e5dcd433c8a61cd612c7f0964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.760658 883 tablet_service.cc:1511] Processing CreateTablet for tablet 1c269e5f94494e8fbc023b62d8614917 (DEFAULT_TABLE table=default.Table_a2d7aa9710d045a6a7a817672113e254 [id=2f1db75eef344b3d94d89f8b9349cdde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.760962 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c269e5f94494e8fbc023b62d8614917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.761236 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54e89cceebf4196b9c77572ed11caca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.761231 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a969954e858843698b07681fd32cd611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.761757 896 tablet_service.cc:1511] Processing CreateTablet for tablet 30df54937d31467ba48e5008225fcf12 (DEFAULT_TABLE table=default.Table_4dc0a667e5eb4b3892bb190938ea4571 [id=0eca6169b2354a04b53867fe95af8e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.762044 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30df54937d31467ba48e5008225fcf12. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.765589 422 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu pid 1856: Timed out: CheckLeaks RPC to 127.0.105.189:36505 timed out after 1.000s (SENT)
I20260617 07:53:23.765748 422 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu with pid 1856
I20260617 07:53:23.766539 743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30df54937d31467ba48e5008225fcf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.767241 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8607c3a4744a4eeb882f1e913875ee1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.767416 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e7cdd768ed418bacafeaf0ad5467d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.759783 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a969954e858843698b07681fd32cd611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.769680 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet e03a26e301e747febc4d5bafdc1a49c6 with delete_type TABLET_DATA_DELETED (replaced by tablet d7b981da1d2e4862824e933dc8babefc) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.769948 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54e89cceebf4196b9c77572ed11caca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.772816 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 1c269e5f94494e8fbc023b62d8614917 (DEFAULT_TABLE table=default.Table_a2d7aa9710d045a6a7a817672113e254 [id=2f1db75eef344b3d94d89f8b9349cdde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.773679 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c269e5f94494e8fbc023b62d8614917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.773849 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c294315a9443aab142c876f4c07f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.774353 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe52884fb6784b10a7da0bbb1b667031. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.779141 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a2dc449c88d4008a38c42eca25a283c consensus state has no leader
I20260617 07:53:23.781658 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8607c3a4744a4eeb882f1e913875ee1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.781932 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 2c120eba06a549ef88ffa19998ab0f3d
I20260617 07:53:23.782051 755 tablet_service.cc:1511] Processing CreateTablet for tablet 8607c3a4744a4eeb882f1e913875ee1f (DEFAULT_TABLE table=default.Table_3d33f4de2ef8400f890dd460c137cd88 [id=90ccbc2a2b5f467bb19b3905e5bb7703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.782384 452 catalog_manager.cc:6784] ReplaceTablet: tablet 2c120eba06a549ef88ffa19998ab0f3d deleted and replaced by tablet 7345590f49894b7a8f7a1e7e4b26c2ef
I20260617 07:53:23.782459 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8607c3a4744a4eeb882f1e913875ee1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.782701 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_49d8c7380b994564bafb7bb0440015b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.783279 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49d8c7380b994564bafb7bb0440015b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.784507 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet e5544753b3144c1989f2ed99bffc2246
I20260617 07:53:23.785156 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_371edc94a4fe40deb6394344e8ead730"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.785681 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_371edc94a4fe40deb6394344e8ead730 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.786023 744 tablet_service.cc:1511] Processing CreateTablet for tablet d0e7cdd768ed418bacafeaf0ad5467d4 (DEFAULT_TABLE table=default.Table_f72d36eff72c4d83b7930336185143de [id=ff323df1810c477d9a95b4a88d844754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.786163 2710 leader_election.cc:290] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.786384 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e7cdd768ed418bacafeaf0ad5467d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.786801 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55d63a25a2845dbbcce20e560361007" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:23.786948 1046 raft_consensus.cc:3060] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.787061 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_143edf6137ce4646bda2af36a72fd7af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:23.787452 1170 ts_tablet_manager.cc:1929] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 07:53:23.787498 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_143edf6137ce4646bda2af36a72fd7af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.787542 1170 log.cc:1199] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d965aa4e8dc244cdb93dd15cdee9070c
I20260617 07:53:23.787817 1170 ts_tablet_manager.cc:1950] T d965aa4e8dc244cdb93dd15cdee9070c P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:23.788520 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 399) took 4983 ms. Trace:
I20260617 07:53:23.788599 1170 rpcz_store.cc:276] 0617 07:53:18.806492 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.806757 (+ 265us) service_pool.cc:224] Handling call
0617 07:53:23.727055 (+4920298us) ts_tablet_manager.cc:1151] Deleting tablet d965aa4e8dc244cdb93dd15cdee9070c
0617 07:53:23.727063 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.741296 (+ 14233us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.787410 (+ 46114us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.788503 (+ 1093us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4920142}
I20260617 07:53:23.788772 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_864d7fa9dccb4fd98be4356a0c0678f0" } new_table_name: "default.Table_de8577690a594723aa13b26d443a3b75" modify_external_catalogs: true
I20260617 07:53:23.789577 1046 raft_consensus.cc:2468] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:23.789657 756 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f843a058bd449796d59b89e2470d8c with delete_type TABLET_DATA_DELETED (replaced by tablet 3580774486c94811987370d563951284) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.790048 851 leader_election.cc:304] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:23.790297 2710 raft_consensus.cc:2804] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:23.790380 2710 raft_consensus.cc:697] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:23.792058 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c120eba06a549ef88ffa19998ab0f3d with delete_type TABLET_DATA_DELETED (replaced by tablet 7345590f49894b7a8f7a1e7e4b26c2ef) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.792397 758 tablet_service.cc:1511] Processing CreateTablet for tablet 03e61c7fa45045d9bedd385b4e11a2bd (DEFAULT_TABLE table=default.Table_bb35b478e847496f90b3ddb167a02383 [id=6e62da034afd499a8aa00dad4a693270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.792737 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e61c7fa45045d9bedd385b4e11a2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.793274 2799 tablet.cc:1724] T 370c8ddac0c747f6b44926f982233ea9 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:23.794145 742 tablet_service.cc:1511] Processing CreateTablet for tablet 74cec8197aa543a9a064fb73a9c0023b (DEFAULT_TABLE table=default.Table_c7c85ec02b084cebbe2e437afa71f3e4 [id=45cb464e9d704d8c8c50da7eede27062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.794194 741 tablet_service.cc:1558] Processing DeleteTablet for tablet e5544753b3144c1989f2ed99bffc2246 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.794474 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74cec8197aa543a9a064fb73a9c0023b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.794603 748 tablet_service.cc:1511] Processing CreateTablet for tablet ff67e763f24e4d6289ff0d3d3c8e8afc (DEFAULT_TABLE table=default.Table_a3a4eb2e45ac47a7a0fef33dc402a4c2 [id=cec4a230005d4e42b37e2e61245f1340]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.794927 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff67e763f24e4d6289ff0d3d3c8e8afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.794904 741 tablet_service.cc:1511] Processing CreateTablet for tablet 61ac530afa7640d4911b4b4fd3e07e7e (DEFAULT_TABLE table=default.Table_1ba8fcc807224287b958cd9273dd474a [id=ab4a27d530404f09bbc56a946bd4822d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.795308 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ac530afa7640d4911b4b4fd3e07e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.796365 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 601) took 4314 ms. Trace:
I20260617 07:53:23.797650 1846 rpcz_store.cc:276] 0617 07:53:19.482821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.482877 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:23.669901 (+4187024us) ts_tablet_manager.cc:1151] Deleting tablet 3bee4c9cd9f2415ca54b8e85dbd326a7
0617 07:53:23.669909 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.700050 (+ 30141us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.736275 (+ 36225us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:23.796347 (+ 60072us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4181405}
I20260617 07:53:23.798349 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 3bee4c9cd9f2415ca54b8e85dbd326a7 (table default.Table_47a904a2ae6045519235b5988330eeff [id=a2296f2b299d464f8e70d9dce376b4a6]) successfully deleted
I20260617 07:53:23.798861 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 602) took 4310 ms. Trace:
I20260617 07:53:23.799207 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 400) took 4992 ms. Trace:
I20260617 07:53:23.800658 746 tablet_service.cc:1511] Processing CreateTablet for tablet b58c8595020b44e38690ec05c5d7bedd (DEFAULT_TABLE table=default.Table_0a8b95e63e0d47cd8b03857112efe394 [id=dcdf21b9cf5b405e882555065b0523f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.800750 1170 rpcz_store.cc:276] 0617 07:53:18.807071 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.807148 (+ 77us) service_pool.cc:224] Handling call
0617 07:53:23.799119 (+4991971us) ts_tablet_manager.cc:1151] Deleting tablet 7934f5fa0287427cb45fe568f0de8758
0617 07:53:23.799127 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.799186 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4991808}
I20260617 07:53:23.800998 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58c8595020b44e38690ec05c5d7bedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.804744 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 402) took 4990 ms. Trace:
I20260617 07:53:23.804819 1170 rpcz_store.cc:276] 0617 07:53:18.814296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.814345 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:23.804653 (+4990308us) ts_tablet_manager.cc:1151] Deleting tablet 121339ab4842432e9fb7bc357750f8ad
0617 07:53:23.804667 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.804727 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4990145}
I20260617 07:53:23.806921 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 403) took 4992 ms. Trace:
I20260617 07:53:23.807001 1170 rpcz_store.cc:276] 0617 07:53:18.814703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.814774 (+ 71us) service_pool.cc:224] Handling call
0617 07:53:23.806847 (+4992073us) ts_tablet_manager.cc:1151] Deleting tablet f15dcc10552d4747bad436538662bb66
0617 07:53:23.806855 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.806909 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4991921}
I20260617 07:53:23.807976 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 404) took 4988 ms. Trace:
I20260617 07:53:23.808081 1170 rpcz_store.cc:276] 0617 07:53:18.820152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.820202 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:23.807861 (+4987659us) ts_tablet_manager.cc:1151] Deleting tablet adbbe7eb5181431290f57ed9128181a3
0617 07:53:23.807869 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.807955 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4987502}
I20260617 07:53:23.808641 1172 tablet_bootstrap.cc:492] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:23.813932 1172 ts_tablet_manager.cc:1403] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.000s
I20260617 07:53:23.814569 2629 raft_consensus.cc:493] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:23.814707 2629 raft_consensus.cc:515] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.815313 2629 leader_election.cc:290] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:23.815843 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca402543247461aa5384abb65fff364" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:23.816331 986 leader_election.cc:343] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.810353 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 405) took 4989 ms. Trace:
I20260617 07:53:23.816965 1170 rpcz_store.cc:276] 0617 07:53:18.820540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.820583 (+ 43us) service_pool.cc:224] Handling call
0617 07:53:23.810240 (+4989657us) ts_tablet_manager.cc:1151] Deleting tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3
0617 07:53:23.810248 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.810340 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4989524}
I20260617 07:53:23.817521 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 406) took 4990 ms. Trace:
I20260617 07:53:23.817642 1170 rpcz_store.cc:276] 0617 07:53:18.827557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.827611 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:23.817433 (+4989822us) ts_tablet_manager.cc:1151] Deleting tablet 3e3d05dcda274f288aebc279aba3e10a
0617 07:53:23.817445 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.817505 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4989617}
I20260617 07:53:23.818002 2629 raft_consensus.cc:493] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.818121 2629 raft_consensus.cc:515] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.801899 2710 consensus_queue.cc:237] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.818645 2629 leader_election.cc:290] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:23.819312 880 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd85a62edfb4c678c3035d1cf965e3b (DEFAULT_TABLE table=default.Table_138f2e00f28c4300b2ac9c69b77c2cfb [id=07e9cc8078d04e839e8735a9d7510d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.819389 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:23.819587 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55d63a25a2845dbbcce20e560361007" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:23.819690 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd85a62edfb4c678c3035d1cf965e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.820833 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9777d3619743cf8df19cf93f97f50a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:23.821316 986 leader_election.cc:343] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.821986 1172 raft_consensus.cc:359] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.822980 1172 raft_consensus.cc:385] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.823196 1172 raft_consensus.cc:740] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.823665 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 407) took 4995 ms. Trace:
I20260617 07:53:23.824440 1170 rpcz_store.cc:276] 0617 07:53:18.828002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.828047 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:23.823581 (+4995534us) ts_tablet_manager.cc:1151] Deleting tablet 53108a2d6c8b4398a568c14df8e0a23e
0617 07:53:23.823591 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.823652 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4995374}
I20260617 07:53:23.823643 1172 consensus_queue.cc:260] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.824947 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c120eba06a549ef88ffa19998ab0f3d with delete_type TABLET_DATA_DELETED (replaced by tablet 7345590f49894b7a8f7a1e7e4b26c2ef) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.825042 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 408) took 4996 ms. Trace:
I20260617 07:53:23.825105 1170 rpcz_store.cc:276] 0617 07:53:18.828790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.828839 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:23.824926 (+4996087us) ts_tablet_manager.cc:1151] Deleting tablet c9657e0dd2a8459cb728bdfe8a68b840
0617 07:53:23.824934 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.825028 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4995925}
I20260617 07:53:23.825656 1172 ts_tablet_manager.cc:1434] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260617 07:53:23.827626 1172 tablet_bootstrap.cc:492] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:23.828094 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 03e61c7fa45045d9bedd385b4e11a2bd (DEFAULT_TABLE table=default.Table_bb35b478e847496f90b3ddb167a02383 [id=6e62da034afd499a8aa00dad4a693270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.829282 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 61ac530afa7640d4911b4b4fd3e07e7e (DEFAULT_TABLE table=default.Table_1ba8fcc807224287b958cd9273dd474a [id=ab4a27d530404f09bbc56a946bd4822d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.828549 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 74cec8197aa543a9a064fb73a9c0023b (DEFAULT_TABLE table=default.Table_c7c85ec02b084cebbe2e437afa71f3e4 [id=45cb464e9d704d8c8c50da7eede27062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.829509 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d965aa4e8dc244cdb93dd15cdee9070c (table default.Table_5cf044f7f8984fdc9c0ea0f028992063 [id=f4ba254355924d909ef34a0453ea4823]) successfully deleted
I20260617 07:53:23.828722 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 5f97ee5f17fc4fc0847a10b0b4c2f892 (DEFAULT_TABLE table=default.Table_d0e5b3d77c244306b561180dd78f6fa2 [id=38620e8597df45ccae38a78ee86caee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.829596 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ac530afa7640d4911b4b4fd3e07e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.829814 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f97ee5f17fc4fc0847a10b0b4c2f892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.831195 1171 tablet_bootstrap.cc:654] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.828835 1020 tablet_service.cc:1511] Processing CreateTablet for tablet b58c8595020b44e38690ec05c5d7bedd (DEFAULT_TABLE table=default.Table_0a8b95e63e0d47cd8b03857112efe394 [id=dcdf21b9cf5b405e882555065b0523f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.832883 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58c8595020b44e38690ec05c5d7bedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.834364 2711 raft_consensus.cc:493] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.834498 2711 raft_consensus.cc:515] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.835145 2711 leader_election.cc:290] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.836011 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4db586d78afa45bdaf4525fb39a9e2e5 (DEFAULT_TABLE table=default.Table_aae2ee49ba404f10a9133db568c68406 [id=e428d088fc8445ac995aeb6817f82957]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.836365 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db586d78afa45bdaf4525fb39a9e2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.828893 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 4db586d78afa45bdaf4525fb39a9e2e5 (DEFAULT_TABLE table=default.Table_aae2ee49ba404f10a9133db568c68406 [id=e428d088fc8445ac995aeb6817f82957]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:23.838080 713 leader_election.cc:343] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a2f21861cb6f481eae968edc733e6e6f
I20260617 07:53:23.838129 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db586d78afa45bdaf4525fb39a9e2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.838681 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd85a62edfb4c678c3035d1cf965e3b (DEFAULT_TABLE table=default.Table_138f2e00f28c4300b2ac9c69b77c2cfb [id=07e9cc8078d04e839e8735a9d7510d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.838994 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd85a62edfb4c678c3035d1cf965e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.841485 742 tablet_service.cc:1511] Processing CreateTablet for tablet 5f97ee5f17fc4fc0847a10b0b4c2f892 (DEFAULT_TABLE table=default.Table_d0e5b3d77c244306b561180dd78f6fa2 [id=38620e8597df45ccae38a78ee86caee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.841917 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f97ee5f17fc4fc0847a10b0b4c2f892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.844095 1170 tablet_replica.cc:333] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:23.829093 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet e5544753b3144c1989f2ed99bffc2246 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.829090 1015 tablet_service.cc:1511] Processing CreateTablet for tablet ff67e763f24e4d6289ff0d3d3c8e8afc (DEFAULT_TABLE table=default.Table_a3a4eb2e45ac47a7a0fef33dc402a4c2 [id=cec4a230005d4e42b37e2e61245f1340]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.844347 1170 raft_consensus.cc:2243] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.844484 1170 raft_consensus.cc:2272] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.844141 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74cec8197aa543a9a064fb73a9c0023b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.845008 1170 ts_tablet_manager.cc:1916] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.846920 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff67e763f24e4d6289ff0d3d3c8e8afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.848198 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e61c7fa45045d9bedd385b4e11a2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.848757 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_a7cfc3ae378d45a6aefe3ef6c2559e4a [id=f96c8d7d0be24aa4958290874ff844b5] alter complete (version 2)
I20260617 07:53:23.849390 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_d410d9dcad68447bbc59efa3eb1c7b9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.849956 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d410d9dcad68447bbc59efa3eb1c7b9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.853911 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3505000e2b554bbbb5f2f22603a741e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.854480 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3505000e2b554bbbb5f2f22603a741e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.856987 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c2504ce95816485aa56a2ae775555496" } new_table_name: "default.Table_612c40ad98cf4d74b2c9482899daa7cb" modify_external_catalogs: true
W20260617 07:53:23.858812 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ef4f711d1534713b3ebd0862db382a3 consensus state has no leader
I20260617 07:53:23.859200 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3695ab67f22046edba88a1e09d1dca29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.859737 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3695ab67f22046edba88a1e09d1dca29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:23.861773 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7934f5fa0287427cb45fe568f0de8758 because the tablet was not found. No further retry: Not found: Tablet not found: 7934f5fa0287427cb45fe568f0de8758
I20260617 07:53:23.864322 892 tablet_service.cc:1511] Processing CreateTablet for tablet 74cec8197aa543a9a064fb73a9c0023b (DEFAULT_TABLE table=default.Table_c7c85ec02b084cebbe2e437afa71f3e4 [id=45cb464e9d704d8c8c50da7eede27062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.864771 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74cec8197aa543a9a064fb73a9c0023b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.866554 898 tablet_service.cc:1558] Processing DeleteTablet for tablet e5544753b3144c1989f2ed99bffc2246 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.866989 885 tablet_service.cc:1511] Processing CreateTablet for tablet ff67e763f24e4d6289ff0d3d3c8e8afc (DEFAULT_TABLE table=default.Table_a3a4eb2e45ac47a7a0fef33dc402a4c2 [id=cec4a230005d4e42b37e2e61245f1340]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.867300 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff67e763f24e4d6289ff0d3d3c8e8afc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.867257 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 121339ab4842432e9fb7bc357750f8ad because the tablet was not found. No further retry: Not found: Tablet not found: 121339ab4842432e9fb7bc357750f8ad
W20260617 07:53:23.867940 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet f15dcc10552d4747bad436538662bb66 because the tablet was not found. No further retry: Not found: Tablet not found: f15dcc10552d4747bad436538662bb66
W20260617 07:53:23.868127 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet adbbe7eb5181431290f57ed9128181a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbbe7eb5181431290f57ed9128181a3 already in progress: creating tablet
W20260617 07:53:23.868294 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 already in progress: creating tablet
W20260617 07:53:23.868516 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3e3d05dcda274f288aebc279aba3e10a because the tablet was not found. No further retry: Not found: Tablet not found: 3e3d05dcda274f288aebc279aba3e10a
W20260617 07:53:23.868683 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 53108a2d6c8b4398a568c14df8e0a23e because the tablet was not found. No further retry: Not found: Tablet not found: 53108a2d6c8b4398a568c14df8e0a23e
W20260617 07:53:23.868832 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c9657e0dd2a8459cb728bdfe8a68b840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9657e0dd2a8459cb728bdfe8a68b840 already in progress: creating tablet
I20260617 07:53:23.871904 2774 raft_consensus.cc:493] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.872020 2774 raft_consensus.cc:515] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.872570 2774 leader_election.cc:290] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.845700 756 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd85a62edfb4c678c3035d1cf965e3b (DEFAULT_TABLE table=default.Table_138f2e00f28c4300b2ac9c69b77c2cfb [id=07e9cc8078d04e839e8735a9d7510d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.873222 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd85a62edfb4c678c3035d1cf965e3b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:23.874910 852 leader_election.cc:343] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.875615 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9777d3619743cf8df19cf93f97f50a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:23.875959 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369442b72f754ee08dc6a484d51f2e99" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.881979 879 tablet_service.cc:1511] Processing CreateTablet for tablet 5f97ee5f17fc4fc0847a10b0b4c2f892 (DEFAULT_TABLE table=default.Table_d0e5b3d77c244306b561180dd78f6fa2 [id=38620e8597df45ccae38a78ee86caee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.881572 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4db586d78afa45bdaf4525fb39a9e2e5 (DEFAULT_TABLE table=default.Table_aae2ee49ba404f10a9133db568c68406 [id=e428d088fc8445ac995aeb6817f82957]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:23.883049 988 leader_election.cc:343] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:23.883132 852 leader_election.cc:343] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.883180 988 leader_election.cc:304] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.883538 2629 raft_consensus.cc:2749] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.883972 887 tablet_service.cc:1511] Processing CreateTablet for tablet 03e61c7fa45045d9bedd385b4e11a2bd (DEFAULT_TABLE table=default.Table_bb35b478e847496f90b3ddb167a02383 [id=6e62da034afd499a8aa00dad4a693270]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:23.866508 716 leader_election.cc:343] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a2f21861cb6f481eae968edc733e6e6f
I20260617 07:53:23.884353 716 leader_election.cc:304] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:23.867437 2711 raft_consensus.cc:493] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.884784 2711 raft_consensus.cc:515] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.885396 2711 leader_election.cc:290] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.885535 2711 raft_consensus.cc:2749] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:23.886797 713 leader_election.cc:343] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 84f498f551ff4767bd16628b03f55ae2
I20260617 07:53:23.862854 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 84f498f551ff4767bd16628b03f55ae2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9436fb7fca094eaab925748e254b1a62) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.890964 883 tablet_service.cc:1511] Processing CreateTablet for tablet 61ac530afa7640d4911b4b4fd3e07e7e (DEFAULT_TABLE table=default.Table_1ba8fcc807224287b958cd9273dd474a [id=ab4a27d530404f09bbc56a946bd4822d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.893159 2756 raft_consensus.cc:493] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:23.893317 2756 raft_consensus.cc:515] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:23.893424 988 leader_election.cc:343] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 7ca402543247461aa5384abb65fff364
I20260617 07:53:23.893507 988 leader_election.cc:304] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:23.893782 2774 raft_consensus.cc:493] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.893810 2729 raft_consensus.cc:2749] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:23.893898 2774 raft_consensus.cc:515] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.894608 2774 leader_election.cc:290] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.896111 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f97ee5f17fc4fc0847a10b0b4c2f892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.896396 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a900aecf46e4430cb7ccdecd54376193" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:23.896409 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a900aecf46e4430cb7ccdecd54376193" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.896564 1051 raft_consensus.cc:2468] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:23.896878 852 leader_election.cc:343] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.897567 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6defd798d4bd4e6f88986301755535ce" } modify_external_catalogs: true
I20260617 07:53:23.897792 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6defd798d4bd4e6f88986301755535ce" } modify_external_catalogs: true
I20260617 07:53:23.898119 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e61c7fa45045d9bedd385b4e11a2bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.898178 851 leader_election.cc:304] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.898991 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ac530afa7640d4911b4b4fd3e07e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.899183 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3ee4b4c000fd46a6b571c382ac2b7134" } modify_external_catalogs: true
I20260617 07:53:23.899353 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3ee4b4c000fd46a6b571c382ac2b7134" } modify_external_catalogs: true
W20260617 07:53:23.902401 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4232e6d6f034b39a0ba50dc9ca090ae consensus state has no leader
I20260617 07:53:23.902526 884 tablet_service.cc:1511] Processing CreateTablet for tablet b58c8595020b44e38690ec05c5d7bedd (DEFAULT_TABLE table=default.Table_0a8b95e63e0d47cd8b03857112efe394 [id=dcdf21b9cf5b405e882555065b0523f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:23.902624 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_23f74c07c322499982b3fcbc0ce236ce" } modify_external_catalogs: true
I20260617 07:53:23.902805 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_23f74c07c322499982b3fcbc0ce236ce" } modify_external_catalogs: true
I20260617 07:53:23.902884 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1349be0f5c284db08f696236a83d4fcd" } modify_external_catalogs: true
I20260617 07:53:23.903036 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1349be0f5c284db08f696236a83d4fcd" } modify_external_catalogs: true
I20260617 07:53:23.904943 2774 raft_consensus.cc:2804] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:23.905061 2774 raft_consensus.cc:493] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:23.905139 2774 raft_consensus.cc:3060] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.906900 1178 tablet_bootstrap.cc:492] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:23.907040 1178 ts_tablet_manager.cc:1403] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.309s user 0.009s sys 0.029s
I20260617 07:53:23.907864 1178 raft_consensus.cc:359] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.908038 1178 raft_consensus.cc:385] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:23.908098 1178 raft_consensus.cc:740] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:23.914880 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db586d78afa45bdaf4525fb39a9e2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.908289 1178 consensus_queue.cc:260] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.923295 458 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_66e18dae23c5456d8125c43c3c21fbac [id=829b5684836747b2aa4265ac17eccd80] alter complete (version 2)
W20260617 07:53:23.923828 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb8857a2de7b42dcb5a7d2027732cd3e consensus state has no leader
I20260617 07:53:23.924407 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_677aba508baf46ab8247a3d1b109fb23 [id=f00addaaab9440a3a70bf54d62a94cd3] alter complete (version 2)
I20260617 07:53:23.928829 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:23.929411 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 62912.9us
I20260617 07:53:23.800597 1846 rpcz_store.cc:276] 0617 07:53:19.488184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.488231 (+ 47us) service_pool.cc:224] Handling call
0617 07:53:23.798747 (+4310516us) ts_tablet_manager.cc:1151] Deleting tablet a0dcd837e1c54af696394e7a6c4d26f0
0617 07:53:23.798756 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:23.798845 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4310097}
I20260617 07:53:23.931355 1846 tablet_replica.cc:333] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:23.931691 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a0dcd837e1c54af696394e7a6c4d26f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0dcd837e1c54af696394e7a6c4d26f0 already in progress: creating tablet
I20260617 07:53:23.938300 2774 raft_consensus.cc:515] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.944842 2774 leader_election.cc:290] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.932483 1178 ts_tablet_manager.cc:1434] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260617 07:53:23.946362 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a900aecf46e4430cb7ccdecd54376193" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:23.946802 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 95865af94c04410386d23cb369180611 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:23.947003 852 leader_election.cc:343] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.955374 456 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf]). Expected version 1 got 0
I20260617 07:53:23.958235 2629 raft_consensus.cc:493] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.958912 1178 tablet_bootstrap.cc:492] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:23.960283 1178 tablet_bootstrap.cc:654] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:23.962724 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_fb378325bac84e01b6f0ac7f7216f632"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:23.963333 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb378325bac84e01b6f0ac7f7216f632 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:23.965647 1846 raft_consensus.cc:2243] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:23.965849 1846 raft_consensus.cc:2272] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:23.967386 1846 ts_tablet_manager.cc:1916] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:23.974426 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf]). Expected version 1 got 0
I20260617 07:53:23.975608 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58c8595020b44e38690ec05c5d7bedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:23.873076 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369442b72f754ee08dc6a484d51f2e99" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:23.979346 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.979483 1046 raft_consensus.cc:2468] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:23.945456 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a900aecf46e4430cb7ccdecd54376193" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:23.979626 1051 raft_consensus.cc:3060] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.980008 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c120eba06a549ef88ffa19998ab0f3d with delete_type TABLET_DATA_DELETED (replaced by tablet 7345590f49894b7a8f7a1e7e4b26c2ef) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:23.982614 851 leader_election.cc:304] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:23.982887 2709 raft_consensus.cc:493] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.982985 2774 raft_consensus.cc:2804] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:23.983055 2774 raft_consensus.cc:493] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:23.983021 2709 raft_consensus.cc:515] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.983109 2774 raft_consensus.cc:3060] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.983171 2629 raft_consensus.cc:515] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.983616 2709 leader_election.cc:290] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:23.984575 851 leader_election.cc:343] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 4d9ace137c4e496fafac4e729718577f
I20260617 07:53:23.984977 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9ace137c4e496fafac4e729718577f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:23.985466 852 leader_election.cc:343] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.985528 2774 raft_consensus.cc:515] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.985577 852 leader_election.cc:304] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:23.985818 2709 raft_consensus.cc:2749] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:23.986511 2774 leader_election.cc:290] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:23.986533 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369442b72f754ee08dc6a484d51f2e99" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:23.986990 852 leader_election.cc:343] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:23.987347 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369442b72f754ee08dc6a484d51f2e99" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:23.987520 1046 raft_consensus.cc:3060] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:23.990801 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 770a5216299842b890d483ca37b0ee86
I20260617 07:53:23.991609 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 770a5216299842b890d483ca37b0ee86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.992872 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet f4d8542262864a0ab9d763528502bcbb
I20260617 07:53:23.994011 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 770a5216299842b890d483ca37b0ee86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:23.994302 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d8542262864a0ab9d763528502bcbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:23.998699 2803 raft_consensus.cc:493] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:23.998840 2803 raft_consensus.cc:515] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:23.998920 2756 leader_election.cc:290] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:23.999444 2803 leader_election.cc:290] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:24.000029 716 leader_election.cc:343] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 84f498f551ff4767bd16628b03f55ae2
I20260617 07:53:24.000131 716 leader_election.cc:304] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.000833 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d4fc81456445518c1158f912dd2f8f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.000888 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f7a4ea634f429794b402439d19bbfe" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:24.001184 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d94915d96694d6f9a86063640e5fe18" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.002369 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f7a4ea634f429794b402439d19bbfe" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:24.003173 716 leader_election.cc:304] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.003571 2711 raft_consensus.cc:2749] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.003741 2711 raft_consensus.cc:2749] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:24.004134 986 leader_election.cc:343] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:24.004329 986 leader_election.cc:343] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.008108 1178 tablet_bootstrap.cc:492] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.008385 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d8542262864a0ab9d763528502bcbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.008968 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 770a5216299842b890d483ca37b0ee86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.009148 1178 ts_tablet_manager.cc:1403] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.001s
I20260617 07:53:24.010069 1178 raft_consensus.cc:359] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.010309 1178 raft_consensus.cc:385] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.010406 1178 raft_consensus.cc:740] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.010502 2629 leader_election.cc:290] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:24.010699 1178 consensus_queue.cc:260] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.011035 2629 raft_consensus.cc:493] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.011271 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 369442b72f754ee08dc6a484d51f2e99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:16 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.011423 1178 ts_tablet_manager.cc:1434] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:24.011441 882 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d8542262864a0ab9d763528502bcbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.011554 885 tablet_service.cc:1558] Processing DeleteTablet for tablet e55d63a25a2845dbbcce20e560361007 with delete_type TABLET_DATA_DELETED (replaced by tablet adbbe7eb5181431290f57ed9128181a3) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.011726 1178 tablet_bootstrap.cc:492] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
W20260617 07:53:24.012198 988 leader_election.cc:343] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 9d94915d96694d6f9a86063640e5fe18
I20260617 07:53:24.012323 988 leader_election.cc:304] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:24.013079 1178 tablet_bootstrap.cc:654] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.014353 2756 raft_consensus.cc:2749] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:24.015679 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d4fc81456445518c1158f912dd2f8f" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:24.016677 2760 tablet.cc:1724] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:24.017629 2629 raft_consensus.cc:515] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.018257 2629 leader_election.cc:290] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:24.019814 1172 tablet_bootstrap.cc:654] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.020081 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb8fbb44e6147be8c9605be886a8aea" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:24.021091 988 leader_election.cc:343] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.021207 988 leader_election.cc:304] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:24.022102 986 leader_election.cc:343] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.022360 2753 tablet.cc:1724] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:24.022583 2629 raft_consensus.cc:2749] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.023713 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb8fbb44e6147be8c9605be886a8aea" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:24.024446 988 leader_election.cc:343] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.024545 988 leader_election.cc:304] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:24.025923 2629 raft_consensus.cc:2749] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.026341 1171 tablet_bootstrap.cc:492] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:24.026340 446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.105.189:36505 (error 108)
I20260617 07:53:24.026521 1171 ts_tablet_manager.cc:1403] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.439s user 0.007s sys 0.003s
W20260617 07:53:24.026989 714 connection.cc:573] client connection to 127.0.105.189:36505 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 07:53:24.027516 2629 raft_consensus.cc:493] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.027509 1171 raft_consensus.cc:359] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.027653 1171 raft_consensus.cc:385] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.027704 1171 raft_consensus.cc:740] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.027949 1171 consensus_queue.cc:260] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.028543 1171 ts_tablet_manager.cc:1434] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:24.031899 1171 tablet_bootstrap.cc:492] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.027637 2629 raft_consensus.cc:515] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.036533 1046 raft_consensus.cc:2468] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:24.036999 851 leader_election.cc:304] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:24.037384 2774 raft_consensus.cc:2804] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:24.037576 2774 raft_consensus.cc:697] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:24.037814 2774 consensus_queue.cc:237] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.039645 1171 tablet_bootstrap.cc:654] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.040848 2629 leader_election.cc:290] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:24.054203 2803 raft_consensus.cc:493] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.054355 2803 raft_consensus.cc:515] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.055029 2803 leader_election.cc:290] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:24.056015 716 leader_election.cc:343] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 95865af94c04410386d23cb369180611
I20260617 07:53:24.059563 2629 raft_consensus.cc:493] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.059701 2629 raft_consensus.cc:515] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.061800 1051 raft_consensus.cc:2468] T a900aecf46e4430cb7ccdecd54376193 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:24.062304 851 leader_election.cc:304] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:24.062673 2709 raft_consensus.cc:2804] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:24.062774 2709 raft_consensus.cc:697] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:24.062777 1846 ts_tablet_manager.cc:1929] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.062873 1846 log.cc:1199] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/3ae9261c0ac94defaecfc7d14ba1ae61
I20260617 07:53:24.062974 2709 consensus_queue.cc:237] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.063172 1846 ts_tablet_manager.cc:1950] T 3ae9261c0ac94defaecfc7d14ba1ae61 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:24.063890 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 603) took 4547 ms. Trace:
I20260617 07:53:24.064587 452 catalog_manager.cc:5696] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:24.070529 2629 leader_election.cc:290] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:24.073478 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 345770b456d64fedba27347674a70900
I20260617 07:53:24.078418 1171 tablet_bootstrap.cc:492] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.078593 1171 ts_tablet_manager.cc:1403] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.001s
I20260617 07:53:24.079329 1171 raft_consensus.cc:359] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.079489 1171 raft_consensus.cc:385] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.079540 1171 raft_consensus.cc:740] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.079704 1171 consensus_queue.cc:260] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.084564 1170 ts_tablet_manager.cc:1929] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.086282 1171 ts_tablet_manager.cc:1434] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 07:53:24.086757 1171 tablet_bootstrap.cc:492] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.089679 1170 log.cc:1199] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/0be19ece3a0a4a51abad7b8e2f3b2420
I20260617 07:53:24.090147 1170 ts_tablet_manager.cc:1950] T 0be19ece3a0a4a51abad7b8e2f3b2420 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:24.090941 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 409) took 5261 ms. Trace:
I20260617 07:53:24.091601 1170 rpcz_store.cc:276] 0617 07:53:18.829158 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.829195 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:23.844049 (+5014854us) ts_tablet_manager.cc:1151] Deleting tablet 0be19ece3a0a4a51abad7b8e2f3b2420
0617 07:53:23.844059 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.050032 (+205973us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.084501 (+ 34469us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.090922 (+ 6421us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5014721}
I20260617 07:53:24.094691 1171 tablet_bootstrap.cc:654] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:24.107707 446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:36505, user_credentials={real_user=slave}} blocked reactor thread for 81381.8us
I20260617 07:53:24.112960 1170 tablet_replica.cc:333] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:24.113260 1170 raft_consensus.cc:2243] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.113483 1170 raft_consensus.cc:2272] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.114079 1170 ts_tablet_manager.cc:1916] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.118525 1171 tablet_bootstrap.cc:492] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.118671 1171 ts_tablet_manager.cc:1403] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260617 07:53:24.119619 1171 raft_consensus.cc:359] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.119830 1171 raft_consensus.cc:385] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.119879 1171 raft_consensus.cc:740] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:24.119900 446 consensus_peers.cc:597] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f -> Peer 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505): Couldn't send request to peer 29a94ff9f875443ab6aeac00922cda0d. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:24.120155 1171 consensus_queue.cc:260] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.122236 2629 raft_consensus.cc:493] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.122406 2629 raft_consensus.cc:515] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.123152 2629 leader_election.cc:290] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:24.124271 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_26d9fe80577d4be283ec3e7dfe2fae45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:24.124383 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b0e6ecffb0434f9898471fb47b940805"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:24.124833 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 345770b456d64fedba27347674a70900 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:24.124886 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26d9fe80577d4be283ec3e7dfe2fae45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:24.124929 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0e6ecffb0434f9898471fb47b940805 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.125175 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03a26e301e747febc4d5bafdc1a49c6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:24.126168 1171 ts_tablet_manager.cc:1434] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 07:53:24.126169 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_51413fc9aaa6421da86dd52735a48765" } new_table_name: "default.Table_fec69fdf7c354420b12cb589a9d86f5f" modify_external_catalogs: true
I20260617 07:53:24.126171 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4f81daf583464e988521e189ca39b6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:24.126459 1171 tablet_bootstrap.cc:492] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.128319 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet e62175d5cc854d45838454043220954e
I20260617 07:53:24.129278 898 tablet_service.cc:1511] Processing CreateTablet for tablet 754162344fad4672a6c9c2b07858b21b (DEFAULT_TABLE table=default.Table_92c75dbb95d641cdb2ca3d3b2841e7c5 [id=501df2ac1bf34a498b167959de7dd725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.129829 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e700810cd024dacbadd9ab109d0d87c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:24.129943 988 leader_election.cc:343] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:24.130577 988 leader_election.cc:343] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.068307 2803 raft_consensus.cc:493] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.130800 1171 tablet_bootstrap.cc:654] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.130798 2803 raft_consensus.cc:515] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.131283 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_d36bea18179d4ba992d8795ee73dc19a [id=bf143b9baca647f0b25452d16dff2ae6] alter complete (version 2)
I20260617 07:53:24.131407 2803 leader_election.cc:290] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.108456 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7611958cf143438497c93f5f2bc098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:24.132460 716 leader_election.cc:343] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 7f7611958cf143438497c93f5f2bc098
I20260617 07:53:24.108762 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 345770b456d64fedba27347674a70900 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:24.132915 892 tablet_service.cc:1511] Processing CreateTablet for tablet b48d79739dac47b7b202c3652671e29b (DEFAULT_TABLE table=default.Table_0b8d9a982e3f4e32b0be803ba561fde3 [id=e07ad02342964d70a634be50704f82fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.109393 756 tablet_service.cc:1511] Processing CreateTablet for tablet b48d79739dac47b7b202c3652671e29b (DEFAULT_TABLE table=default.Table_0b8d9a982e3f4e32b0be803ba561fde3 [id=e07ad02342964d70a634be50704f82fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.133332 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b48d79739dac47b7b202c3652671e29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.122792 742 tablet_service.cc:1511] Processing CreateTablet for tablet 754162344fad4672a6c9c2b07858b21b (DEFAULT_TABLE table=default.Table_92c75dbb95d641cdb2ca3d3b2841e7c5 [id=501df2ac1bf34a498b167959de7dd725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.123202 748 tablet_service.cc:1511] Processing CreateTablet for tablet 33623303a56c47e3a3a4e7aad82df972 (DEFAULT_TABLE table=default.Table_5caf6314d3724712839ea92d5e377ef6 [id=733e590cc9c74d4f81b5261fb637b1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.129555 745 tablet_service.cc:1558] Processing DeleteTablet for tablet e62175d5cc854d45838454043220954e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:24.134214 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.136648 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33623303a56c47e3a3a4e7aad82df972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.137036 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754162344fad4672a6c9c2b07858b21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.137322 887 tablet_service.cc:1558] Processing DeleteTablet for tablet e62175d5cc854d45838454043220954e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.137780 887 tablet_service.cc:1511] Processing CreateTablet for tablet 33623303a56c47e3a3a4e7aad82df972 (DEFAULT_TABLE table=default.Table_5caf6314d3724712839ea92d5e377ef6 [id=733e590cc9c74d4f81b5261fb637b1d3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:24.138237 988 leader_election.cc:343] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.141150 1051 raft_consensus.cc:1275] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:24.142035 2709 consensus_queue.cc:1048] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:24.143499 852 consensus_peers.cc:597] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:24.162321 1862 pending_rounds.cc:77] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772762490544128 op_type: NO_OP noop_request { }
I20260617 07:53:24.162812 1862 raft_consensus.cc:2889] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:24.163157 1862 raft_consensus.cc:2272] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.163661 765 raft_consensus.cc:3060] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:24.156291 1846 rpcz_store.cc:276] 0617 07:53:19.516065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.517095 (+ 1030us) service_pool.cc:224] Handling call
0617 07:53:23.931309 (+4414214us) ts_tablet_manager.cc:1151] Deleting tablet 3ae9261c0ac94defaecfc7d14ba1ae61
0617 07:53:23.931317 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.004921 (+ 73604us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.062725 (+ 57804us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.063873 (+ 1148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4413956}
I20260617 07:53:24.171851 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d018eef700b3482a83212d8b4a10041e" } new_table_name: "default.Table_5ff5f705babb4bf5954fe34e745c20d9" modify_external_catalogs: true
I20260617 07:53:24.172358 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_687053e90da743bdb4d74e3d1f368e89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.172955 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_687053e90da743bdb4d74e3d1f368e89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.173449 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_4d518b1a10fb4d86ada299b76be8b2b1" } new_table_name: "default.Table_22b9fd5286624841901b76af4be80e57" modify_external_catalogs: true
I20260617 07:53:24.174381 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3613e9b67ed84a848431deed188ba5f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.174908 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3613e9b67ed84a848431deed188ba5f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.174880 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f34608efcf844e66b9c7a0e6a63fcd6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.175349 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f34608efcf844e66b9c7a0e6a63fcd6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.183964 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_232d7a605a2843cbb5ff6907fd1cf808"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.184618 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_232d7a605a2843cbb5ff6907fd1cf808 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.176369 748 tablet_service.cc:1511] Processing CreateTablet for tablet eb5f4cc3af804480b029c33ea5602611 (DEFAULT_TABLE table=default.Table_1f40145baeb646d5923f0718f3dcfd0d [id=18c59ddeddf642fcb3ed161a2d812bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.183322 2799 tablet.cc:1724] T d9f7a4ea634f429794b402439d19bbfe P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:24.187247 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5f4cc3af804480b029c33ea5602611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.194195 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 3ae9261c0ac94defaecfc7d14ba1ae61 (table default.Table_f906af88bdcd40169dad534822931936 [id=cd20d0490cb74168b4ff032d0f943992]) successfully deleted
I20260617 07:53:24.197269 1178 tablet_bootstrap.cc:492] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.197485 1178 ts_tablet_manager.cc:1403] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.186s user 0.001s sys 0.003s
I20260617 07:53:24.198666 1178 raft_consensus.cc:359] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.199220 1178 raft_consensus.cc:385] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.199013 2760 tablet.cc:1724] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:24.199337 1178 raft_consensus.cc:740] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.199671 1178 consensus_queue.cc:260] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.200850 1178 ts_tablet_manager.cc:1434] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:24.206898 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:24.207312 458 catalog_manager.cc:5696] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:24.208043 458 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:24.209205 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_7074bb8dadc643a6bdbd6cc8f86f4032" } modify_external_catalogs: true
I20260617 07:53:24.211326 756 tablet_service.cc:1511] Processing CreateTablet for tablet 81a7a2a6fa514724adb97e9fcaea8ea4 (DEFAULT_TABLE table=default.Table_14b61f2fed0246169c36d16dc9f4a70f [id=3f33060df4c14363ad1e0c7806f358d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.225093 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4f81daf583464e988521e189ca39b6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.225106 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e700810cd024dacbadd9ab109d0d87c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.228215 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03a26e301e747febc4d5bafdc1a49c6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.229012 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a7a2a6fa514724adb97e9fcaea8ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.197499 2753 tablet.cc:1724] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:24.202540 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754162344fad4672a6c9c2b07858b21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.211776 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_7074bb8dadc643a6bdbd6cc8f86f4032" } modify_external_catalogs: true
I20260617 07:53:24.247144 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33623303a56c47e3a3a4e7aad82df972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.248926 1846 tablet_replica.cc:333] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:24.249114 1846 raft_consensus.cc:2243] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.249266 1846 raft_consensus.cc:2272] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.251045 1178 tablet_bootstrap.cc:492] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:24.252686 1178 tablet_bootstrap.cc:654] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.253981 1846 ts_tablet_manager.cc:1916] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.265662 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_934c26f5636144099ec19d04a50b090a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.267287 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_934c26f5636144099ec19d04a50b090a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.269105 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b48d79739dac47b7b202c3652671e29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.281507 887 tablet_service.cc:1511] Processing CreateTablet for tablet 81a7a2a6fa514724adb97e9fcaea8ea4 (DEFAULT_TABLE table=default.Table_14b61f2fed0246169c36d16dc9f4a70f [id=3f33060df4c14363ad1e0c7806f358d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.282024 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a7a2a6fa514724adb97e9fcaea8ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.286042 748 tablet_service.cc:1511] Processing CreateTablet for tablet 085ba205d7374dde8ecf40c147ad7aaa (DEFAULT_TABLE table=default.Table_774c024c17f54bcaa0c35e69f911a6f6 [id=0850c2e96e2a4c589790aaa353d2f63b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.286625 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085ba205d7374dde8ecf40c147ad7aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.210816 884 tablet_service.cc:1511] Processing CreateTablet for tablet eb5f4cc3af804480b029c33ea5602611 (DEFAULT_TABLE table=default.Table_1f40145baeb646d5923f0718f3dcfd0d [id=18c59ddeddf642fcb3ed161a2d812bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.291360 756 tablet_service.cc:1511] Processing CreateTablet for tablet ebd5c5e7d088476fb1f113bf3e52dbdf (DEFAULT_TABLE table=default.Table_9032f8129cb543819393109437d5beab [id=295030d2fbf149c5a08a97f90000208e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.291709 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd5c5e7d088476fb1f113bf3e52dbdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:24.300763 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9780f9700e842e9b09fa223cf5d6a68 consensus state has no leader
W20260617 07:53:24.303202 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5f158254bd34f1dbc5c9e3e92baa360 consensus state has no leader
W20260617 07:53:24.303838 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ecd880890df5494f8500d623b0524e9c consensus state has no leader
I20260617 07:53:24.304776 887 tablet_service.cc:1511] Processing CreateTablet for tablet 085ba205d7374dde8ecf40c147ad7aaa (DEFAULT_TABLE table=default.Table_774c024c17f54bcaa0c35e69f911a6f6 [id=0850c2e96e2a4c589790aaa353d2f63b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.304780 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5f4cc3af804480b029c33ea5602611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.305482 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085ba205d7374dde8ecf40c147ad7aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.305948 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet d9f7a4ea634f429794b402439d19bbfe (table default.Table_5d79edb7235749f78af1a31e98d3d016 [id=0520008198914d0994fb211238c522bf]). Expected version 1 got 0
I20260617 07:53:24.306892 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_f320a356edaa463dae9407cbd2263d6f" } new_table_name: "default.Table_4c4d2dd234c3442980e38c1f7cde948b" modify_external_catalogs: true
I20260617 07:53:24.306982 1862 ts_tablet_manager.cc:1916] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.308060 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d97e42eee9e14d7ca1ec6f5caf5744e0" } new_table_name: "default.Table_62c17ca0481442d58651d8e9a4fa3524" modify_external_catalogs: true
I20260617 07:53:24.311712 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f09297492f89469786c6549162e1b05a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.312247 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f09297492f89469786c6549162e1b05a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.312747 1862 ts_tablet_manager.cc:1929] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:24.313874 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_444ae499f85c4d64948904dcaa1e9884"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.314352 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_444ae499f85c4d64948904dcaa1e9884 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.319978 1178 tablet_bootstrap.cc:492] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.320178 1178 ts_tablet_manager.cc:1403] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.002s
I20260617 07:53:24.320991 1862 log.cc:1199] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5364dfe28b8d4042941c8d8d4d1cf503
I20260617 07:53:24.321480 1862 ts_tablet_manager.cc:1950] T 5364dfe28b8d4042941c8d8d4d1cf503 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:24.322027 2629 raft_consensus.cc:493] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:24.322185 2629 raft_consensus.cc:515] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.322746 2629 leader_election.cc:290] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:24.322557 1178 raft_consensus.cc:359] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.323309 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 345770b456d64fedba27347674a70900 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.323710 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet beb8fbb44e6147be8c9605be886a8aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.324708 1014 tablet_service.cc:1511] Processing CreateTablet for tablet b48d79739dac47b7b202c3652671e29b (DEFAULT_TABLE table=default.Table_0b8d9a982e3f4e32b0be803ba561fde3 [id=e07ad02342964d70a634be50704f82fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.325255 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b48d79739dac47b7b202c3652671e29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.324935 1178 raft_consensus.cc:385] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.325472 1178 raft_consensus.cc:740] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.325691 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 633) took 1399 ms. Trace:
I20260617 07:53:24.326035 1178 consensus_queue.cc:260] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:24.326375 988 leader_election.cc:343] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 63de833f7aa740b0b5bf2494b78aca5c
I20260617 07:53:24.326522 1862 rpcz_store.cc:276] 0617 07:53:22.926382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.926477 (+ 95us) service_pool.cc:224] Handling call
0617 07:53:23.663395 (+736918us) ts_tablet_manager.cc:1151] Deleting tablet 5364dfe28b8d4042941c8d8d4d1cf503
0617 07:53:23.663402 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.309936 (+646534us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.312701 (+ 2765us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.325676 (+ 12975us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":735935}
I20260617 07:53:24.327780 884 tablet_service.cc:1511] Processing CreateTablet for tablet ebd5c5e7d088476fb1f113bf3e52dbdf (DEFAULT_TABLE table=default.Table_9032f8129cb543819393109437d5beab [id=295030d2fbf149c5a08a97f90000208e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.328182 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5364dfe28b8d4042941c8d8d4d1cf503 (table default.Table_665c19b8c9d14ccc9f5beb633b690e13 [id=3ab32aa970c24c1bbde1768b3defee07]) successfully deleted
I20260617 07:53:24.328243 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd5c5e7d088476fb1f113bf3e52dbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.328536 742 tablet_service.cc:1511] Processing CreateTablet for tablet 7345590f49894b7a8f7a1e7e4b26c2ef (DEFAULT_TABLE table=default.Table_73897e868adb452cbbcedea7797a6352 [id=03d2a1add32c43898bafa557e4d010fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.328662 1178 ts_tablet_manager.cc:1434] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 07:53:24.328859 1862 tablet_replica.cc:333] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:24.328917 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7345590f49894b7a8f7a1e7e4b26c2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.329023 1862 raft_consensus.cc:2243] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.329164 1862 raft_consensus.cc:2272] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.329653 1862 ts_tablet_manager.cc:1916] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.340540 1862 ts_tablet_manager.cc:1929] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.341384 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 0be19ece3a0a4a51abad7b8e2f3b2420 (table default.Table_00d654600a8a474d84c1678c529d4489 [id=9776f24641614e23a1ea878c6aad0efa]) successfully deleted
I20260617 07:53:24.343168 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet e62175d5cc854d45838454043220954e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:23 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.343339 1862 log.cc:1199] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/77c3bf1860c34ee3821bf273234cb0a4
I20260617 07:53:24.343662 1862 ts_tablet_manager.cc:1950] T 77c3bf1860c34ee3821bf273234cb0a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:24.343924 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 634) took 1417 ms. Trace:
I20260617 07:53:24.344005 1862 rpcz_store.cc:276] 0617 07:53:22.926617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.926657 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:24.328815 (+1402158us) ts_tablet_manager.cc:1151] Deleting tablet 77c3bf1860c34ee3821bf273234cb0a4
0617 07:53:24.328825 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.337881 (+ 9056us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.340497 (+ 2616us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.343912 (+ 3415us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1401288}
I20260617 07:53:24.344353 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 645) took 1288 ms. Trace:
I20260617 07:53:24.344417 1862 rpcz_store.cc:276] 0617 07:53:23.056156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.056209 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:24.344251 (+1288042us) ts_tablet_manager.cc:1151] Deleting tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1
0617 07:53:24.344260 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.344341 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1287724}
I20260617 07:53:24.344715 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 643) took 1312 ms. Trace:
I20260617 07:53:24.344776 1862 rpcz_store.cc:276] 0617 07:53:23.032361 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.126450 (+ 94089us) service_pool.cc:224] Handling call
0617 07:53:24.344637 (+1218187us) ts_tablet_manager.cc:1151] Deleting tablet 146d1b46891a416aafe55aa740e1569e
0617 07:53:24.344644 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.344704 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1217819}
I20260617 07:53:24.345033 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 651) took 1152 ms. Trace:
I20260617 07:53:24.345090 1862 rpcz_store.cc:276] 0617 07:53:23.192705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.192923 (+ 218us) service_pool.cc:224] Handling call
0617 07:53:24.344948 (+1152025us) ts_tablet_manager.cc:1151] Deleting tablet 2372cb9ae6e343be945b1e8d2db86894
0617 07:53:24.344958 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.345022 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1148425}
I20260617 07:53:24.345342 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 652) took 1131 ms. Trace:
I20260617 07:53:24.345409 1862 rpcz_store.cc:276] 0617 07:53:23.214128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.219959 (+ 5831us) service_pool.cc:224] Handling call
0617 07:53:24.345270 (+1125311us) ts_tablet_manager.cc:1151] Deleting tablet 7ca7af3d86d741f482a1f5f97de9c767
0617 07:53:24.345277 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.345331 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1125013}
I20260617 07:53:24.345885 1862 tablet_replica.cc:333] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:24.346138 1862 raft_consensus.cc:2243] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.346294 1862 raft_consensus.cc:2272] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.347584 1178 tablet_bootstrap.cc:492] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:24.348369 1862 ts_tablet_manager.cc:1916] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.349020 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 33623303a56c47e3a3a4e7aad82df972 (DEFAULT_TABLE table=default.Table_5caf6314d3724712839ea92d5e377ef6 [id=733e590cc9c74d4f81b5261fb637b1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.349273 1178 tablet_bootstrap.cc:654] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.349442 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33623303a56c47e3a3a4e7aad82df972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.354156 1862 ts_tablet_manager.cc:1929] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.354272 1862 log.cc:1199] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/f5053b7c24964dee880890fbb803ce7b
I20260617 07:53:24.354557 1862 ts_tablet_manager.cc:1950] T f5053b7c24964dee880890fbb803ce7b P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:24.354987 1862 tablet_replica.cc:333] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:24.356633 1862 raft_consensus.cc:2243] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:24.356902 1862 pending_rounds.cc:70] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:24.357004 1862 pending_rounds.cc:77] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772763564695552 op_type: NO_OP noop_request { }
I20260617 07:53:24.357158 1862 raft_consensus.cc:2889] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:24.357220 1171 tablet_bootstrap.cc:492] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.357383 1171 ts_tablet_manager.cc:1403] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.231s user 0.040s sys 0.033s
I20260617 07:53:24.358042 1171 raft_consensus.cc:359] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.358182 1171 raft_consensus.cc:385] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.358254 1171 raft_consensus.cc:740] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.358194 742 tablet_service.cc:1511] Processing CreateTablet for tablet 23f8d24fe94b4b48acd0030c4276944e (DEFAULT_TABLE table=default.Table_5a33989a09d74eb2978b216ba46a372f [id=bed11028cf904965a31e443315b3f8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.358439 1171 consensus_queue.cc:260] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.358600 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f8d24fe94b4b48acd0030c4276944e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.358902 1171 ts_tablet_manager.cc:1434] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260617 07:53:24.359129 1171 tablet_bootstrap.cc:492] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.360636 1171 tablet_bootstrap.cc:654] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.362589 1862 raft_consensus.cc:2272] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.363631 1862 ts_tablet_manager.cc:1916] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.367491 1170 ts_tablet_manager.cc:1929] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.367687 1846 ts_tablet_manager.cc:1929] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.367849 1846 log.cc:1199] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/36ce60b466f7420992ef194d72b5718d
I20260617 07:53:24.368177 1846 ts_tablet_manager.cc:1950] T 36ce60b466f7420992ef194d72b5718d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:24.368862 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 604) took 4851 ms. Trace:
I20260617 07:53:24.344560 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 77c3bf1860c34ee3821bf273234cb0a4 (table default.Table_539fd5773b6749b7aa922ab7ba5250ad [id=4d565f22e74c4c9d97a5b367e2b016b4]) successfully deleted
W20260617 07:53:24.374229 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 already in progress: creating tablet
W20260617 07:53:24.374490 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 146d1b46891a416aafe55aa740e1569e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 146d1b46891a416aafe55aa740e1569e already in progress: creating tablet
I20260617 07:53:24.374589 1862 ts_tablet_manager.cc:1929] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:24.374675 1862 log.cc:1199] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/5f8602b87a20455884c16196a901d335
W20260617 07:53:24.374689 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2372cb9ae6e343be945b1e8d2db86894 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2372cb9ae6e343be945b1e8d2db86894 already in progress: creating tablet
W20260617 07:53:24.374913 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 7ca7af3d86d741f482a1f5f97de9c767 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ca7af3d86d741f482a1f5f97de9c767 already in progress: creating tablet
I20260617 07:53:24.375022 1862 ts_tablet_manager.cc:1950] T 5f8602b87a20455884c16196a901d335 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:24.375095 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a0f7775846454e96a9f433e84e90a229 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0f7775846454e96a9f433e84e90a229 already in progress: creating tablet
I20260617 07:53:24.375283 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]) successfully deleted
I20260617 07:53:24.375434 1862 tablet_replica.cc:333] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:24.351907 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_11e8915c1fc444049ee51be7f91d14db [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 2 got 0
I20260617 07:53:24.357005 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 56e089af99464471b4d5482c3364d20f from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:24.375593 1862 raft_consensus.cc:2243] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:24.375797 1862 pending_rounds.cc:70] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:24.375849 1862 pending_rounds.cc:77] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772763238633472 op_type: NO_OP noop_request { }
I20260617 07:53:24.375942 1862 raft_consensus.cc:2889] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:24.376026 1862 raft_consensus.cc:2272] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.377024 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 5f8602b87a20455884c16196a901d335 (table default.Table_e01c4bf739194d638e2a3988702d4cfb [id=87e7c45adff04a7eb2c6edf0b75a047c]) successfully deleted
I20260617 07:53:24.377911 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ec9f51e614dd4d61ab97ab2bcaec742f" } modify_external_catalogs: true
I20260617 07:53:24.378086 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ec9f51e614dd4d61ab97ab2bcaec742f" } modify_external_catalogs: true
I20260617 07:53:24.378630 1171 tablet_bootstrap.cc:492] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.378741 1171 ts_tablet_manager.cc:1403] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.003s
I20260617 07:53:24.379333 1171 raft_consensus.cc:359] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.379495 1171 raft_consensus.cc:385] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.379542 1171 raft_consensus.cc:740] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.379717 1171 consensus_queue.cc:260] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.380172 1171 ts_tablet_manager.cc:1434] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 07:53:24.380421 1171 tablet_bootstrap.cc:492] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.381958 1171 tablet_bootstrap.cc:654] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.368126 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 81a7a2a6fa514724adb97e9fcaea8ea4 (DEFAULT_TABLE table=default.Table_14b61f2fed0246169c36d16dc9f4a70f [id=3f33060df4c14363ad1e0c7806f358d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.391558 1170 log.cc:1199] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5f8602b87a20455884c16196a901d335
I20260617 07:53:24.391815 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a7a2a6fa514724adb97e9fcaea8ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.391880 1170 ts_tablet_manager.cc:1950] T 5f8602b87a20455884c16196a901d335 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:24.392633 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 410) took 5563 ms. Trace:
I20260617 07:53:24.392711 1170 rpcz_store.cc:276] 0617 07:53:18.829464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.829499 (+ 35us) service_pool.cc:224] Handling call
0617 07:53:24.092395 (+5262896us) ts_tablet_manager.cc:1151] Deleting tablet 5f8602b87a20455884c16196a901d335
0617 07:53:24.112900 (+ 20505us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.117481 (+ 4581us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.367440 (+249959us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.392609 (+ 25169us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5262759}
I20260617 07:53:24.393136 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 411) took 5563 ms. Trace:
I20260617 07:53:24.393204 1170 rpcz_store.cc:276] 0617 07:53:18.829762 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.829796 (+ 34us) service_pool.cc:224] Handling call
0617 07:53:24.393033 (+5563237us) ts_tablet_manager.cc:1151] Deleting tablet e897b111e65c497591c7daaa81d783c7
0617 07:53:24.393042 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.393122 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5563116}
I20260617 07:53:24.368626 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 085ba205d7374dde8ecf40c147ad7aaa (DEFAULT_TABLE table=default.Table_774c024c17f54bcaa0c35e69f911a6f6 [id=0850c2e96e2a4c589790aaa353d2f63b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.393988 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085ba205d7374dde8ecf40c147ad7aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.398101 1170 tablet_replica.cc:333] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:24.398343 1170 raft_consensus.cc:2243] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.368626 1018 tablet_service.cc:1511] Processing CreateTablet for tablet ebd5c5e7d088476fb1f113bf3e52dbdf (DEFAULT_TABLE table=default.Table_9032f8129cb543819393109437d5beab [id=295030d2fbf149c5a08a97f90000208e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.398518 1170 raft_consensus.cc:2272] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.398783 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd5c5e7d088476fb1f113bf3e52dbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.398996 1170 ts_tablet_manager.cc:1916] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:24.399748 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 216614d066e9446f91e53d2a382b5f6e consensus state has no leader
I20260617 07:53:24.369220 1015 tablet_service.cc:1511] Processing CreateTablet for tablet eb5f4cc3af804480b029c33ea5602611 (DEFAULT_TABLE table=default.Table_1f40145baeb646d5923f0718f3dcfd0d [id=18c59ddeddf642fcb3ed161a2d812bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.401629 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5f4cc3af804480b029c33ea5602611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.369552 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 754162344fad4672a6c9c2b07858b21b (DEFAULT_TABLE table=default.Table_92c75dbb95d641cdb2ca3d3b2841e7c5 [id=501df2ac1bf34a498b167959de7dd725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.373548 1172 tablet_bootstrap.cc:492] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
W20260617 07:53:24.391049 986 leader_election.cc:343] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.402128 986 leader_election.cc:304] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:24.402431 1172 ts_tablet_manager.cc:1403] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.575s user 0.010s sys 0.003s
I20260617 07:53:24.403960 884 tablet_service.cc:1511] Processing CreateTablet for tablet 517712d5f584434ba8c40b017a6a9092 (DEFAULT_TABLE table=default.Table_50024b66fbc145d990cf71324a0afe35 [id=b1d62cacd60243adb0d191191d93bc45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.404345 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517712d5f584434ba8c40b017a6a9092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.405982 887 tablet_service.cc:1511] Processing CreateTablet for tablet cbe1871b812a447e9b47a65de7709423 (DEFAULT_TABLE table=default.Table_fd7a3773d74242fcbdc4ee8f0794fd21 [id=0e00b24abf1446b3b8cbdc70e9327065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.406314 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe1871b812a447e9b47a65de7709423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.407423 883 tablet_service.cc:1511] Processing CreateTablet for tablet 83b75957083e4eb9b132280dbd7c5b9d (DEFAULT_TABLE table=default.Table_3608b494fe704c4eb01d58181b1f7c83 [id=1a09bca6f47e40d8830dd9f2da74d3a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.407706 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b75957083e4eb9b132280dbd7c5b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.415194 892 tablet_service.cc:1511] Processing CreateTablet for tablet 7345590f49894b7a8f7a1e7e4b26c2ef (DEFAULT_TABLE table=default.Table_73897e868adb452cbbcedea7797a6352 [id=03d2a1add32c43898bafa557e4d010fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.403968 898 tablet_service.cc:1511] Processing CreateTablet for tablet 23f8d24fe94b4b48acd0030c4276944e (DEFAULT_TABLE table=default.Table_5a33989a09d74eb2978b216ba46a372f [id=bed11028cf904965a31e443315b3f8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.416244 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f8d24fe94b4b48acd0030c4276944e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.416858 2629 raft_consensus.cc:2749] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:24.417335 986 leader_election.cc:343] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.417524 986 leader_election.cc:304] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:24.416554 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7345590f49894b7a8f7a1e7e4b26c2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.419505 2629 raft_consensus.cc:2749] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:24.420035 986 leader_election.cc:343] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.420199 986 leader_election.cc:304] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:24.420457 2629 raft_consensus.cc:2749] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.421025 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 5f8602b87a20455884c16196a901d335 (table default.Table_e01c4bf739194d638e2a3988702d4cfb [id=87e7c45adff04a7eb2c6edf0b75a047c]) successfully deleted
W20260617 07:53:24.422426 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e897b111e65c497591c7daaa81d783c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e897b111e65c497591c7daaa81d783c7 already in progress: creating tablet
I20260617 07:53:24.423761 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7345590f49894b7a8f7a1e7e4b26c2ef (DEFAULT_TABLE table=default.Table_73897e868adb452cbbcedea7797a6352 [id=03d2a1add32c43898bafa557e4d010fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.426736 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_832c0052f588434faa10b821b4d09514" } modify_external_catalogs: true
I20260617 07:53:24.426856 1171 tablet_bootstrap.cc:492] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.426976 1171 ts_tablet_manager.cc:1403] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.009s
I20260617 07:53:24.426942 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_832c0052f588434faa10b821b4d09514" } modify_external_catalogs: true
I20260617 07:53:24.427488 1172 raft_consensus.cc:359] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.427671 1172 raft_consensus.cc:385] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.427727 1172 raft_consensus.cc:740] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.427712 1171 raft_consensus.cc:359] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.427867 1171 raft_consensus.cc:385] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.427919 1171 raft_consensus.cc:740] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.427922 1172 consensus_queue.cc:260] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.428200 1171 consensus_queue.cc:260] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.428766 1172 ts_tablet_manager.cc:1434] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260617 07:53:24.429029 1172 tablet_bootstrap.cc:492] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.429947 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_fe72d813417e44f1af5c5a831d6db626"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.430442 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe72d813417e44f1af5c5a831d6db626 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.430858 1171 ts_tablet_manager.cc:1434] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:24.431166 1171 tablet_bootstrap.cc:492] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.431674 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7345590f49894b7a8f7a1e7e4b26c2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.432760 1171 tablet_bootstrap.cc:654] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.434316 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 9618a5c0c9dd4c368f5763c434f70da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.434804 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754162344fad4672a6c9c2b07858b21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.438352 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d4afe4a3d708447fa7ab8bf53614c4ba
I20260617 07:53:24.438433 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 83b75957083e4eb9b132280dbd7c5b9d (DEFAULT_TABLE table=default.Table_3608b494fe704c4eb01d58181b1f7c83 [id=1a09bca6f47e40d8830dd9f2da74d3a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.438633 1026 tablet_service.cc:1511] Processing CreateTablet for tablet cbe1871b812a447e9b47a65de7709423 (DEFAULT_TABLE table=default.Table_fd7a3773d74242fcbdc4ee8f0794fd21 [id=0e00b24abf1446b3b8cbdc70e9327065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.439462 887 tablet_service.cc:1558] Processing DeleteTablet for tablet d4afe4a3d708447fa7ab8bf53614c4ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:24.390937 713 leader_election.cc:343] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 95865af94c04410386d23cb369180611
I20260617 07:53:24.391038 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63de833f7aa740b0b5bf2494b78aca5c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.443076 1846 rpcz_store.cc:276] 0617 07:53:19.517638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.517683 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:24.194532 (+4676849us) ts_tablet_manager.cc:1151] Deleting tablet 36ce60b466f7420992ef194d72b5718d
0617 07:53:24.248868 (+ 54336us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.256854 (+ 7986us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.367643 (+110789us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.368845 (+ 1202us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4676658}
I20260617 07:53:24.443760 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 605) took 4925 ms. Trace:
I20260617 07:53:24.443846 1846 rpcz_store.cc:276] 0617 07:53:19.518009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.518051 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:24.443598 (+4925547us) ts_tablet_manager.cc:1151] Deleting tablet beb8fbb44e6147be8c9605be886a8aea
0617 07:53:24.443613 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.443741 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4925347}
I20260617 07:53:24.444190 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 606) took 4925 ms. Trace:
I20260617 07:53:24.444262 1846 rpcz_store.cc:276] 0617 07:53:19.518488 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.518530 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:24.444086 (+4925556us) ts_tablet_manager.cc:1151] Deleting tablet eba5976fcadd4add9c671300b431617b
0617 07:53:24.444096 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.444176 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4925373}
I20260617 07:53:24.444585 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 607) took 4925 ms. Trace:
I20260617 07:53:24.444655 1846 rpcz_store.cc:276] 0617 07:53:19.518824 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.518863 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:24.444481 (+4925618us) ts_tablet_manager.cc:1151] Deleting tablet 3bd63a5d7e8342d9b919aa0862f8cfc7
0617 07:53:24.444490 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.444572 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4925404}
I20260617 07:53:24.444964 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 608) took 4925 ms. Trace:
I20260617 07:53:24.445031 1846 rpcz_store.cc:276] 0617 07:53:19.519234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.519286 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:24.444872 (+4925586us) ts_tablet_manager.cc:1151] Deleting tablet adbb0c38ef9242a5bfbbcbe22faa5df9
0617 07:53:24.444881 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.444951 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4925388}
I20260617 07:53:24.443135 713 leader_election.cc:304] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.443212 779 raft_consensus.cc:2468] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
W20260617 07:53:24.445777 713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 54853.8us
I20260617 07:53:24.445798 2803 raft_consensus.cc:2749] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:24.446849 713 leader_election.cc:343] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 7f7611958cf143438497c93f5f2bc098
I20260617 07:53:24.446942 713 leader_election.cc:304] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.447283 745 tablet_service.cc:1511] Processing CreateTablet for tablet 3580774486c94811987370d563951284 (DEFAULT_TABLE table=default.Table_291781c0e1684d12b62096ae0017b212 [id=fa62d9f914ca4053b7065f8023603e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.447779 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3580774486c94811987370d563951284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.448647 1171 tablet_bootstrap.cc:492] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.448766 1171 ts_tablet_manager.cc:1403] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.002s
W20260617 07:53:24.449230 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet beb8fbb44e6147be8c9605be886a8aea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet beb8fbb44e6147be8c9605be886a8aea already in progress: creating tablet
W20260617 07:53:24.449420 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet eba5976fcadd4add9c671300b431617b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eba5976fcadd4add9c671300b431617b already in progress: creating tablet
I20260617 07:53:24.449440 1171 raft_consensus.cc:359] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.449587 1171 raft_consensus.cc:385] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 07:53:24.449590 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 already in progress: creating tablet
I20260617 07:53:24.449632 1171 raft_consensus.cc:740] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.449811 744 tablet_service.cc:1558] Processing DeleteTablet for tablet d4afe4a3d708447fa7ab8bf53614c4ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:24.449859 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet adbb0c38ef9242a5bfbbcbe22faa5df9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbb0c38ef9242a5bfbbcbe22faa5df9 already in progress: creating tablet
I20260617 07:53:24.449860 1171 consensus_queue.cc:260] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.449976 2803 raft_consensus.cc:2749] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.450325 1171 ts_tablet_manager.cc:1434] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:24.450583 1171 tablet_bootstrap.cc:492] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.452201 1171 tablet_bootstrap.cc:654] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.454898 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_acb19b0a19f54fe9a4be9d22be8f44b7" } modify_external_catalogs: true
I20260617 07:53:24.455139 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_acb19b0a19f54fe9a4be9d22be8f44b7" } modify_external_catalogs: true
I20260617 07:53:24.456845 756 tablet_service.cc:1511] Processing CreateTablet for tablet 517712d5f584434ba8c40b017a6a9092 (DEFAULT_TABLE table=default.Table_50024b66fbc145d990cf71324a0afe35 [id=b1d62cacd60243adb0d191191d93bc45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.457229 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517712d5f584434ba8c40b017a6a9092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.438354 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 517712d5f584434ba8c40b017a6a9092 (DEFAULT_TABLE table=default.Table_50024b66fbc145d990cf71324a0afe35 [id=b1d62cacd60243adb0d191191d93bc45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.460088 748 tablet_service.cc:1511] Processing CreateTablet for tablet cbe1871b812a447e9b47a65de7709423 (DEFAULT_TABLE table=default.Table_fd7a3773d74242fcbdc4ee8f0794fd21 [id=0e00b24abf1446b3b8cbdc70e9327065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.460444 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe1871b812a447e9b47a65de7709423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.460853 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 23f8d24fe94b4b48acd0030c4276944e (DEFAULT_TABLE table=default.Table_5a33989a09d74eb2978b216ba46a372f [id=bed11028cf904965a31e443315b3f8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.464085 1171 tablet_bootstrap.cc:492] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.464223 1171 ts_tablet_manager.cc:1403] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.001s
I20260617 07:53:24.464931 1171 raft_consensus.cc:359] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.465090 1171 raft_consensus.cc:385] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.465139 1171 raft_consensus.cc:740] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.465338 1171 consensus_queue.cc:260] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.465494 742 tablet_service.cc:1511] Processing CreateTablet for tablet 83b75957083e4eb9b132280dbd7c5b9d (DEFAULT_TABLE table=default.Table_3608b494fe704c4eb01d58181b1f7c83 [id=1a09bca6f47e40d8830dd9f2da74d3a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.465823 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b75957083e4eb9b132280dbd7c5b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.465922 1171 ts_tablet_manager.cc:1434] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:24.466177 1171 tablet_bootstrap.cc:492] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.468186 1171 tablet_bootstrap.cc:654] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.475239 986 leader_election.cc:304] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:24.480933 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b75957083e4eb9b132280dbd7c5b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.481410 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:24.482229 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe1871b812a447e9b47a65de7709423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.483408 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517712d5f584434ba8c40b017a6a9092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.486708 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f8d24fe94b4b48acd0030c4276944e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.488859 2506 sys_catalog.cc:455] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "becdd6b4fad846399c95f04697e01d0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becdd6b4fad846399c95f04697e01d0f" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 41615 } } peers { permanent_uuid: "29a94ff9f875443ab6aeac00922cda0d" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 36505 } } peers { permanent_uuid: "3b274c37ad4445ba8b41d6784b3cd336" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 33087 } } }
I20260617 07:53:24.489092 2506 sys_catalog.cc:458] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f [sys.catalog]: This master's current role is: LEADER
I20260617 07:53:24.489437 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:24.490268 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:24.494812 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 11794aa70824476e9751a41ab305cc80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.495070 1172 tablet_bootstrap.cc:654] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.495482 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c0ae1553e2aa43cf85c7584f5fff935e" } modify_external_catalogs: true
I20260617 07:53:24.495656 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c0ae1553e2aa43cf85c7584f5fff935e" } modify_external_catalogs: true
I20260617 07:53:24.497380 1178 tablet_bootstrap.cc:492] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.497501 1178 ts_tablet_manager.cc:1403] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.150s user 0.002s sys 0.000s
I20260617 07:53:24.498631 1178 raft_consensus.cc:359] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.498781 1178 raft_consensus.cc:385] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.498833 1178 raft_consensus.cc:740] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.499049 1178 consensus_queue.cc:260] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.506621 2729 raft_consensus.cc:493] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:24.506839 2729 raft_consensus.cc:515] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:24.507577 2729 leader_election.cc:290] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:24.508977 988 leader_election.cc:343] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 5ec425bb523a449d9fe16d3ea3a0d7ae
I20260617 07:53:24.509217 2594 raft_consensus.cc:493] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.509327 2594 raft_consensus.cc:515] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.509898 2594 leader_election.cc:290] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:24.511415 988 consensus_peers.cc:597] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbc79cfa11e342bd87da1aa03847c3cb. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:24.511402 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488cc3a082b14dee8f70153e6f2925a4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:24.512091 852 leader_election.cc:343] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:24.512475 851 leader_election.cc:343] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 488cc3a082b14dee8f70153e6f2925a4
I20260617 07:53:24.512578 851 leader_election.cc:304] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.512930 2710 raft_consensus.cc:2749] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.519363 2629 raft_consensus.cc:2804] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 07:53:24.519440 2629 raft_consensus.cc:493] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:24.519496 2629 raft_consensus.cc:3060] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:24.522254 2629 raft_consensus.cc:515] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.523240 2629 leader_election.cc:290] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:24.523499 986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 48284.3us
W20260617 07:53:24.524092 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f55c9a85e6e4b5ea7f2014cd0b7921a consensus state has no leader
W20260617 07:53:24.525417 988 leader_election.cc:343] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 63de833f7aa740b0b5bf2494b78aca5c
I20260617 07:53:24.527951 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.528165 765 raft_consensus.cc:2468] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:24.528757 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet d4afe4a3d708447fa7ab8bf53614c4ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.529024 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63de833f7aa740b0b5bf2494b78aca5c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:24.529196 766 raft_consensus.cc:3060] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 2
I20260617 07:53:24.531883 766 raft_consensus.cc:2468] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 2.
W20260617 07:53:24.534423 852 consensus_peers.cc:597] T 2777cf575a914f59b3459f3ce96f5d9a P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260617 07:53:24.537667 2594 consensus_queue.cc:1048] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:24.537881 986 leader_election.cc:304] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:24.538812 2729 raft_consensus.cc:2804] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 07:53:24.538887 2729 raft_consensus.cc:493] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:24.538945 2729 raft_consensus.cc:3060] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:24.541437 2729 raft_consensus.cc:515] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:24.544224 988 leader_election.cc:343] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 5ec425bb523a449d9fe16d3ea3a0d7ae
I20260617 07:53:24.544663 2729 leader_election.cc:290] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:24.546685 1178 ts_tablet_manager.cc:1434] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.049s user 0.000s sys 0.002s
I20260617 07:53:24.548487 1178 tablet_bootstrap.cc:492] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:24.550854 986 leader_election.cc:304] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:24.551374 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 609) took 5031 ms. Trace:
I20260617 07:53:24.552349 892 tablet_service.cc:1511] Processing CreateTablet for tablet 3580774486c94811987370d563951284 (DEFAULT_TABLE table=default.Table_291781c0e1684d12b62096ae0017b212 [id=fa62d9f914ca4053b7065f8023603e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.552775 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3580774486c94811987370d563951284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.556655 2729 raft_consensus.cc:2804] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Leader election won for term 2
I20260617 07:53:24.556789 2729 raft_consensus.cc:697] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:24.557034 2729 consensus_queue.cc:237] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.566857 1170 ts_tablet_manager.cc:1929] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.566969 1170 log.cc:1199] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/c58bbdbf59c7426c8adbbbe3f0aafaed
I20260617 07:53:24.567266 1170 ts_tablet_manager.cc:1950] T c58bbdbf59c7426c8adbbbe3f0aafaed P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:24.567989 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 412) took 5737 ms. Trace:
I20260617 07:53:24.568073 1170 rpcz_store.cc:276] 0617 07:53:18.830072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.830109 (+ 37us) service_pool.cc:224] Handling call
0617 07:53:24.398050 (+5567941us) ts_tablet_manager.cc:1151] Deleting tablet c58bbdbf59c7426c8adbbbe3f0aafaed
0617 07:53:24.398060 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.436367 (+ 38307us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.566809 (+130442us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.567972 (+ 1163us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5567816}
I20260617 07:53:24.568434 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 413) took 5738 ms. Trace:
I20260617 07:53:24.561595 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 121339ab4842432e9fb7bc357750f8ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:24.568506 1170 rpcz_store.cc:276] 0617 07:53:18.830376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.830409 (+ 33us) service_pool.cc:224] Handling call
0617 07:53:24.568322 (+5737913us) ts_tablet_manager.cc:1151] Deleting tablet 9436fb7fca094eaab925748e254b1a62
0617 07:53:24.568330 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.568419 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5737799}
I20260617 07:53:24.562960 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec425bb523a449d9fe16d3ea3a0d7ae" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:24.568728 765 raft_consensus.cc:3060] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Advancing to term 2
I20260617 07:53:24.568773 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 414) took 5728 ms. Trace:
I20260617 07:53:24.568833 1170 rpcz_store.cc:276] 0617 07:53:18.840728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.840776 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:24.568704 (+5727928us) ts_tablet_manager.cc:1151] Deleting tablet ee0e12aa4c60457182201a94caecda45
0617 07:53:24.568712 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.568759 (+ 47us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5720878}
I20260617 07:53:24.569100 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 415) took 5721 ms. Trace:
I20260617 07:53:24.569168 1170 rpcz_store.cc:276] 0617 07:53:18.847929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.847977 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:24.569037 (+5721060us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:24.569045 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.569088 (+ 43us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5720911}
I20260617 07:53:24.569464 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 416) took 5582 ms. Trace:
I20260617 07:53:24.569531 1170 rpcz_store.cc:276] 0617 07:53:18.987273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.987362 (+ 89us) service_pool.cc:224] Handling call
0617 07:53:24.569379 (+5582017us) ts_tablet_manager.cc:1151] Deleting tablet 3bd63a5d7e8342d9b919aa0862f8cfc7
0617 07:53:24.569387 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.569451 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5581837}
I20260617 07:53:24.569047 1846 rpcz_store.cc:276] 0617 07:53:19.519634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.519673 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:24.551235 (+5031562us) ts_tablet_manager.cc:1151] Deleting tablet ce7cc6cbd4a0474880ed62aebc035226
0617 07:53:24.551246 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.551357 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5031382}
W20260617 07:53:24.573949 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ce7cc6cbd4a0474880ed62aebc035226 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce7cc6cbd4a0474880ed62aebc035226 already in progress: creating tablet
I20260617 07:53:24.581961 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 610) took 5061 ms. Trace:
I20260617 07:53:24.582091 1846 rpcz_store.cc:276] 0617 07:53:19.520030 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.520069 (+ 39us) service_pool.cc:224] Handling call
0617 07:53:24.581796 (+5061727us) ts_tablet_manager.cc:1151] Deleting tablet fb74bb5046dc4bda98be3a9ba2f4a3c6
0617 07:53:24.581811 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.581936 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5061522}
I20260617 07:53:24.582921 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 488cc3a082b14dee8f70153e6f2925a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:24.583590 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 already in progress: creating tablet
I20260617 07:53:24.584792 1178 tablet_bootstrap.cc:654] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.588084 765 raft_consensus.cc:2468] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 2.
I20260617 07:53:24.590126 986 leader_election.cc:304] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b; no voters: 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:24.590569 2629 raft_consensus.cc:2804] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Leader election won for term 2
I20260617 07:53:24.594954 2629 raft_consensus.cc:697] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:24.595180 1862 ts_tablet_manager.cc:1916] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.595350 2629 consensus_queue.cc:237] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:24.602414 852 consensus_peers.cc:597] T cb0ff0f0426440fba477a3dc4d1644e0 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:24.605595 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fdedb9a69a0744439fd2c804e180933b consensus state has no leader
I20260617 07:53:24.608709 1172 tablet_bootstrap.cc:492] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.608989 1172 ts_tablet_manager.cc:1403] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.180s user 0.009s sys 0.004s
I20260617 07:53:24.610280 1172 raft_consensus.cc:359] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.610651 1172 raft_consensus.cc:385] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.610811 1172 raft_consensus.cc:740] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.611234 1178 tablet_bootstrap.cc:492] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.611259 1172 consensus_queue.cc:260] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.612317 1171 tablet_bootstrap.cc:492] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.612500 1171 ts_tablet_manager.cc:1403] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.146s user 0.039s sys 0.032s
I20260617 07:53:24.613366 1171 raft_consensus.cc:359] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.613590 1171 raft_consensus.cc:385] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.613685 1171 raft_consensus.cc:740] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.613988 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 417) took 5577 ms. Trace:
I20260617 07:53:24.614007 1172 ts_tablet_manager.cc:1434] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 07:53:24.614002 1171 consensus_queue.cc:260] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.614703 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ed779c8a02e144ef81280862481c4efc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:24.615885 1172 tablet_bootstrap.cc:492] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.614089 1170 rpcz_store.cc:276] 0617 07:53:19.036774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.036839 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:24.613863 (+5577024us) ts_tablet_manager.cc:1151] Deleting tablet adbb0c38ef9242a5bfbbcbe22faa5df9
0617 07:53:24.613875 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.613972 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5532680}
I20260617 07:53:24.618301 1171 ts_tablet_manager.cc:1434] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 07:53:24.618641 1171 tablet_bootstrap.cc:492] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.619412 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 418) took 5582 ms. Trace:
I20260617 07:53:24.619719 1170 rpcz_store.cc:276] 0617 07:53:19.036901 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.043252 (+ 6351us) service_pool.cc:224] Handling call
0617 07:53:24.618596 (+5575344us) ts_tablet_manager.cc:1151] Deleting tablet ce7cc6cbd4a0474880ed62aebc035226
0617 07:53:24.618609 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.619243 (+ 634us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5574936}
I20260617 07:53:24.621078 1171 tablet_bootstrap.cc:654] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.622094 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 401) took 5814 ms. Trace:
I20260617 07:53:24.623759 1170 rpcz_store.cc:276] 0617 07:53:18.807461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:18.807501 (+ 40us) service_pool.cc:224] Handling call
0617 07:53:24.621501 (+5814000us) ts_tablet_manager.cc:1151] Deleting tablet 4e8e9692227147d6a8c6854133941b44
0617 07:53:24.621668 (+ 167us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.622077 (+ 409us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5569168}
I20260617 07:53:24.626031 1178 ts_tablet_manager.cc:1403] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.002s
I20260617 07:53:24.612030 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 611) took 5091 ms. Trace:
I20260617 07:53:24.623036 765 raft_consensus.cc:1275] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Refusing update from remote peer dc3bec007846459a9da0c7b8211e477b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260617 07:53:24.626305 1846 rpcz_store.cc:276] 0617 07:53:19.520389 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.520437 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:24.611905 (+5091468us) ts_tablet_manager.cc:1151] Deleting tablet 5fb489c72a7a4e3590b81c768eeb5c43
0617 07:53:24.611914 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.612012 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5091268}
I20260617 07:53:24.626618 1846 tablet_replica.cc:333] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:24.626793 1846 raft_consensus.cc:2243] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.626983 2629 consensus_queue.cc:1048] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:24.627944 1846 raft_consensus.cc:2272] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.628507 1846 ts_tablet_manager.cc:1916] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:24.628587 986 consensus_peers.cc:597] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:24.628986 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5fb489c72a7a4e3590b81c768eeb5c43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fb489c72a7a4e3590b81c768eeb5c43 already in progress: creating tablet
I20260617 07:53:24.627697 1178 raft_consensus.cc:359] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.629833 1178 raft_consensus.cc:385] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.572564 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]) successfully deleted
I20260617 07:53:24.629942 1178 raft_consensus.cc:740] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
W20260617 07:53:24.629962 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed779c8a02e144ef81280862481c4efc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:24.630026 445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 57440.1us
I20260617 07:53:24.630203 1178 consensus_queue.cc:260] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:24.630781 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 9436fb7fca094eaab925748e254b1a62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9436fb7fca094eaab925748e254b1a62 already in progress: creating tablet
W20260617 07:53:24.631000 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ee0e12aa4c60457182201a94caecda45 because the tablet was not found. No further retry: Not found: Tablet not found: ee0e12aa4c60457182201a94caecda45
W20260617 07:53:24.631160 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 95865af94c04410386d23cb369180611 because the tablet was not found. No further retry: Not found: Tablet not found: 95865af94c04410386d23cb369180611
W20260617 07:53:24.631345 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bd63a5d7e8342d9b919aa0862f8cfc7 already in progress: creating tablet
W20260617 07:53:24.631520 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet adbb0c38ef9242a5bfbbcbe22faa5df9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbb0c38ef9242a5bfbbcbe22faa5df9 already in progress: creating tablet
W20260617 07:53:24.631693 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ce7cc6cbd4a0474880ed62aebc035226 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce7cc6cbd4a0474880ed62aebc035226 already in progress: creating tablet
W20260617 07:53:24.632817 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4e8e9692227147d6a8c6854133941b44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e8e9692227147d6a8c6854133941b44 already in progress: creating tablet
I20260617 07:53:24.633806 1172 tablet_bootstrap.cc:654] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.633948 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 419) took 5539 ms. Trace:
I20260617 07:53:24.634344 1178 ts_tablet_manager.cc:1434] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260617 07:53:24.634857 1170 rpcz_store.cc:276] 0617 07:53:19.094314 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.094372 (+ 58us) service_pool.cc:224] Handling call
0617 07:53:24.626233 (+5531861us) ts_tablet_manager.cc:1151] Deleting tablet fb74bb5046dc4bda98be3a9ba2f4a3c6
0617 07:53:24.626244 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.633932 (+ 7688us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5531439}
W20260617 07:53:24.635418 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 already in progress: creating tablet
I20260617 07:53:24.635532 1178 tablet_bootstrap.cc:492] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:24.635808 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 420) took 5502 ms. Trace:
I20260617 07:53:24.635936 1170 rpcz_store.cc:276] 0617 07:53:19.133349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.133596 (+ 247us) service_pool.cc:224] Handling call
0617 07:53:24.635703 (+5502107us) ts_tablet_manager.cc:1151] Deleting tablet 5fb489c72a7a4e3590b81c768eeb5c43
0617 07:53:24.635712 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.635792 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5501799}
W20260617 07:53:24.636765 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5fb489c72a7a4e3590b81c768eeb5c43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fb489c72a7a4e3590b81c768eeb5c43 already in progress: creating tablet
I20260617 07:53:24.637168 1178 tablet_bootstrap.cc:654] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.637576 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 3580774486c94811987370d563951284 (DEFAULT_TABLE table=default.Table_291781c0e1684d12b62096ae0017b212 [id=fa62d9f914ca4053b7065f8023603e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.637969 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3580774486c94811987370d563951284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.642580 892 tablet_service.cc:1511] Processing CreateTablet for tablet 49732dea2ce842b5b0aa1fe7b87501e4 (DEFAULT_TABLE table=default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.643010 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49732dea2ce842b5b0aa1fe7b87501e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.643257 898 tablet_service.cc:1511] Processing CreateTablet for tablet af26f5e478af43eea21094621879d95c (DEFAULT_TABLE table=default.Table_e3e48dd41d7142f3b6445fe78c01f8a4 [id=91e1bc076d9742fcadca8e0b3451cffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.643481 745 tablet_service.cc:1511] Processing CreateTablet for tablet af26f5e478af43eea21094621879d95c (DEFAULT_TABLE table=default.Table_e3e48dd41d7142f3b6445fe78c01f8a4 [id=91e1bc076d9742fcadca8e0b3451cffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.643625 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af26f5e478af43eea21094621879d95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.643844 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af26f5e478af43eea21094621879d95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.643038 744 tablet_service.cc:1511] Processing CreateTablet for tablet 49732dea2ce842b5b0aa1fe7b87501e4 (DEFAULT_TABLE table=default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.644361 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49732dea2ce842b5b0aa1fe7b87501e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.644557 2803 raft_consensus.cc:493] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:24.644683 2803 raft_consensus.cc:515] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.645370 2803 leader_election.cc:290] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.650373 1178 tablet_bootstrap.cc:492] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.651196 1171 tablet_bootstrap.cc:492] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.651377 1171 ts_tablet_manager.cc:1403] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.001s
I20260617 07:53:24.652140 1171 raft_consensus.cc:359] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.652398 1171 raft_consensus.cc:385] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.652501 1171 raft_consensus.cc:740] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.652781 1171 consensus_queue.cc:260] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.653438 1171 ts_tablet_manager.cc:1434] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:24.653756 1171 tablet_bootstrap.cc:492] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.655356 1171 tablet_bootstrap.cc:654] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.657338 1178 ts_tablet_manager.cc:1403] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
W20260617 07:53:24.658008 716 leader_election.cc:343] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: b4c9a032007a412e95bbd2b229edd50b
I20260617 07:53:24.658125 1178 raft_consensus.cc:359] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.658361 1178 raft_consensus.cc:385] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.658453 1178 raft_consensus.cc:740] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.658718 1178 consensus_queue.cc:260] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.659320 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c9a032007a412e95bbd2b229edd50b" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:24.659657 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 49732dea2ce842b5b0aa1fe7b87501e4 (DEFAULT_TABLE table=default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.660072 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49732dea2ce842b5b0aa1fe7b87501e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.661490 1178 ts_tablet_manager.cc:1434] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 07:53:24.657196 1846 ts_tablet_manager.cc:1929] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.662317 1846 log.cc:1199] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/cbc79cfa11e342bd87da1aa03847c3cb
I20260617 07:53:24.662720 1846 ts_tablet_manager.cc:1950] T cbc79cfa11e342bd87da1aa03847c3cb P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:24.664566 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 622) took 4983 ms. Trace:
I20260617 07:53:24.667716 1014 tablet_service.cc:1511] Processing CreateTablet for tablet af26f5e478af43eea21094621879d95c (DEFAULT_TABLE table=default.Table_e3e48dd41d7142f3b6445fe78c01f8a4 [id=91e1bc076d9742fcadca8e0b3451cffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:24.667950 1846 rpcz_store.cc:276] 0617 07:53:19.681178 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.681630 (+ 452us) service_pool.cc:224] Handling call
0617 07:53:24.626577 (+4944947us) ts_tablet_manager.cc:1151] Deleting tablet cbc79cfa11e342bd87da1aa03847c3cb
0617 07:53:24.626587 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.639275 (+ 12688us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.657151 (+ 17876us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.664550 (+ 7399us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4944748}
I20260617 07:53:24.668154 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af26f5e478af43eea21094621879d95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:24.667011 713 leader_election.cc:304] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.668680 2803 raft_consensus.cc:2749] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:24.663854 1178 tablet_bootstrap.cc:492] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:24.670583 1178 tablet_bootstrap.cc:654] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.670996 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]) successfully deleted
I20260617 07:53:24.671509 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 625) took 4990 ms. Trace:
I20260617 07:53:24.672441 1846 rpcz_store.cc:276] 0617 07:53:19.681491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.683792 (+ 2301us) service_pool.cc:224] Handling call
0617 07:53:24.671386 (+4987594us) ts_tablet_manager.cc:1151] Deleting tablet 9d94915d96694d6f9a86063640e5fe18
0617 07:53:24.671396 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.671493 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4987402}
W20260617 07:53:24.672963 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9d94915d96694d6f9a86063640e5fe18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d94915d96694d6f9a86063640e5fe18 already in progress: creating tablet
I20260617 07:53:24.673372 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 626) took 4989 ms. Trace:
I20260617 07:53:24.673489 1846 rpcz_store.cc:276] 0617 07:53:19.684156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.684639 (+ 483us) service_pool.cc:224] Handling call
0617 07:53:24.673268 (+4988629us) ts_tablet_manager.cc:1151] Deleting tablet e9f8492f127243eca07b2ffbabddded5
0617 07:53:24.673276 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.673355 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4988449}
W20260617 07:53:24.673961 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e9f8492f127243eca07b2ffbabddded5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9f8492f127243eca07b2ffbabddded5 already in progress: creating tablet
I20260617 07:53:24.674376 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 627) took 4989 ms. Trace:
I20260617 07:53:24.674491 1846 rpcz_store.cc:276] 0617 07:53:19.684953 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.685134 (+ 181us) service_pool.cc:224] Handling call
0617 07:53:24.674257 (+4989123us) ts_tablet_manager.cc:1151] Deleting tablet cc1d9ce2ab5b428893719d9acd272d88
0617 07:53:24.674269 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.674360 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4988973}
I20260617 07:53:24.637084 1170 tablet_replica.cc:333] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:24.675031 1170 raft_consensus.cc:2243] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: Raft consensus shutting down.
W20260617 07:53:24.675077 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cc1d9ce2ab5b428893719d9acd272d88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc1d9ce2ab5b428893719d9acd272d88 already in progress: creating tablet
I20260617 07:53:24.675403 1170 pending_rounds.cc:70] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Trying to abort 2 pending ops.
I20260617 07:53:24.675503 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 628) took 4990 ms. Trace:
I20260617 07:53:24.675494 1170 pending_rounds.cc:77] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7297772763594031104 op_type: NO_OP noop_request { }
I20260617 07:53:24.676090 1846 rpcz_store.cc:276] 0617 07:53:19.685511 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.686061 (+ 550us) service_pool.cc:224] Handling call
0617 07:53:24.675409 (+4989348us) ts_tablet_manager.cc:1151] Deleting tablet 6cdcd3904a754939b9ae09cc3672bbc6
0617 07:53:24.675417 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.675487 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4989166}
I20260617 07:53:24.675586 1170 raft_consensus.cc:2889] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:24.676776 1170 pending_rounds.cc:77] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7297772750563643392 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "cbc79cfa11e342bd87da1aa03847c3cb" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_7c3a47f37c184835aa2758f4f5f69c6d" dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" new_extra_config { } }
W20260617 07:53:24.676894 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6cdcd3904a754939b9ae09cc3672bbc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cdcd3904a754939b9ae09cc3672bbc6 already in progress: creating tablet
I20260617 07:53:24.677160 1170 raft_consensus.cc:2272] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.677698 1846 tablet_replica.cc:333] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:24.677747 1170 ts_tablet_manager.cc:1916] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.678349 1846 raft_consensus.cc:2243] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.678934 1846 raft_consensus.cc:2272] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.682421 1846 ts_tablet_manager.cc:1916] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.689232 1846 ts_tablet_manager.cc:1929] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.692378 457 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_cf59fff4b93345819e95a268c92f8c64 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 2 got 0
I20260617 07:53:24.693634 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 037539021d1743bb9a66403b8a01662f from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:24.694226 2709 raft_consensus.cc:493] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.694380 2709 raft_consensus.cc:515] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.694984 2709 leader_election.cc:290] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:24.696026 851 leader_election.cc:343] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 11794aa70824476e9751a41ab305cc80
I20260617 07:53:24.699134 1172 tablet_bootstrap.cc:492] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.699340 1172 ts_tablet_manager.cc:1403] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.001s
I20260617 07:53:24.700035 1172 raft_consensus.cc:359] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.700282 1172 raft_consensus.cc:385] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.700379 1172 raft_consensus.cc:740] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.700703 1172 consensus_queue.cc:260] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.702330 1172 ts_tablet_manager.cc:1434] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:24.703446 1172 tablet_bootstrap.cc:492] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.704897 1172 tablet_bootstrap.cc:654] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.698624 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11794aa70824476e9751a41ab305cc80" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.702409 1178 tablet_bootstrap.cc:492] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.706117 1178 ts_tablet_manager.cc:1403] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.000s
I20260617 07:53:24.706859 1178 raft_consensus.cc:359] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.707095 1178 raft_consensus.cc:385] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.707197 1178 raft_consensus.cc:740] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.707435 1178 consensus_queue.cc:260] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:24.708348 852 leader_election.cc:343] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.708484 852 leader_election.cc:304] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.708624 2774 raft_consensus.cc:493] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.708732 2774 raft_consensus.cc:515] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.709168 1178 ts_tablet_manager.cc:1434] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:24.709249 2774 leader_election.cc:290] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.710352 1178 tablet_bootstrap.cc:492] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:24.710326 2775 raft_consensus.cc:2749] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.710358 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d846e5951d400ebc4ba6552406c63c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:24.710765 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d846e5951d400ebc4ba6552406c63c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:24.710791 851 leader_election.cc:343] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.711107 2775 raft_consensus.cc:493] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.711226 2775 raft_consensus.cc:515] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.711807 2775 leader_election.cc:290] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.711844 1178 tablet_bootstrap.cc:654] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.712174 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdf8f714539449d8862cd2a2336fbe9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:24.712381 852 leader_election.cc:343] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.712430 1046 raft_consensus.cc:2468] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:24.712497 852 leader_election.cc:304] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.712541 1846 log.cc:1199] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/63de833f7aa740b0b5bf2494b78aca5c
I20260617 07:53:24.712837 1846 ts_tablet_manager.cc:1950] T 63de833f7aa740b0b5bf2494b78aca5c P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:24.712848 2774 raft_consensus.cc:2749] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.712901 851 leader_election.cc:304] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:24.713234 2774 raft_consensus.cc:2804] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:24.713306 2774 raft_consensus.cc:493] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:24.713362 2774 raft_consensus.cc:3060] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:24.713279 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdf8f714539449d8862cd2a2336fbe9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.714035 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 629) took 5027 ms. Trace:
W20260617 07:53:24.715103 852 leader_election.cc:343] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.716413 2774 raft_consensus.cc:515] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.717235 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2777cf575a914f59b3459f3ce96f5d9a (table default.Table_cf59fff4b93345819e95a268c92f8c64 [id=303a8e07863a4dbe90a17c3c1aeae6c8]). Expected version 2 got 0
I20260617 07:53:24.717338 2774 leader_election.cc:290] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.717437 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdf8f714539449d8862cd2a2336fbe9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:24.717483 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:24.717599 1051 raft_consensus.cc:3060] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:24.717949 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdf8f714539449d8862cd2a2336fbe9" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:24.722167 852 leader_election.cc:343] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.720352 1051 raft_consensus.cc:2468] T 1cdf8f714539449d8862cd2a2336fbe9 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:24.723084 765 raft_consensus.cc:3060] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:24.715000 1846 rpcz_store.cc:276] 0617 07:53:19.686382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.687702 (+ 1320us) service_pool.cc:224] Handling call
0617 07:53:24.677652 (+4989950us) ts_tablet_manager.cc:1151] Deleting tablet 63de833f7aa740b0b5bf2494b78aca5c
0617 07:53:24.677663 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.686589 (+ 8926us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.689184 (+ 2595us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.714014 (+ 24830us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4989742}
I20260617 07:53:24.723343 851 leader_election.cc:304] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:24.723779 2774 raft_consensus.cc:2804] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:24.723935 2774 raft_consensus.cc:697] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:24.724205 2774 consensus_queue.cc:237] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.724537 1178 tablet_bootstrap.cc:492] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.725219 1178 ts_tablet_manager.cc:1403] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20260617 07:53:24.724766 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 630) took 5035 ms. Trace:
I20260617 07:53:24.725818 1846 rpcz_store.cc:276] 0617 07:53:19.688090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.688259 (+ 169us) service_pool.cc:224] Handling call
0617 07:53:24.723557 (+5035298us) ts_tablet_manager.cc:1151] Deleting tablet eafcf54494f244f1b978b4b5e39d93bd
0617 07:53:24.723565 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.723651 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5035117}
I20260617 07:53:24.726248 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 637) took 5027 ms. Trace:
I20260617 07:53:24.726501 1846 rpcz_store.cc:276] 0617 07:53:19.699162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.700699 (+ 1537us) service_pool.cc:224] Handling call
0617 07:53:24.726133 (+5025434us) ts_tablet_manager.cc:1151] Deleting tablet a90472b619d644b7b01f5104872ecb64
0617 07:53:24.726142 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.726232 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5025177}
I20260617 07:53:24.727031 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 645) took 4999 ms. Trace:
I20260617 07:53:24.727681 1846 rpcz_store.cc:276] 0617 07:53:19.727466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.727636 (+ 170us) service_pool.cc:224] Handling call
0617 07:53:24.726932 (+4999296us) ts_tablet_manager.cc:1151] Deleting tablet c449d3e251aa4f06a9191114bff0e0e2
0617 07:53:24.726942 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.727016 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4999073}
I20260617 07:53:24.728538 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 646) took 5000 ms. Trace:
I20260617 07:53:24.728961 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]) successfully deleted
W20260617 07:53:24.729236 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet eafcf54494f244f1b978b4b5e39d93bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eafcf54494f244f1b978b4b5e39d93bd already in progress: creating tablet
W20260617 07:53:24.729465 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a90472b619d644b7b01f5104872ecb64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a90472b619d644b7b01f5104872ecb64 already in progress: creating tablet
W20260617 07:53:24.729673 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c449d3e251aa4f06a9191114bff0e0e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c449d3e251aa4f06a9191114bff0e0e2 already in progress: creating tablet
I20260617 07:53:24.730108 1846 rpcz_store.cc:276] 0617 07:53:19.727995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.728193 (+ 198us) service_pool.cc:224] Handling call
0617 07:53:24.728454 (+5000261us) ts_tablet_manager.cc:1151] Deleting tablet 4f95a13b909c4ef9be6c56a317b42c9b
0617 07:53:24.728462 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.728525 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5000069}
I20260617 07:53:24.730859 1170 ts_tablet_manager.cc:1929] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.3
I20260617 07:53:24.731695 1170 log.cc:1199] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/cbc79cfa11e342bd87da1aa03847c3cb
I20260617 07:53:24.732461 1170 ts_tablet_manager.cc:1950] T cbc79cfa11e342bd87da1aa03847c3cb P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:24.728111 1178 raft_consensus.cc:359] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.734393 1178 raft_consensus.cc:385] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.734496 1178 raft_consensus.cc:740] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.734828 1846 tablet_replica.cc:333] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:24.735001 1178 consensus_queue.cc:260] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.736994 1178 ts_tablet_manager.cc:1434] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260617 07:53:24.735659 1846 raft_consensus.cc:2243] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.737848 1846 raft_consensus.cc:2272] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.738436 1846 ts_tablet_manager.cc:1916] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.742990 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:24.743522 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 431) took 5543 ms. Trace:
I20260617 07:53:24.744486 1170 rpcz_store.cc:276] 0617 07:53:19.199596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.199650 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:24.637044 (+5437394us) ts_tablet_manager.cc:1151] Deleting tablet cbc79cfa11e342bd87da1aa03847c3cb
0617 07:53:24.637053 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.705360 (+ 68307us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.730794 (+ 25434us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.743502 (+ 12708us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5437202}
I20260617 07:53:24.739586 1178 tablet_bootstrap.cc:492] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:24.742671 1172 tablet_bootstrap.cc:492] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.745517 1172 ts_tablet_manager.cc:1403] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.003s
I20260617 07:53:24.746255 1172 raft_consensus.cc:359] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.746946 1172 raft_consensus.cc:385] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.747118 1172 raft_consensus.cc:740] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.746688 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 432) took 5544 ms. Trace:
I20260617 07:53:24.747561 1170 rpcz_store.cc:276] 0617 07:53:19.202212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.202261 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:24.746590 (+5544329us) ts_tablet_manager.cc:1151] Deleting tablet 596ef68705c84791b54f07e03b219b4c
0617 07:53:24.746600 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.746671 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5544159}
I20260617 07:53:24.746767 1178 tablet_bootstrap.cc:654] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.748873 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 433) took 5545 ms. Trace:
I20260617 07:53:24.749284 1170 rpcz_store.cc:276] 0617 07:53:19.203219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.203268 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:24.748745 (+5545477us) ts_tablet_manager.cc:1151] Deleting tablet 70610822c57e45c7add7e1f5ce96d889
0617 07:53:24.748754 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.748859 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5545312}
I20260617 07:53:24.748088 1172 consensus_queue.cc:260] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.751453 1172 ts_tablet_manager.cc:1434] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 07:53:24.751808 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 434) took 5548 ms. Trace:
I20260617 07:53:24.753230 1170 rpcz_store.cc:276] 0617 07:53:19.203371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.203457 (+ 86us) service_pool.cc:224] Handling call
0617 07:53:24.751710 (+5548253us) ts_tablet_manager.cc:1151] Deleting tablet 1f6264adc3994c22864ea73106ba2320
0617 07:53:24.751720 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.751789 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5548122}
I20260617 07:53:24.754148 1170 tablet_replica.cc:333] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:24.754465 1178 tablet_bootstrap.cc:492] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.753633 1172 tablet_bootstrap.cc:492] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.755080 1170 raft_consensus.cc:2243] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:24.755124 1178 ts_tablet_manager.cc:1403] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260617 07:53:24.756017 1178 raft_consensus.cc:359] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.756515 1170 pending_rounds.cc:70] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:24.756886 1170 pending_rounds.cc:77] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772753120813056 op_type: NO_OP noop_request { }
I20260617 07:53:24.757002 1178 raft_consensus.cc:385] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.757113 1170 raft_consensus.cc:2889] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260617 07:53:24.757215 852 consensus_peers.cc:597] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:24.757272 1178 raft_consensus.cc:740] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.757378 1170 raft_consensus.cc:2272] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.757743 1178 consensus_queue.cc:260] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.758051 1170 ts_tablet_manager.cc:1916] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.745277 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet cbc79cfa11e342bd87da1aa03847c3cb (table default.Table_7c3a47f37c184835aa2758f4f5f69c6d [id=ad4030fa284949019fea2539566b66aa]) successfully deleted
W20260617 07:53:24.759517 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 596ef68705c84791b54f07e03b219b4c because the tablet was not found. No further retry: Not found: Tablet not found: 596ef68705c84791b54f07e03b219b4c
I20260617 07:53:24.759652 1178 ts_tablet_manager.cc:1434] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
W20260617 07:53:24.759768 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 70610822c57e45c7add7e1f5ce96d889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70610822c57e45c7add7e1f5ce96d889 already in progress: creating tablet
I20260617 07:53:24.761062 1178 tablet_bootstrap.cc:492] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:24.751222 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 56e089af99464471b4d5482c3364d20f
I20260617 07:53:24.762393 459 catalog_manager.cc:6784] ReplaceTablet: tablet 56e089af99464471b4d5482c3364d20f deleted and replaced by tablet d95a7e6fda324402a7a59a335f876c08
I20260617 07:53:24.762951 1846 ts_tablet_manager.cc:1929] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:24.763036 1846 log.cc:1199] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/5ec425bb523a449d9fe16d3ea3a0d7ae
I20260617 07:53:24.763063 1172 tablet_bootstrap.cc:654] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.763360 1846 ts_tablet_manager.cc:1950] T 5ec425bb523a449d9fe16d3ea3a0d7ae P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:24.767268 1172 tablet_bootstrap.cc:492] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.767869 1172 ts_tablet_manager.cc:1403] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260617 07:53:24.769032 1172 raft_consensus.cc:359] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.769308 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 657) took 4719 ms. Trace:
I20260617 07:53:24.769836 1172 raft_consensus.cc:385] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.770200 1846 rpcz_store.cc:276] 0617 07:53:20.050251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.079662 (+ 29411us) service_pool.cc:224] Handling call
0617 07:53:24.734790 (+4655128us) ts_tablet_manager.cc:1151] Deleting tablet 5ec425bb523a449d9fe16d3ea3a0d7ae
0617 07:53:24.734799 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.742934 (+ 8135us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.762906 (+ 19972us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.769290 (+ 6384us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4654876}
I20260617 07:53:24.770865 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 655) took 4720 ms. Trace:
I20260617 07:53:24.771309 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]) successfully deleted
I20260617 07:53:24.771293 1846 rpcz_store.cc:276] 0617 07:53:20.050015 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.100520 (+ 50505us) service_pool.cc:224] Handling call
0617 07:53:24.770736 (+4670216us) ts_tablet_manager.cc:1151] Deleting tablet 37b36c91191445478055b78830be9450
0617 07:53:24.770745 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.770850 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4648962}
I20260617 07:53:24.771392 1172 raft_consensus.cc:740] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.771617 1172 consensus_queue.cc:260] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:24.771687 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 37b36c91191445478055b78830be9450 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37b36c91191445478055b78830be9450 already in progress: creating tablet
I20260617 07:53:24.773703 1172 ts_tablet_manager.cc:1434] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:24.774243 1178 tablet_bootstrap.cc:654] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.774267 779 raft_consensus.cc:3060] T 28538804fd254dc8b4a341debf508a85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:24.775974 1172 tablet_bootstrap.cc:492] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.775987 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 654) took 4726 ms. Trace:
I20260617 07:53:24.776078 1846 rpcz_store.cc:276] 0617 07:53:20.049867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.080685 (+ 30818us) service_pool.cc:224] Handling call
0617 07:53:24.775870 (+4695185us) ts_tablet_manager.cc:1151] Deleting tablet 17c8a945eca643f3b3f4807406e9a24e
0617 07:53:24.775878 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.775971 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4630588}
I20260617 07:53:24.776436 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 656) took 4726 ms. Trace:
I20260617 07:53:24.776510 1846 rpcz_store.cc:276] 0617 07:53:20.050124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.081696 (+ 31572us) service_pool.cc:224] Handling call
0617 07:53:24.776341 (+4694645us) ts_tablet_manager.cc:1151] Deleting tablet 61510f9812e849e388c6c163e9af5f4f
0617 07:53:24.776350 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.776423 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4615333}
I20260617 07:53:24.776949 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 676) took 4687 ms. Trace:
I20260617 07:53:24.777041 1846 rpcz_store.cc:276] 0617 07:53:20.089696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.239510 (+149814us) service_pool.cc:224] Handling call
0617 07:53:24.776853 (+4537343us) ts_tablet_manager.cc:1151] Deleting tablet 67cd66ea6ebc42bda00fbec82da73f16
0617 07:53:24.776864 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.776934 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4537085}
I20260617 07:53:24.777338 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 677) took 4687 ms. Trace:
I20260617 07:53:24.777405 1846 rpcz_store.cc:276] 0617 07:53:20.089804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.239789 (+149985us) service_pool.cc:224] Handling call
0617 07:53:24.777244 (+4537455us) ts_tablet_manager.cc:1151] Deleting tablet f34a2ee6fa82482db979ab25bc284f8e
0617 07:53:24.777254 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.777325 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4537311}
W20260617 07:53:24.777624 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 17c8a945eca643f3b3f4807406e9a24e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17c8a945eca643f3b3f4807406e9a24e already in progress: creating tablet
W20260617 07:53:24.778111 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 61510f9812e849e388c6c163e9af5f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61510f9812e849e388c6c163e9af5f4f already in progress: creating tablet
W20260617 07:53:24.778564 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 67cd66ea6ebc42bda00fbec82da73f16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67cd66ea6ebc42bda00fbec82da73f16 already in progress: creating tablet
I20260617 07:53:24.778786 1172 tablet_bootstrap.cc:654] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:24.781965 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f34a2ee6fa82482db979ab25bc284f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f34a2ee6fa82482db979ab25bc284f8e already in progress: creating tablet
I20260617 07:53:24.782229 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 56e089af99464471b4d5482c3364d20f with delete_type TABLET_DATA_DELETED (replaced by tablet d95a7e6fda324402a7a59a335f876c08) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.782439 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 678) took 4692 ms. Trace:
I20260617 07:53:24.783041 1846 rpcz_store.cc:276] 0617 07:53:20.089890 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.239946 (+150056us) service_pool.cc:224] Handling call
0617 07:53:24.782362 (+4542416us) ts_tablet_manager.cc:1151] Deleting tablet 05de71ea02df48ffacb369caa7f7d3de
0617 07:53:24.782369 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.782424 (+ 55us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4542296}
W20260617 07:53:24.783878 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 05de71ea02df48ffacb369caa7f7d3de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05de71ea02df48ffacb369caa7f7d3de already in progress: creating tablet
I20260617 07:53:24.784462 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 679) took 4271 ms. Trace:
I20260617 07:53:24.785102 1846 rpcz_store.cc:276] 0617 07:53:20.512708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.512780 (+ 72us) service_pool.cc:224] Handling call
0617 07:53:24.784343 (+4271563us) ts_tablet_manager.cc:1151] Deleting tablet a1e064b5bc93442f83aeffa88861d818
0617 07:53:24.784356 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.784445 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4264619}
W20260617 07:53:24.785799 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a1e064b5bc93442f83aeffa88861d818 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e064b5bc93442f83aeffa88861d818 already in progress: creating tablet
I20260617 07:53:24.786490 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 680) took 4273 ms. Trace:
I20260617 07:53:24.787106 1172 tablet_bootstrap.cc:492] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.787180 1846 rpcz_store.cc:276] 0617 07:53:20.512973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.524151 (+ 11178us) service_pool.cc:224] Handling call
0617 07:53:24.786373 (+4262222us) ts_tablet_manager.cc:1151] Deleting tablet 7ca402543247461aa5384abb65fff364
0617 07:53:24.786385 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.786472 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4262020}
I20260617 07:53:24.787793 1172 ts_tablet_manager.cc:1403] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
W20260617 07:53:24.788081 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7ca402543247461aa5384abb65fff364 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ca402543247461aa5384abb65fff364 already in progress: creating tablet
I20260617 07:53:24.788504 1846 tablet_replica.cc:333] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:24.788714 1172 raft_consensus.cc:359] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.788895 1172 raft_consensus.cc:385] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.789120 1846 raft_consensus.cc:2243] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.789739 1846 raft_consensus.cc:2272] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.787334 1170 ts_tablet_manager.cc:1929] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:24.789964 1170 log.cc:1199] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/630e540a77374c11895ab5a0e394b3bb
I20260617 07:53:24.790422 1170 ts_tablet_manager.cc:1950] T 630e540a77374c11895ab5a0e394b3bb P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:24.790766 1846 ts_tablet_manager.cc:1916] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.791565 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 437) took 5556 ms. Trace:
I20260617 07:53:24.792342 1170 rpcz_store.cc:276] 0617 07:53:19.235089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.235295 (+ 206us) service_pool.cc:224] Handling call
0617 07:53:24.754103 (+5518808us) ts_tablet_manager.cc:1151] Deleting tablet 630e540a77374c11895ab5a0e394b3bb
0617 07:53:24.754112 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.761247 (+ 7135us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.782051 (+ 20804us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.791548 (+ 9497us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5518529}
I20260617 07:53:24.788951 1172 raft_consensus.cc:740] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.793407 1172 consensus_queue.cc:260] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.793846 1170 tablet_replica.cc:333] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:24.796082 1172 ts_tablet_manager.cc:1434] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260617 07:53:24.796319 1170 raft_consensus.cc:2243] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.796906 1170 raft_consensus.cc:2272] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.797482 1170 ts_tablet_manager.cc:1916] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.798362 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 56e089af99464471b4d5482c3364d20f with delete_type TABLET_DATA_DELETED (replaced by tablet d95a7e6fda324402a7a59a335f876c08) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:24.799746 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
/tmp/dist-test-taskYlbqAx/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:36505
--webserver_interface=127.0.105.189
--webserver_port=38635
--builtin_ntp_servers=127.0.105.148:37851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 07:53:24.798661 1172 tablet_bootstrap.cc:492] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.803658 1172 tablet_bootstrap.cc:654] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.805492 1846 ts_tablet_manager.cc:1929] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:24.810832 1846 log.cc:1199] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/69f5b567da0e4baab53c00c55923e920
I20260617 07:53:24.811478 1846 ts_tablet_manager.cc:1950] T 69f5b567da0e4baab53c00c55923e920 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:24.813051 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 689) took 4198 ms. Trace:
I20260617 07:53:24.815518 1846 rpcz_store.cc:276] 0617 07:53:20.614875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.614921 (+ 46us) service_pool.cc:224] Handling call
0617 07:53:24.788460 (+4173539us) ts_tablet_manager.cc:1151] Deleting tablet 69f5b567da0e4baab53c00c55923e920
0617 07:53:24.788471 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.800889 (+ 12418us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.805441 (+ 4552us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.813033 (+ 7592us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4173319}
I20260617 07:53:24.816095 1172 tablet_bootstrap.cc:492] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.816252 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet a4a35e3b7bb74667aa498c58a856cacc
I20260617 07:53:24.816375 1172 ts_tablet_manager.cc:1403] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260617 07:53:24.817077 1172 raft_consensus.cc:359] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.817889 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 690) took 4201 ms. Trace:
I20260617 07:53:24.818310 1172 raft_consensus.cc:385] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.818528 1172 raft_consensus.cc:740] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.818928 1172 consensus_queue.cc:260] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.818403 1846 rpcz_store.cc:276] 0617 07:53:20.615842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.615886 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:24.817120 (+4201234us) ts_tablet_manager.cc:1151] Deleting tablet 24ba13170e864dfa96cddfb1a76b8c40
0617 07:53:24.817131 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.817776 (+ 645us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4200967}
I20260617 07:53:24.820880 1172 ts_tablet_manager.cc:1434] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 07:53:24.821045 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 691) took 4204 ms. Trace:
I20260617 07:53:24.821699 1846 rpcz_store.cc:276] 0617 07:53:20.616250 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.616295 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:24.820363 (+4204068us) ts_tablet_manager.cc:1151] Deleting tablet ea4c1033487a4dd2a73bd5148d5bb8f9
0617 07:53:24.820373 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.821026 (+ 653us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4203834}
I20260617 07:53:24.824003 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_7696e2ad0ad344399a63554bebb4c01b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:24.824093 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 692) took 4103 ms. Trace:
I20260617 07:53:24.824373 1846 rpcz_store.cc:276] 0617 07:53:20.720863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.721015 (+ 152us) service_pool.cc:224] Handling call
0617 07:53:24.823424 (+4102409us) ts_tablet_manager.cc:1151] Deleting tablet d06187aa09fd4776a992a07405a10876
0617 07:53:24.823435 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.823974 (+ 539us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4102093}
I20260617 07:53:24.827742 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 693) took 4106 ms. Trace:
I20260617 07:53:24.828255 1172 tablet_bootstrap.cc:492] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.828176 1846 rpcz_store.cc:276] 0617 07:53:20.720957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.721324 (+ 367us) service_pool.cc:224] Handling call
0617 07:53:24.826997 (+4105673us) ts_tablet_manager.cc:1151] Deleting tablet 561c8bf9e5c840628ab1c8cf91dc2d93
0617 07:53:24.827007 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.827630 (+ 623us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4105365}
I20260617 07:53:24.830480 1846 tablet_replica.cc:333] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:24.822490 1170 ts_tablet_manager.cc:1929] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:24.831842 1846 raft_consensus.cc:2243] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.832763 1846 raft_consensus.cc:2272] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.833845 1846 ts_tablet_manager.cc:1916] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.838634 2709 raft_consensus.cc:493] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.838771 2709 raft_consensus.cc:515] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.839366 2709 leader_election.cc:290] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.840715 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be19ece3a0a4a51abad7b8e2f3b2420" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:24.841279 851 leader_election.cc:343] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 0be19ece3a0a4a51abad7b8e2f3b2420
W20260617 07:53:24.842002 852 leader_election.cc:343] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.842213 852 leader_election.cc:304] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.842715 2709 raft_consensus.cc:2749] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.842763 1171 tablet_bootstrap.cc:492] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.842932 1171 ts_tablet_manager.cc:1403] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.189s user 0.017s sys 0.021s
I20260617 07:53:24.844628 1171 raft_consensus.cc:359] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.844887 1171 raft_consensus.cc:385] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.844971 1171 raft_consensus.cc:740] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.845329 1171 consensus_queue.cc:260] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.846781 1171 ts_tablet_manager.cc:1434] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:24.847251 1171 tablet_bootstrap.cc:492] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.845955 1172 tablet_bootstrap.cc:654] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.847468 1170 log.cc:1199] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/9d94915d96694d6f9a86063640e5fe18
I20260617 07:53:24.848120 1170 ts_tablet_manager.cc:1950] T 9d94915d96694d6f9a86063640e5fe18 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:24.849260 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet b62ae096bfd347029ef8d7f0462dd111
I20260617 07:53:24.849836 1171 tablet_bootstrap.cc:654] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.853509 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 438) took 5587 ms. Trace:
I20260617 07:53:24.853654 1170 rpcz_store.cc:276] 0617 07:53:19.266373 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.266439 (+ 66us) service_pool.cc:224] Handling call
0617 07:53:24.793800 (+5527361us) ts_tablet_manager.cc:1151] Deleting tablet 9d94915d96694d6f9a86063640e5fe18
0617 07:53:24.793810 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.811674 (+ 17864us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.822440 (+ 10766us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.853490 (+ 31050us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5527150}
I20260617 07:53:24.854096 1862 ts_tablet_manager.cc:1929] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:24.854452 1862 log.cc:1199] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/c58bbdbf59c7426c8adbbbe3f0aafaed
I20260617 07:53:24.855156 1170 tablet_replica.cc:333] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:24.855400 1170 raft_consensus.cc:2243] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.855556 459 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 8cf4025a0f784cc6868950e51a45da2e (table default.Table_d36bea18179d4ba992d8795ee73dc19a [id=bf143b9baca647f0b25452d16dff2ae6]). Expected version 2 got 0
I20260617 07:53:24.816395 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]) successfully deleted
W20260617 07:53:24.856292 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 24ba13170e864dfa96cddfb1a76b8c40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24ba13170e864dfa96cddfb1a76b8c40 already in progress: creating tablet
W20260617 07:53:24.856477 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ea4c1033487a4dd2a73bd5148d5bb8f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea4c1033487a4dd2a73bd5148d5bb8f9 already in progress: creating tablet
W20260617 07:53:24.856627 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d06187aa09fd4776a992a07405a10876 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d06187aa09fd4776a992a07405a10876 already in progress: creating tablet
W20260617 07:53:24.856886 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 561c8bf9e5c840628ab1c8cf91dc2d93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 561c8bf9e5c840628ab1c8cf91dc2d93 already in progress: creating tablet
I20260617 07:53:24.857787 756 tablet_service.cc:1558] Processing DeleteTablet for tablet b62ae096bfd347029ef8d7f0462dd111 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:24.859786 1170 raft_consensus.cc:2272] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.860205 2856 tablet.cc:1724] T 233cae2480ed457bbab22ead8c0bde2c P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:24.860522 2803 raft_consensus.cc:493] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.860597 1170 ts_tablet_manager.cc:1916] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.860636 2803 raft_consensus.cc:515] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.861181 2803 leader_election.cc:290] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:24.862126 716 leader_election.cc:343] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 121339ab4842432e9fb7bc357750f8ad
I20260617 07:53:24.862515 756 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a35e3b7bb74667aa498c58a856cacc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:24.863037 713 leader_election.cc:343] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 121339ab4842432e9fb7bc357750f8ad
I20260617 07:53:24.863145 713 leader_election.cc:304] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.863564 2803 raft_consensus.cc:2749] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.865338 898 tablet_service.cc:1558] Processing DeleteTablet for tablet b62ae096bfd347029ef8d7f0462dd111 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.865396 1862 ts_tablet_manager.cc:1950] T c58bbdbf59c7426c8adbbbe3f0aafaed P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:24.865443 887 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a35e3b7bb74667aa498c58a856cacc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:24.865836 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7696e2ad0ad344399a63554bebb4c01b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.866572 1172 tablet_bootstrap.cc:492] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.866803 1172 ts_tablet_manager.cc:1403] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.004s
I20260617 07:53:24.867899 1172 raft_consensus.cc:359] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.868165 1172 raft_consensus.cc:385] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.868280 1172 raft_consensus.cc:740] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.868571 1172 consensus_queue.cc:260] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.868947 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 662) took 1222 ms. Trace:
I20260617 07:53:24.869484 1172 ts_tablet_manager.cc:1434] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:24.869856 1172 tablet_bootstrap.cc:492] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.869768 1862 rpcz_store.cc:276] 0617 07:53:23.646698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.647031 (+ 333us) service_pool.cc:224] Handling call
0617 07:53:24.375393 (+728362us) ts_tablet_manager.cc:1151] Deleting tablet c58bbdbf59c7426c8adbbbe3f0aafaed
0617 07:53:24.375403 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.758163 (+382760us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.854011 (+ 95848us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.868927 (+ 14916us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":728215}
I20260617 07:53:24.871038 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0e521eaa5cf042d4a77d12fe71871ae2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.871543 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e521eaa5cf042d4a77d12fe71871ae2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.872001 1172 tablet_bootstrap.cc:654] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.874495 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_688e63c9bbf3476c8925bd08ca801213" } new_table_name: "default.Table_6f43914efa774fb1b61d4f870c76bad8" modify_external_catalogs: true
I20260617 07:53:24.875759 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_dc7b3a260be0403aa988a9e09d73be9b" } new_table_name: "default.Table_a2fb3ae720774615a6f2baf5ad675502" modify_external_catalogs: true
I20260617 07:53:24.878824 1170 ts_tablet_manager.cc:1929] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.878978 453 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_0a3622a666594847848eb4982fd1316a [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 3 got 0
I20260617 07:53:24.880481 1170 log.cc:1199] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/e9f8492f127243eca07b2ffbabddded5
I20260617 07:53:24.880852 1170 ts_tablet_manager.cc:1950] T e9f8492f127243eca07b2ffbabddded5 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:24.884218 458 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 233cae2480ed457bbab22ead8c0bde2c (table default.Table_2d4fd391c62440b0baa36dd1c67778c6 [id=3735e299178a4fe2876f1a11535fa4f8]). Expected version 1 got 0
I20260617 07:53:24.886531 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1936829f95a944e1894b1d3e4021a5e0" } new_table_name: "default.Table_ce46042c0d43486bb5f801f023d331eb" modify_external_catalogs: true
I20260617 07:53:24.887148 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 439) took 5616 ms. Trace:
I20260617 07:53:24.888702 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 65bf5384ec244d36ba3d4e781c5eb8a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:24.888984 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 60d1b4975077493eb6919b23d6523d3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:18 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:24.875177 2774 consensus_queue.cc:1048] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:24.887706 1172 tablet_bootstrap.cc:492] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.889699 1172 ts_tablet_manager.cc:1403] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260617 07:53:24.889598 1170 rpcz_store.cc:276] 0617 07:53:19.270218 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.270282 (+ 64us) service_pool.cc:224] Handling call
0617 07:53:24.855105 (+5584823us) ts_tablet_manager.cc:1151] Deleting tablet e9f8492f127243eca07b2ffbabddded5
0617 07:53:24.855115 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.871094 (+ 15979us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.878768 (+ 7674us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.887124 (+ 8356us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5584628}
I20260617 07:53:24.890199 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 441) took 5553 ms. Trace:
I20260617 07:53:24.890309 1170 rpcz_store.cc:276] 0617 07:53:19.336885 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.338735 (+ 1850us) service_pool.cc:224] Handling call
0617 07:53:24.890067 (+5551332us) ts_tablet_manager.cc:1151] Deleting tablet 6cdcd3904a754939b9ae09cc3672bbc6
0617 07:53:24.890077 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.890181 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5551162}
I20260617 07:53:24.891207 1172 raft_consensus.cc:359] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.891450 1172 raft_consensus.cc:385] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.891561 1172 raft_consensus.cc:740] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.891573 1170 tablet_replica.cc:333] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:24.891875 1172 consensus_queue.cc:260] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.892045 1170 raft_consensus.cc:2243] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: Raft consensus shutting down.
I20260617 07:53:24.892367 1170 pending_rounds.cc:70] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
I20260617 07:53:24.892472 1170 pending_rounds.cc:77] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7297772767468650496 op_type: NO_OP noop_request { }
I20260617 07:53:24.892642 1170 raft_consensus.cc:2889] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:24.892800 1170 raft_consensus.cc:2272] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.893882 1172 ts_tablet_manager.cc:1434] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260617 07:53:24.894191 1172 tablet_bootstrap.cc:492] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.895998 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet b7d4fc81456445518c1158f912dd2f8f
I20260617 07:53:24.896260 1172 tablet_bootstrap.cc:654] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.897748 887 tablet_service.cc:1558] Processing DeleteTablet for tablet b7d4fc81456445518c1158f912dd2f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.899246 1171 tablet_bootstrap.cc:492] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:24.898347 1170 ts_tablet_manager.cc:1916] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.899996 748 tablet_service.cc:1558] Processing DeleteTablet for tablet b7d4fc81456445518c1158f912dd2f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:24.900298 1171 ts_tablet_manager.cc:1403] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.001s
I20260617 07:53:24.901160 1171 raft_consensus.cc:359] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.902207 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet c58bbdbf59c7426c8adbbbe3f0aafaed (table default.Table_f4b27f0c168e4788986ff63a8dbca936 [id=cd211da523fd4c43a9915b8f98dddae2]) successfully deleted
I20260617 07:53:24.905256 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_b65ffd246e534b13b1963ce42362edb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:24.905661 2803 raft_consensus.cc:493] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.905804 2803 raft_consensus.cc:515] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:24.905998 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b65ffd246e534b13b1963ce42362edb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.906387 2803 leader_election.cc:290] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.908814 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956eefc9ac3147bb857a448563c6fb6f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:24.908703 852 consensus_peers.cc:597] T a900aecf46e4430cb7ccdecd54376193 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:24.906903 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956eefc9ac3147bb857a448563c6fb6f" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:24.910091 716 leader_election.cc:304] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.910496 2803 raft_consensus.cc:2749] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.911003 1171 raft_consensus.cc:385] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.911175 1171 raft_consensus.cc:740] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.903035 1862 tablet_replica.cc:333] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:24.912935 1170 ts_tablet_manager.cc:1929] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.3
I20260617 07:53:24.913039 1170 log.cc:1199] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/63de833f7aa740b0b5bf2494b78aca5c
I20260617 07:53:24.913388 1170 ts_tablet_manager.cc:1950] T 63de833f7aa740b0b5bf2494b78aca5c P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:24.914052 1862 raft_consensus.cc:2243] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.914846 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 047da1717bf545a9b3a23a9d9136f66f
I20260617 07:53:24.917546 1172 tablet_bootstrap.cc:492] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.917697 1172 ts_tablet_manager.cc:1403] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.002s
I20260617 07:53:24.919042 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 047da1717bf545a9b3a23a9d9136f66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:24.916241 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 047da1717bf545a9b3a23a9d9136f66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.919320 1862 raft_consensus.cc:2272] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.919898 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1c2e353824df416c8aa1877db624a6fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:24.920495 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c2e353824df416c8aa1877db624a6fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.920845 2803 raft_consensus.cc:493] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.920956 2803 raft_consensus.cc:515] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.921582 2803 leader_election.cc:290] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.921695 1172 raft_consensus.cc:359] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.921927 1172 raft_consensus.cc:385] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.921998 1172 raft_consensus.cc:740] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.922204 1172 consensus_queue.cc:260] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.910493 1178 tablet_bootstrap.cc:492] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:24.921830 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 442) took 5580 ms. Trace:
I20260617 07:53:24.922578 1178 ts_tablet_manager.cc:1403] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.162s user 0.011s sys 0.010s
I20260617 07:53:24.922878 1172 ts_tablet_manager.cc:1434] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260617 07:53:24.922457 1170 rpcz_store.cc:276] 0617 07:53:19.340943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.341005 (+ 62us) service_pool.cc:224] Handling call
0617 07:53:24.891522 (+5550517us) ts_tablet_manager.cc:1151] Deleting tablet 63de833f7aa740b0b5bf2494b78aca5c
0617 07:53:24.891535 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.909089 (+ 17554us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.912884 (+ 3795us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.921812 (+ 8928us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5550323}
I20260617 07:53:24.923077 1170 tablet_replica.cc:333] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:24.923146 1172 tablet_bootstrap.cc:492] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.923272 1170 raft_consensus.cc:2243] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:24.923409 1170 raft_consensus.cc:2272] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.923794 1178 raft_consensus.cc:359] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.924003 1178 raft_consensus.cc:385] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.924103 1178 raft_consensus.cc:740] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.924381 1178 consensus_queue.cc:260] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.923982 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2777cf575a914f59b3459f3ce96f5d9a" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:24.924908 1178 ts_tablet_manager.cc:1434] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:24.924885 1172 tablet_bootstrap.cc:654] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.921764 2775 raft_consensus.cc:493] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.926307 2775 raft_consensus.cc:515] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.927035 2775 leader_election.cc:290] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.922333 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2777cf575a914f59b3459f3ce96f5d9a" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:24.922794 2774 raft_consensus.cc:493] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.927450 2774 raft_consensus.cc:515] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.927680 716 leader_election.cc:304] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.927979 2774 leader_election.cc:290] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:24.928814 851 leader_election.cc:343] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 9618a5c0c9dd4c368f5763c434f70da5
I20260617 07:53:24.929029 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d4fc81456445518c1158f912dd2f8f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:24.929258 1051 raft_consensus.cc:2468] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:24.929589 851 leader_election.cc:304] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:24.929848 2774 raft_consensus.cc:2804] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:24.929920 2774 raft_consensus.cc:493] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:24.929984 2774 raft_consensus.cc:3060] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:24.930472 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9618a5c0c9dd4c368f5763c434f70da5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:24.931084 852 leader_election.cc:343] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.931195 852 leader_election.cc:304] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:24.931684 2775 raft_consensus.cc:2749] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:24.932353 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d4fc81456445518c1158f912dd2f8f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:24.933017 2774 raft_consensus.cc:515] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:24.933131 852 leader_election.cc:343] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.933650 2629 raft_consensus.cc:493] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:24.933812 2629 raft_consensus.cc:515] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.934281 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d4fc81456445518c1158f912dd2f8f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:24.934392 2629 leader_election.cc:290] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545)
I20260617 07:53:24.934422 1046 raft_consensus.cc:3060] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:24.935261 988 leader_election.cc:343] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: b4c9a032007a412e95bbd2b229edd50b
I20260617 07:53:24.936465 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d4fc81456445518c1158f912dd2f8f" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:24.937093 852 leader_election.cc:343] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:24.938138 1046 raft_consensus.cc:2468] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:24.938632 851 leader_election.cc:304] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:24.938882 2775 raft_consensus.cc:2804] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:24.938977 2774 leader_election.cc:290] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.939040 2775 raft_consensus.cc:697] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:24.939276 2775 consensus_queue.cc:237] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.924885 1170 ts_tablet_manager.cc:1916] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:24.946806 445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:36497, user_credentials={real_user=slave}} blocked reactor thread for 187062us
W20260617 07:53:24.954568 852 consensus_peers.cc:597] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:24.957623 1170 ts_tablet_manager.cc:1929] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.957767 1170 log.cc:1199] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/cc1d9ce2ab5b428893719d9acd272d88
I20260617 07:53:24.958091 1170 ts_tablet_manager.cc:1950] T cc1d9ce2ab5b428893719d9acd272d88 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:24.958804 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 440) took 5622 ms. Trace:
I20260617 07:53:24.958879 1170 rpcz_store.cc:276] 0617 07:53:19.336745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.354896 (+ 18151us) service_pool.cc:224] Handling call
0617 07:53:24.923032 (+5568136us) ts_tablet_manager.cc:1151] Deleting tablet cc1d9ce2ab5b428893719d9acd272d88
0617 07:53:24.923042 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.953764 (+ 30722us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.957570 (+ 3806us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.958784 (+ 1214us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5567961}
I20260617 07:53:24.959261 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 443) took 5537 ms. Trace:
I20260617 07:53:24.959321 1170 rpcz_store.cc:276] 0617 07:53:19.421913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.433230 (+ 11317us) service_pool.cc:224] Handling call
0617 07:53:24.959139 (+5525909us) ts_tablet_manager.cc:1151] Deleting tablet eafcf54494f244f1b978b4b5e39d93bd
0617 07:53:24.959148 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.959248 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5525681}
I20260617 07:53:24.960486 1172 tablet_bootstrap.cc:492] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:24.960630 1172 ts_tablet_manager.cc:1403] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.009s
I20260617 07:53:24.961282 2729 raft_consensus.cc:493] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:24.961404 2729 raft_consensus.cc:515] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:24.961443 1172 raft_consensus.cc:359] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.961597 1172 raft_consensus.cc:385] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:24.961642 1172 raft_consensus.cc:740] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:24.961858 1172 consensus_queue.cc:260] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.962002 2729 leader_election.cc:290] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:24.962113 2729 raft_consensus.cc:493] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:24.962211 2729 raft_consensus.cc:515] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.962316 1172 ts_tablet_manager.cc:1434] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:24.962672 2729 leader_election.cc:290] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:24.962885 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 449) took 5397 ms. Trace:
I20260617 07:53:24.963037 1172 tablet_bootstrap.cc:492] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:24.962960 1170 rpcz_store.cc:276] 0617 07:53:19.565895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.566502 (+ 607us) service_pool.cc:224] Handling call
0617 07:53:24.959512 (+5393010us) ts_tablet_manager.cc:1151] Deleting tablet a90472b619d644b7b01f5104872ecb64
0617 07:53:24.959519 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.962866 (+ 3347us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5392835}
I20260617 07:53:24.963294 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 459) took 5374 ms. Trace:
I20260617 07:53:24.963358 1170 rpcz_store.cc:276] 0617 07:53:19.589313 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.592741 (+ 3428us) service_pool.cc:224] Handling call
0617 07:53:24.963177 (+5370436us) ts_tablet_manager.cc:1151] Deleting tablet 4f95a13b909c4ef9be6c56a317b42c9b
0617 07:53:24.963186 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.963278 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5367275}
I20260617 07:53:24.963721 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 457) took 5374 ms. Trace:
I20260617 07:53:24.961002 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3b2792fc15244bbf828a27c4156aca04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:24.963812 1170 rpcz_store.cc:276] 0617 07:53:19.588839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.588880 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:24.963609 (+5374729us) ts_tablet_manager.cc:1151] Deleting tablet c449d3e251aa4f06a9191114bff0e0e2
0617 07:53:24.963618 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.963700 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5367361}
I20260617 07:53:24.964169 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 467) took 5313 ms. Trace:
W20260617 07:53:24.964249 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b2792fc15244bbf828a27c4156aca04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:24.964255 1170 rpcz_store.cc:276] 0617 07:53:19.650997 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.658471 (+ 7474us) service_pool.cc:224] Handling call
0617 07:53:24.964067 (+5305596us) ts_tablet_manager.cc:1151] Deleting tablet 17c8a945eca643f3b3f4807406e9a24e
0617 07:53:24.964075 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.964154 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5305440}
I20260617 07:53:24.964558 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 468) took 5293 ms. Trace:
I20260617 07:53:24.964622 1170 rpcz_store.cc:276] 0617 07:53:19.670969 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.673787 (+ 2818us) service_pool.cc:224] Handling call
0617 07:53:24.964466 (+5290679us) ts_tablet_manager.cc:1151] Deleting tablet 37b36c91191445478055b78830be9450
0617 07:53:24.964474 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.964544 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5290489}
I20260617 07:53:24.964850 1172 tablet_bootstrap.cc:654] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:24.964903 1170 tablet_replica.cc:333] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:24.965106 1170 raft_consensus.cc:2243] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: Raft consensus shutting down.
I20260617 07:53:24.965384 1170 pending_rounds.cc:70] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Trying to abort 1 pending ops.
W20260617 07:53:24.965420 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 1f6264adc3994c22864ea73106ba2320 because the tablet was not found. No further retry: Not found: Tablet not found: 1f6264adc3994c22864ea73106ba2320
I20260617 07:53:24.965440 1170 pending_rounds.cc:77] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7297772767628120064 op_type: NO_OP noop_request { }
I20260617 07:53:24.965516 1170 raft_consensus.cc:2889] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:24.965590 1170 raft_consensus.cc:2272] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:24.965608 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 630e540a77374c11895ab5a0e394b3bb (table default.Table_09ed725f843f4ae09d3c74af68112a46 [id=5000dc26300c4d94a567bd56e0d8599c]) successfully deleted
I20260617 07:53:24.965826 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 9d94915d96694d6f9a86063640e5fe18 (table default.Table_9cc33f29bdc74258b288fd41c7366da4 [id=885235c3332d4c4c9f62503732d3a38e]) successfully deleted
I20260617 07:53:24.965972 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet e9f8492f127243eca07b2ffbabddded5 (table default.Table_77163a83bea3432b8b2ea745bef42ce8 [id=2cd57d521b8b4434b456c086f0e36de8]) successfully deleted
W20260617 07:53:24.966126 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 6cdcd3904a754939b9ae09cc3672bbc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cdcd3904a754939b9ae09cc3672bbc6 already in progress: creating tablet
I20260617 07:53:24.966269 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 63de833f7aa740b0b5bf2494b78aca5c (table default.Table_c6fedca194ec4749b5cf314ab4952408 [id=32680a1bed374ba18c213d1bf46ce772]) successfully deleted
W20260617 07:53:24.966303 988 leader_election.cc:343] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 69f5b567da0e4baab53c00c55923e920
I20260617 07:53:24.966401 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet cc1d9ce2ab5b428893719d9acd272d88 (table default.Table_74d1e24e8c594e52b77ec38499225bc1 [id=912e818e8697427a8ce7dc146b9a428f]) successfully deleted
W20260617 07:53:24.966547 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet eafcf54494f244f1b978b4b5e39d93bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eafcf54494f244f1b978b4b5e39d93bd already in progress: creating tablet
I20260617 07:53:24.966521 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba13170e864dfa96cddfb1a76b8c40" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:24.966866 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a90472b619d644b7b01f5104872ecb64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a90472b619d644b7b01f5104872ecb64 already in progress: creating tablet
W20260617 07:53:24.967078 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c449d3e251aa4f06a9191114bff0e0e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c449d3e251aa4f06a9191114bff0e0e2 already in progress: creating tablet
W20260617 07:53:24.967203 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 17c8a945eca643f3b3f4807406e9a24e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17c8a945eca643f3b3f4807406e9a24e already in progress: creating tablet
W20260617 07:53:24.967324 988 leader_election.cc:343] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:24.967367 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 37b36c91191445478055b78830be9450 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37b36c91191445478055b78830be9450 already in progress: creating tablet
I20260617 07:53:24.969152 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 56e089af99464471b4d5482c3364d20f with delete_type TABLET_DATA_DELETED (replaced by tablet d95a7e6fda324402a7a59a335f876c08) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.969337 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet b62ae096bfd347029ef8d7f0462dd111 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.969455 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a35e3b7bb74667aa498c58a856cacc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.969571 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet b7d4fc81456445518c1158f912dd2f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.969681 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 047da1717bf545a9b3a23a9d9136f66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:24 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.969828 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db4fdde370e4d30bbf14285923644a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:24.970669 1170 ts_tablet_manager.cc:1916] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:24.971197 1846 ts_tablet_manager.cc:1929] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:24.971305 1846 log.cc:1199] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a2f21861cb6f481eae968edc733e6e6f
I20260617 07:53:24.971220 2710 consensus_queue.cc:1048] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:24.971587 1846 ts_tablet_manager.cc:1950] T a2f21861cb6f481eae968edc733e6e6f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:24.972327 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 694) took 4186 ms. Trace:
I20260617 07:53:24.972414 1846 rpcz_store.cc:276] 0617 07:53:20.785604 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.790996 (+ 5392us) service_pool.cc:224] Handling call
0617 07:53:24.830160 (+4039164us) ts_tablet_manager.cc:1151] Deleting tablet a2f21861cb6f481eae968edc733e6e6f
0617 07:53:24.830170 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.908219 (+ 78049us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.971135 (+ 62916us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:24.972306 (+ 1171us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4038768}
I20260617 07:53:24.972832 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a2f21861cb6f481eae968edc733e6e6f (table default.Table_35ca50ee926746e499128390bf83c078 [id=12d27e43b2da42f7b55dbf5c9f4b103f]) successfully deleted
I20260617 07:53:24.973223 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 705) took 3913 ms. Trace:
I20260617 07:53:24.973354 1846 rpcz_store.cc:276] 0617 07:53:21.059877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.059941 (+ 64us) service_pool.cc:224] Handling call
0617 07:53:24.973103 (+3913162us) ts_tablet_manager.cc:1151] Deleting tablet 843c2afd54ee451a948cc8b92c556a31
0617 07:53:24.973115 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.973204 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3912977}
W20260617 07:53:24.973852 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 843c2afd54ee451a948cc8b92c556a31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 843c2afd54ee451a948cc8b92c556a31 already in progress: creating tablet
I20260617 07:53:24.974370 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 706) took 3908 ms. Trace:
I20260617 07:53:24.982311 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 037539021d1743bb9a66403b8a01662f
I20260617 07:53:24.982770 457 catalog_manager.cc:6784] ReplaceTablet: tablet 037539021d1743bb9a66403b8a01662f deleted and replaced by tablet 96479936187446439b68db81835801ba
I20260617 07:53:24.983515 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 037539021d1743bb9a66403b8a01662f with delete_type TABLET_DATA_DELETED (replaced by tablet 96479936187446439b68db81835801ba) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:24.920626 1171 consensus_queue.cc:260] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:24.987021 1171 ts_tablet_manager.cc:1434] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.086s user 0.001s sys 0.000s
I20260617 07:53:24.987612 1171 tablet_bootstrap.cc:492] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:24.988683 1862 ts_tablet_manager.cc:1916] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.003328 1170 ts_tablet_manager.cc:1929] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.3
I20260617 07:53:25.007867 1170 log.cc:1199] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5ec425bb523a449d9fe16d3ea3a0d7ae
I20260617 07:53:25.008428 1170 ts_tablet_manager.cc:1950] T 5ec425bb523a449d9fe16d3ea3a0d7ae P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.010669 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 470) took 5283 ms. Trace:
I20260617 07:53:25.010825 1170 rpcz_store.cc:276] 0617 07:53:19.727568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.752475 (+ 24907us) service_pool.cc:224] Handling call
0617 07:53:24.964860 (+5212385us) ts_tablet_manager.cc:1151] Deleting tablet 5ec425bb523a449d9fe16d3ea3a0d7ae
0617 07:53:24.964869 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.975710 (+ 10841us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.003241 (+ 27531us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.010635 (+ 7394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5212194}
I20260617 07:53:25.014173 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 469) took 5312 ms. Trace:
I20260617 07:53:25.014364 1170 rpcz_store.cc:276] 0617 07:53:19.701765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.752706 (+ 50941us) service_pool.cc:224] Handling call
0617 07:53:25.013998 (+5261292us) ts_tablet_manager.cc:1151] Deleting tablet 61510f9812e849e388c6c163e9af5f4f
0617 07:53:25.014014 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.014150 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5261176}
I20260617 07:53:25.015141 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 489) took 5178 ms. Trace:
I20260617 07:53:25.015311 1170 rpcz_store.cc:276] 0617 07:53:19.836498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.841964 (+ 5466us) service_pool.cc:224] Handling call
0617 07:53:25.014926 (+5172962us) ts_tablet_manager.cc:1151] Deleting tablet 67cd66ea6ebc42bda00fbec82da73f16
0617 07:53:25.014939 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.015119 (+ 180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5172701}
I20260617 07:53:25.015846 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 490) took 5152 ms. Trace:
I20260617 07:53:25.015966 1170 rpcz_store.cc:276] 0617 07:53:19.862932 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.863012 (+ 80us) service_pool.cc:224] Handling call
0617 07:53:25.015763 (+5152751us) ts_tablet_manager.cc:1151] Deleting tablet f34a2ee6fa82482db979ab25bc284f8e
0617 07:53:25.015771 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.015834 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5152583}
I20260617 07:53:25.016281 2710 raft_consensus.cc:493] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.016435 2710 raft_consensus.cc:515] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.016911 1170 tablet_replica.cc:333] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.017105 1170 raft_consensus.cc:2243] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.017251 2710 leader_election.cc:290] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.017269 1170 raft_consensus.cc:2272] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.021051 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de5420edefc47ed9dcdf1eea02a22fa" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.021308 1046 raft_consensus.cc:2468] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:25.022081 851 leader_election.cc:304] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:25.022132 1170 ts_tablet_manager.cc:1916] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.022468 2710 raft_consensus.cc:2804] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:25.022560 2710 raft_consensus.cc:493] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:25.022644 2710 raft_consensus.cc:3060] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.024756 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 037539021d1743bb9a66403b8a01662f with delete_type TABLET_DATA_DELETED (replaced by tablet 96479936187446439b68db81835801ba) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.025084 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 5ec425bb523a449d9fe16d3ea3a0d7ae (table default.Table_92a996a9fa604b7ca46cf37cc9688973 [id=75e0087891a14cac9688f76ee43c157d]) successfully deleted
I20260617 07:53:25.025226 2774 consensus_queue.cc:1048] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:25.025293 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 61510f9812e849e388c6c163e9af5f4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61510f9812e849e388c6c163e9af5f4f already in progress: creating tablet
W20260617 07:53:25.025444 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 67cd66ea6ebc42bda00fbec82da73f16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67cd66ea6ebc42bda00fbec82da73f16 already in progress: creating tablet
W20260617 07:53:25.025573 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet f34a2ee6fa82482db979ab25bc284f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f34a2ee6fa82482db979ab25bc284f8e already in progress: creating tablet
I20260617 07:53:25.025741 1846 rpcz_store.cc:276] 0617 07:53:21.065647 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.065703 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:24.974242 (+3908539us) ts_tablet_manager.cc:1151] Deleting tablet e9bed1de333b4944a9a72ae26a9f8542
0617 07:53:24.974255 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:24.974354 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3908342}
I20260617 07:53:25.026474 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 707) took 3948 ms. Trace:
I20260617 07:53:25.026614 1846 rpcz_store.cc:276] 0617 07:53:21.077825 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.077876 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:25.026350 (+3948474us) ts_tablet_manager.cc:1151] Deleting tablet e793cbccf5774e95a8316d6298d4646f
0617 07:53:25.026362 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.026458 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3948279}
W20260617 07:53:25.026883 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e9bed1de333b4944a9a72ae26a9f8542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9bed1de333b4944a9a72ae26a9f8542 already in progress: creating tablet
I20260617 07:53:25.027532 1846 tablet_replica.cc:333] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:25.027700 1846 raft_consensus.cc:2243] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.027755 1172 tablet_bootstrap.cc:492] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.027872 1172 ts_tablet_manager.cc:1403] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.065s user 0.012s sys 0.007s
W20260617 07:53:25.027864 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e793cbccf5774e95a8316d6298d4646f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e793cbccf5774e95a8316d6298d4646f already in progress: creating tablet
I20260617 07:53:25.027890 1846 raft_consensus.cc:2272] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.028468 1846 ts_tablet_manager.cc:1916] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.028520 1172 raft_consensus.cc:359] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.028671 1172 raft_consensus.cc:385] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.028728 1172 raft_consensus.cc:740] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.028963 1172 consensus_queue.cc:260] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.026010 2710 raft_consensus.cc:515] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.029536 1172 ts_tablet_manager.cc:1434] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:25.029810 1172 tablet_bootstrap.cc:492] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.030282 2710 leader_election.cc:290] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.030653 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de5420edefc47ed9dcdf1eea02a22fa" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:25.030814 1047 raft_consensus.cc:3060] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.031805 1172 tablet_bootstrap.cc:654] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.008013 2803 raft_consensus.cc:2749] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.008183 1178 tablet_bootstrap.cc:492] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:25.032385 2803 raft_consensus.cc:493] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.032485 2803 raft_consensus.cc:515] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.033000 2803 leader_election.cc:290] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:24.988837 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 037539021d1743bb9a66403b8a01662f with delete_type TABLET_DATA_DELETED (replaced by tablet 96479936187446439b68db81835801ba) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.030642 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de5420edefc47ed9dcdf1eea02a22fa" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:25.033584 852 leader_election.cc:343] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.033665 1178 tablet_bootstrap.cc:654] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.032207 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de5420edefc47ed9dcdf1eea02a22fa" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.033968 713 leader_election.cc:343] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 60d1b4975077493eb6919b23d6523d3d
W20260617 07:53:25.034297 852 leader_election.cc:343] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.033663 1047 raft_consensus.cc:2468] T 7de5420edefc47ed9dcdf1eea02a22fa P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:25.034826 851 leader_election.cc:304] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.035151 2774 raft_consensus.cc:2804] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:25.035245 2774 raft_consensus.cc:697] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:25.035439 2774 consensus_queue.cc:237] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.042886 1172 tablet_bootstrap.cc:492] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.043018 1172 ts_tablet_manager.cc:1403] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260617 07:53:25.043702 1172 raft_consensus.cc:359] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.043882 1172 raft_consensus.cc:385] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.043951 1172 raft_consensus.cc:740] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.044200 1172 consensus_queue.cc:260] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.044734 1172 ts_tablet_manager.cc:1434] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:25.044982 1172 tablet_bootstrap.cc:492] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.046710 1172 tablet_bootstrap.cc:654] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.048919 1171 tablet_bootstrap.cc:654] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.058655 1170 ts_tablet_manager.cc:1929] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.058801 2774 raft_consensus.cc:493] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.058985 2774 raft_consensus.cc:515] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.060781 2774 leader_election.cc:290] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.065124 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e700810cd024dacbadd9ab109d0d87c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.065608 1170 log.cc:1199] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/05de71ea02df48ffacb369caa7f7d3de
W20260617 07:53:25.065689 852 leader_election.cc:343] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.061848 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e700810cd024dacbadd9ab109d0d87c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.065963 1051 raft_consensus.cc:2468] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:25.066335 851 leader_election.cc:304] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.066704 1172 tablet_bootstrap.cc:492] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.066704 2709 raft_consensus.cc:2804] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:25.066776 2709 raft_consensus.cc:493] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:25.066826 1172 ts_tablet_manager.cc:1403] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.004s
I20260617 07:53:25.066836 2709 raft_consensus.cc:3060] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.067517 1172 raft_consensus.cc:359] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.067649 1172 raft_consensus.cc:385] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.067693 1172 raft_consensus.cc:740] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.067863 1172 consensus_queue.cc:260] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.068295 1172 ts_tablet_manager.cc:1434] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 07:53:25.068552 1172 tablet_bootstrap.cc:492] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.069444 2709 raft_consensus.cc:515] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.070125 1172 tablet_bootstrap.cc:654] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.070604 2709 leader_election.cc:290] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:25.070413 716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 142746us
I20260617 07:53:25.071087 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e700810cd024dacbadd9ab109d0d87c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:25.073208 1170 ts_tablet_manager.cc:1950] T 05de71ea02df48ffacb369caa7f7d3de P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:25.073302 852 leader_election.cc:343] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.073593 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e700810cd024dacbadd9ab109d0d87c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:25.073820 1046 raft_consensus.cc:3060] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.073982 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 491) took 5210 ms. Trace:
I20260617 07:53:25.074103 1170 rpcz_store.cc:276] 0617 07:53:19.863080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:19.863214 (+ 134us) service_pool.cc:224] Handling call
0617 07:53:25.016868 (+5153654us) ts_tablet_manager.cc:1151] Deleting tablet 05de71ea02df48ffacb369caa7f7d3de
0617 07:53:25.016877 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.029971 (+ 13094us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.058595 (+ 28624us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.073965 (+ 15370us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5153536}
I20260617 07:53:25.074571 1170 tablet_replica.cc:333] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.074877 1170 raft_consensus.cc:2243] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.075773 1170 raft_consensus.cc:2272] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.076016 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 05de71ea02df48ffacb369caa7f7d3de (table default.Table_2f40c198682e49768bee2d6a87292d46 [id=c8eaf721ce2242fdac07849a8ec26e58]) successfully deleted
I20260617 07:53:25.076464 1170 ts_tablet_manager.cc:1916] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.076910 1046 raft_consensus.cc:2468] T 4e700810cd024dacbadd9ab109d0d87c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:25.077373 851 leader_election.cc:304] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.079859 2775 raft_consensus.cc:2804] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:25.080104 2775 raft_consensus.cc:697] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:25.080750 2775 consensus_queue.cc:237] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.082419 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c9a032007a412e95bbd2b229edd50b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.082954 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_d3613cd799784e968908338ef2f15b3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.083597 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3613cd799784e968908338ef2f15b3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.083562 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_42699429d869420995a9231757782531" } modify_external_catalogs: true
I20260617 07:53:25.083746 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_42699429d869420995a9231757782531" } modify_external_catalogs: true
I20260617 07:53:25.087209 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba13170e864dfa96cddfb1a76b8c40" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.087908 1172 tablet_bootstrap.cc:492] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.088037 1172 ts_tablet_manager.cc:1403] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
W20260617 07:53:25.088181 986 leader_election.cc:343] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:25.088300 986 leader_election.cc:304] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:25.088670 986 leader_election.cc:343] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Not found: Tablet not found: 69f5b567da0e4baab53c00c55923e920
I20260617 07:53:25.088770 986 leader_election.cc:304] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.088802 1172 raft_consensus.cc:359] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.088944 1172 raft_consensus.cc:385] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.089000 2729 raft_consensus.cc:2749] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:25.089012 1172 raft_consensus.cc:740] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
W20260617 07:53:25.089138 986 leader_election.cc:343] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.089174 2729 raft_consensus.cc:2749] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:25.089214 986 leader_election.cc:304] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.089298 1172 consensus_queue.cc:260] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.089422 2729 raft_consensus.cc:2749] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:25.088723 716 leader_election.cc:343] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 60d1b4975077493eb6919b23d6523d3d
I20260617 07:53:25.089758 716 leader_election.cc:304] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:25.089807 1172 ts_tablet_manager.cc:1434] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:25.090055 1172 tablet_bootstrap.cc:492] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.091462 2861 raft_consensus.cc:2749] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.091704 1172 tablet_bootstrap.cc:654] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.092973 1170 ts_tablet_manager.cc:1929] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.093114 1170 log.cc:1199] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a1e064b5bc93442f83aeffa88861d818
I20260617 07:53:25.093453 1170 ts_tablet_manager.cc:1950] T a1e064b5bc93442f83aeffa88861d818 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.094175 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 492) took 4946 ms. Trace:
I20260617 07:53:25.095317 1170 rpcz_store.cc:276] 0617 07:53:20.147598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.149405 (+ 1807us) service_pool.cc:224] Handling call
0617 07:53:25.074532 (+4925127us) ts_tablet_manager.cc:1151] Deleting tablet a1e064b5bc93442f83aeffa88861d818
0617 07:53:25.074541 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.079336 (+ 4795us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.092921 (+ 13585us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.094159 (+ 1238us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4924958}
I20260617 07:53:25.095880 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a1e064b5bc93442f83aeffa88861d818 (table default.Table_2e4311968bfb4956bb02a8626f5d767f [id=965c116ab3dc4e32ad0febae905610e4]) successfully deleted
I20260617 07:53:25.096249 1170 tablet_replica.cc:333] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.096457 1170 raft_consensus.cc:2243] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.096828 1170 raft_consensus.cc:2272] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.097443 1170 ts_tablet_manager.cc:1916] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.099496 2629 raft_consensus.cc:493] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.099653 2629 raft_consensus.cc:515] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.100201 2629 leader_election.cc:290] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.100728 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b111e65c497591c7daaa81d783c7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:25.101251 988 leader_election.cc:343] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.104354 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b111e65c497591c7daaa81d783c7" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.104892 986 leader_election.cc:343] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.105002 986 leader_election.cc:304] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.105310 2629 raft_consensus.cc:2749] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.109035 1172 tablet_bootstrap.cc:492] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.109176 1172 ts_tablet_manager.cc:1403] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20260617 07:53:25.109239 1178 tablet_bootstrap.cc:492] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:25.109400 1178 ts_tablet_manager.cc:1403] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.101s user 0.004s sys 0.004s
I20260617 07:53:25.109951 1172 raft_consensus.cc:359] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.110106 1172 raft_consensus.cc:385] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.110219 1178 raft_consensus.cc:359] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.110349 1172 raft_consensus.cc:740] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.110461 1178 raft_consensus.cc:385] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.110566 1178 raft_consensus.cc:740] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.110546 1172 consensus_queue.cc:260] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.111775 1172 ts_tablet_manager.cc:1434] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:25.112610 1172 tablet_bootstrap.cc:492] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.113373 1171 tablet_bootstrap.cc:492] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.113484 1171 ts_tablet_manager.cc:1403] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.126s user 0.002s sys 0.002s
I20260617 07:53:25.113871 1178 consensus_queue.cc:260] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.114137 1172 tablet_bootstrap.cc:654] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.114476 1178 ts_tablet_manager.cc:1434] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 07:53:25.114764 1178 tablet_bootstrap.cc:492] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:25.116250 1178 tablet_bootstrap.cc:654] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.117666 1171 raft_consensus.cc:359] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.117874 1171 raft_consensus.cc:385] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.117935 1171 raft_consensus.cc:740] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.118129 1171 consensus_queue.cc:260] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.118880 1171 ts_tablet_manager.cc:1434] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:25.119154 1171 tablet_bootstrap.cc:492] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:25.120100 1862 ts_tablet_manager.cc:1929] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.120188 1862 log.cc:1199] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/6d8f144d04af4ea18f99aee3b82f4a28
I20260617 07:53:25.120461 1862 ts_tablet_manager.cc:1950] T 6d8f144d04af4ea18f99aee3b82f4a28 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:25.122681 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a61124fa6f846a6be1a208f2eaa7c20 consensus state has no leader
I20260617 07:53:25.124326 1170 ts_tablet_manager.cc:1929] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260617 07:53:25.124367 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75149090e9ab4eed93bd635cde173000 consensus state has no leader
I20260617 07:53:25.124514 1170 log.cc:1199] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/7ca402543247461aa5384abb65fff364
I20260617 07:53:25.125329 1170 ts_tablet_manager.cc:1950] T 7ca402543247461aa5384abb65fff364 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:25.126147 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 018a118f883e4005b139897e485d00b3 consensus state has no leader
I20260617 07:53:25.127384 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 493) took 4907 ms. Trace:
I20260617 07:53:25.130292 1170 rpcz_store.cc:276] 0617 07:53:20.220060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.221774 (+ 1714us) service_pool.cc:224] Handling call
0617 07:53:25.096205 (+4874431us) ts_tablet_manager.cc:1151] Deleting tablet 7ca402543247461aa5384abb65fff364
0617 07:53:25.096214 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.103635 (+ 7421us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.124274 (+ 20639us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.127367 (+ 3093us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4874236}
I20260617 07:53:25.131099 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 7ca402543247461aa5384abb65fff364 (table default.Table_5062aff937d2497d8947cb2c4f1c87bb [id=9b001f577b6e4c95a448d6892bc6d87a]) successfully deleted
I20260617 07:53:25.131269 1170 tablet_replica.cc:333] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.131490 1170 raft_consensus.cc:2243] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.131695 1170 raft_consensus.cc:2272] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.132359 1170 ts_tablet_manager.cc:1916] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:25.134148 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 69946.1us
I20260617 07:53:25.134775 1172 tablet_bootstrap.cc:492] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.134896 1172 ts_tablet_manager.cc:1403] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.001s
I20260617 07:53:25.135675 1172 raft_consensus.cc:359] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.135831 1172 raft_consensus.cc:385] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.135895 1172 raft_consensus.cc:740] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.136070 1172 consensus_queue.cc:260] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.136513 1172 ts_tablet_manager.cc:1434] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:25.136766 1172 tablet_bootstrap.cc:492] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.136929 452 master_service.cc:960] ReplaceTablet: received request to replace tablet c6b85e7ed0a64c128de5cc48c4d4435f from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:25.138196 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 663) took 1491 ms. Trace:
I20260617 07:53:25.139019 1172 tablet_bootstrap.cc:654] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.140431 779 raft_consensus.cc:3060] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.141074 2861 raft_consensus.cc:493] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.141245 2861 raft_consensus.cc:515] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.141763 1862 rpcz_store.cc:276] 0617 07:53:23.646834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.647210 (+ 376us) service_pool.cc:224] Handling call
0617 07:53:24.902985 (+1255775us) ts_tablet_manager.cc:1151] Deleting tablet 6d8f144d04af4ea18f99aee3b82f4a28
0617 07:53:24.902995 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.015683 (+112688us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.120045 (+104362us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.138174 (+ 18129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1255648}
I20260617 07:53:25.142213 461 master_service.cc:960] ReplaceTablet: received request to replace tablet 17c8a945eca643f3b3f4807406e9a24e from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:25.142254 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 6d8f144d04af4ea18f99aee3b82f4a28 (table default.Table_119ecdf0aa5343da9cee836dd150a21a [id=ec04f28d4a6e4fa18078aacb6b6f0bb8]) successfully deleted
I20260617 07:53:25.142283 1862 tablet_replica.cc:333] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.142452 1862 raft_consensus.cc:2243] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.142612 2861 leader_election.cc:290] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.142982 1862 raft_consensus.cc:2272] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.143522 1862 ts_tablet_manager.cc:1916] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:25.144533 713 leader_election.cc:343] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: f15dcc10552d4747bad436538662bb66
W20260617 07:53:25.145059 716 leader_election.cc:343] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: f15dcc10552d4747bad436538662bb66
I20260617 07:53:25.145226 716 leader_election.cc:304] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:25.145685 2861 raft_consensus.cc:2749] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.149920 1171 tablet_bootstrap.cc:654] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.150295 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e2fdbe909a5540ef9bdfd194cfda30d1" } new_table_name: "default.Table_d1830d0b4ae94729a8fbaa13068536d8" modify_external_catalogs: true
I20260617 07:53:25.151755 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ecf79d16ff9b4ab3839a33f052ed19fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.152298 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecf79d16ff9b4ab3839a33f052ed19fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.153283 1170 ts_tablet_manager.cc:1929] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:25.153375 1170 log.cc:1199] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/69f5b567da0e4baab53c00c55923e920
I20260617 07:53:25.153568 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_96bbd20483414a0fb8cd5558573b1567"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.154136 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96bbd20483414a0fb8cd5558573b1567 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.157011 1170 ts_tablet_manager.cc:1950] T 69f5b567da0e4baab53c00c55923e920 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.159199 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9815ff9400a3426e8f09edd618831938" } new_table_name: "default.Table_9b6c04843afa4dea84e4ac76ab7cc48b" modify_external_catalogs: true
I20260617 07:53:25.162469 1172 tablet_bootstrap.cc:492] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.163404 2803 raft_consensus.cc:493] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.163575 2803 raft_consensus.cc:515] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.164216 2803 leader_election.cc:290] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.165609 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 4de8df5e15cb43c0b95ec5af3110db66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.170302 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 502) took 4719 ms. Trace:
I20260617 07:53:25.170379 1170 rpcz_store.cc:276] 0617 07:53:20.451331 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.451385 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:25.131214 (+4679829us) ts_tablet_manager.cc:1151] Deleting tablet 69f5b567da0e4baab53c00c55923e920
0617 07:53:25.131226 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.150418 (+ 19192us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.153237 (+ 2819us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.170285 (+ 17048us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4679611}
I20260617 07:53:25.170650 1170 tablet_replica.cc:333] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.170810 1170 raft_consensus.cc:2243] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.170929 1170 raft_consensus.cc:2272] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.171380 1170 ts_tablet_manager.cc:1916] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.171562 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0e2e4f2458344f1c842bef1b61a48f91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.172032 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e2e4f2458344f1c842bef1b61a48f91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.173010 1862 ts_tablet_manager.cc:1929] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.173105 1862 log.cc:1199] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/a02dbb70eec84932917ef282fdae0bd7
I20260617 07:53:25.173408 1862 ts_tablet_manager.cc:1950] T a02dbb70eec84932917ef282fdae0bd7 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:25.174124 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 664) took 1527 ms. Trace:
I20260617 07:53:25.174198 1862 rpcz_store.cc:276] 0617 07:53:23.646981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.648967 (+ 1986us) service_pool.cc:224] Handling call
0617 07:53:25.142238 (+1493271us) ts_tablet_manager.cc:1151] Deleting tablet a02dbb70eec84932917ef282fdae0bd7
0617 07:53:25.142247 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.151675 (+ 9428us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.172958 (+ 21283us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.174103 (+ 1145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1493112}
I20260617 07:53:25.174717 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet a02dbb70eec84932917ef282fdae0bd7 (table default.Table_fceae19017b24062acf8baff4d043ec9 [id=1a61bbe203b44d6d89dbc71a84fc3917]) successfully deleted
W20260617 07:53:25.175915 716 leader_election.cc:343] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 4de8df5e15cb43c0b95ec5af3110db66
I20260617 07:53:25.176661 1170 ts_tablet_manager.cc:1929] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 07:53:25.177543 713 leader_election.cc:343] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 4de8df5e15cb43c0b95ec5af3110db66
I20260617 07:53:25.177680 713 leader_election.cc:304] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:25.178084 2803 raft_consensus.cc:2749] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.178954 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 69f5b567da0e4baab53c00c55923e920 (table default.Table_508fdaaadb52464f8c6c145656801fc3 [id=121e9982362a4d0b9e37fd44dabc695b]) successfully deleted
I20260617 07:53:25.181350 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e47ba449880147f6a1209c001192aa4b" } modify_external_catalogs: true
I20260617 07:53:25.181967 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e47ba449880147f6a1209c001192aa4b" } modify_external_catalogs: true
I20260617 07:53:25.182057 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f7c3f6260c4db690de1a5081bb2493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:10 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.185987 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 665) took 1530 ms. Trace:
I20260617 07:53:25.186123 1862 rpcz_store.cc:276] 0617 07:53:23.655112 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.655551 (+ 439us) service_pool.cc:224] Handling call
0617 07:53:25.185835 (+1530284us) ts_tablet_manager.cc:1151] Deleting tablet 92d1398b4b604f75be1a3b46e5ac9b77
0617 07:53:25.185845 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.185966 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1530135}
W20260617 07:53:25.186223 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fac31abffeb3453f8f0eeed3542ee965 consensus state has no leader
I20260617 07:53:25.186676 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 667) took 1527 ms. Trace:
W20260617 07:53:25.186776 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 92d1398b4b604f75be1a3b46e5ac9b77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92d1398b4b604f75be1a3b46e5ac9b77 already in progress: creating tablet
I20260617 07:53:25.186789 1862 rpcz_store.cc:276] 0617 07:53:23.659480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.659617 (+ 137us) service_pool.cc:224] Handling call
0617 07:53:25.186571 (+1526954us) ts_tablet_manager.cc:1151] Deleting tablet 8d58c09bfda64ad2aa42ecfbd413c6ef
0617 07:53:25.186579 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.186662 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1526780}
I20260617 07:53:25.187201 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 666) took 1527 ms. Trace:
W20260617 07:53:25.187235 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d58c09bfda64ad2aa42ecfbd413c6ef already in progress: creating tablet
I20260617 07:53:25.187325 1862 rpcz_store.cc:276] 0617 07:53:23.659309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.659908 (+ 599us) service_pool.cc:224] Handling call
0617 07:53:25.187098 (+1527190us) ts_tablet_manager.cc:1151] Deleting tablet 0b479c2984934852a864699b66416538
0617 07:53:25.187106 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.187189 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1527050}
I20260617 07:53:25.187805 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 668) took 1525 ms. Trace:
I20260617 07:53:25.187923 1862 rpcz_store.cc:276] 0617 07:53:23.662269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.662326 (+ 57us) service_pool.cc:224] Handling call
0617 07:53:25.187724 (+1525398us) ts_tablet_manager.cc:1151] Deleting tablet 8607c3a4744a4eeb882f1e913875ee1f
0617 07:53:25.187732 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.187793 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1525238}
I20260617 07:53:25.188351 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 669) took 1524 ms. Trace:
I20260617 07:53:25.188465 1862 rpcz_store.cc:276] 0617 07:53:23.664202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.664266 (+ 64us) service_pool.cc:224] Handling call
0617 07:53:25.188251 (+1523985us) ts_tablet_manager.cc:1151] Deleting tablet 12727ad13f0747ce8d9710a71ba2c075
0617 07:53:25.188259 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.188339 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1519659}
I20260617 07:53:25.188911 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 670) took 1515 ms. Trace:
I20260617 07:53:25.189123 1862 rpcz_store.cc:276] 0617 07:53:23.673870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.673914 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:25.188812 (+1514898us) ts_tablet_manager.cc:1151] Deleting tablet 213d76d2aa1a41d5951aa093d09d9ce6
0617 07:53:25.188819 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.188898 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1514738}
I20260617 07:53:25.189558 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 676) took 1434 ms. Trace:
I20260617 07:53:25.189679 1862 rpcz_store.cc:276] 0617 07:53:23.754601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.758850 (+ 4249us) service_pool.cc:224] Handling call
0617 07:53:25.189459 (+1430609us) ts_tablet_manager.cc:1151] Deleting tablet d3f843a058bd449796d59b89e2470d8c
0617 07:53:25.189467 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.189546 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1430442}
I20260617 07:53:25.190119 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 685) took 1365 ms. Trace:
W20260617 07:53:25.190323 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 0b479c2984934852a864699b66416538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b479c2984934852a864699b66416538 already in progress: creating tablet
W20260617 07:53:25.190608 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 8607c3a4744a4eeb882f1e913875ee1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8607c3a4744a4eeb882f1e913875ee1f already in progress: creating tablet
W20260617 07:53:25.190827 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 12727ad13f0747ce8d9710a71ba2c075 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12727ad13f0747ce8d9710a71ba2c075 already in progress: creating tablet
W20260617 07:53:25.191056 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 213d76d2aa1a41d5951aa093d09d9ce6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 213d76d2aa1a41d5951aa093d09d9ce6 already in progress: creating tablet
W20260617 07:53:25.191324 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d3f843a058bd449796d59b89e2470d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3f843a058bd449796d59b89e2470d8c already in progress: creating tablet
I20260617 07:53:25.192099 1862 rpcz_store.cc:276] 0617 07:53:23.824830 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.824889 (+ 59us) service_pool.cc:224] Handling call
0617 07:53:25.190039 (+1365150us) ts_tablet_manager.cc:1151] Deleting tablet 2c120eba06a549ef88ffa19998ab0f3d
0617 07:53:25.190046 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.190107 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364972}
I20260617 07:53:25.192610 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 688) took 1329 ms. Trace:
I20260617 07:53:25.193608 1862 rpcz_store.cc:276] 0617 07:53:23.863322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.866501 (+ 3179us) service_pool.cc:224] Handling call
0617 07:53:25.192527 (+1326026us) ts_tablet_manager.cc:1151] Deleting tablet e5544753b3144c1989f2ed99bffc2246
0617 07:53:25.192535 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.192599 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325817}
I20260617 07:53:25.187852 2729 raft_consensus.cc:493] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.193846 2729 raft_consensus.cc:515] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.194067 1862 tablet_replica.cc:333] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.194233 1862 raft_consensus.cc:2243] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:25.194521 2729 leader_election.cc:290] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.194557 1862 raft_consensus.cc:2272] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.195001 1170 log.cc:1199] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/24ba13170e864dfa96cddfb1a76b8c40
W20260617 07:53:25.195147 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 2c120eba06a549ef88ffa19998ab0f3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c120eba06a549ef88ffa19998ab0f3d already in progress: creating tablet
I20260617 07:53:25.195313 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216614d066e9446f91e53d2a382b5f6e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.195410 1170 ts_tablet_manager.cc:1950] T 24ba13170e864dfa96cddfb1a76b8c40 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:25.195406 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e5544753b3144c1989f2ed99bffc2246 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5544753b3144c1989f2ed99bffc2246 already in progress: creating tablet
I20260617 07:53:25.195724 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216614d066e9446f91e53d2a382b5f6e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:25.195953 1862 ts_tablet_manager.cc:1916] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.196100 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 503) took 4665 ms. Trace:
I20260617 07:53:25.196246 1170 rpcz_store.cc:276] 0617 07:53:20.531056 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.536018 (+ 4962us) service_pool.cc:224] Handling call
0617 07:53:25.170610 (+4634592us) ts_tablet_manager.cc:1151] Deleting tablet 24ba13170e864dfa96cddfb1a76b8c40
0617 07:53:25.170618 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.174184 (+ 3566us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.176619 (+ 2435us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.196083 (+ 19464us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4634394}
W20260617 07:53:25.196453 988 leader_election.cc:343] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.196825 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 24ba13170e864dfa96cddfb1a76b8c40 (table default.Table_bfa59190ca144c4d9d0cbab7a39eef9c [id=214df2f2d641469c91a78dfd5bb3aba8]) successfully deleted
W20260617 07:53:25.197116 986 leader_election.cc:343] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.197224 986 leader_election.cc:304] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.197570 2729 raft_consensus.cc:2749] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.197976 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 504) took 4637 ms. Trace:
I20260617 07:53:25.198096 1170 rpcz_store.cc:276] 0617 07:53:20.560779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.565196 (+ 4417us) service_pool.cc:224] Handling call
0617 07:53:25.197861 (+4632665us) ts_tablet_manager.cc:1151] Deleting tablet ea4c1033487a4dd2a73bd5148d5bb8f9
0617 07:53:25.197871 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.197959 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4632492}
W20260617 07:53:25.198609 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ea4c1033487a4dd2a73bd5148d5bb8f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea4c1033487a4dd2a73bd5148d5bb8f9 already in progress: creating tablet
I20260617 07:53:25.198942 1170 tablet_replica.cc:333] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.199170 1170 raft_consensus.cc:2243] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.199344 1170 raft_consensus.cc:2272] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.200030 1170 ts_tablet_manager.cc:1916] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.207666 765 raft_consensus.cc:3060] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.211524 1170 ts_tablet_manager.cc:1929] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.211623 1170 log.cc:1199] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d06187aa09fd4776a992a07405a10876
I20260617 07:53:25.211877 1170 ts_tablet_manager.cc:1950] T d06187aa09fd4776a992a07405a10876 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.212606 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 505) took 4521 ms. Trace:
I20260617 07:53:25.212682 1170 rpcz_store.cc:276] 0617 07:53:20.690936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.691164 (+ 228us) service_pool.cc:224] Handling call
0617 07:53:25.198898 (+4507734us) ts_tablet_manager.cc:1151] Deleting tablet d06187aa09fd4776a992a07405a10876
0617 07:53:25.198907 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.208653 (+ 9746us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.211477 (+ 2824us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.212583 (+ 1106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4502044}
I20260617 07:53:25.213177 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d06187aa09fd4776a992a07405a10876 (table default.Table_67181344e3b04622865d4584952c600e [id=c866e35886e44e30b9a235af0b9a18ad]) successfully deleted
I20260617 07:53:25.215955 1172 ts_tablet_manager.cc:1403] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.079s user 0.019s sys 0.005s
I20260617 07:53:25.216570 1172 raft_consensus.cc:359] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.216728 1172 raft_consensus.cc:385] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.216776 1172 raft_consensus.cc:740] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.223189 2729 raft_consensus.cc:493] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.223308 2729 raft_consensus.cc:515] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.223832 2729 leader_election.cc:290] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.224395 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f1051b9dd04db5a8f1245242d39376" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:25.224926 988 leader_election.cc:343] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.225062 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f1051b9dd04db5a8f1245242d39376" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.227401 2856 tablet.cc:1724] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:25.228164 1862 ts_tablet_manager.cc:1929] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260617 07:53:25.231089 986 leader_election.cc:343] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.231212 986 leader_election.cc:304] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.231639 2729 raft_consensus.cc:2749] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.231884 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 506) took 4540 ms. Trace:
I20260617 07:53:25.231954 1170 rpcz_store.cc:276] 0617 07:53:20.691077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.691147 (+ 70us) service_pool.cc:224] Handling call
0617 07:53:25.225124 (+4533977us) ts_tablet_manager.cc:1151] Deleting tablet 561c8bf9e5c840628ab1c8cf91dc2d93
0617 07:53:25.225133 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.231866 (+ 6733us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4528181}
W20260617 07:53:25.232518 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 561c8bf9e5c840628ab1c8cf91dc2d93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 561c8bf9e5c840628ab1c8cf91dc2d93 already in progress: creating tablet
I20260617 07:53:25.232997 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 517) took 4239 ms. Trace:
I20260617 07:53:25.233112 1170 rpcz_store.cc:276] 0617 07:53:20.993157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:20.999396 (+ 6239us) service_pool.cc:224] Handling call
0617 07:53:25.232910 (+4233514us) ts_tablet_manager.cc:1151] Deleting tablet 4681e8e3f1174b299d89ec541ca8e6b3
0617 07:53:25.232920 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.232982 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4233320}
W20260617 07:53:25.233595 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 4681e8e3f1174b299d89ec541ca8e6b3 because the tablet was not found. No further retry: Not found: Tablet not found: 4681e8e3f1174b299d89ec541ca8e6b3
I20260617 07:53:25.233806 1862 log.cc:1199] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/770a5216299842b890d483ca37b0ee86
I20260617 07:53:25.233990 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 518) took 4162 ms. Trace:
I20260617 07:53:25.234095 1170 rpcz_store.cc:276] 0617 07:53:21.071153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.071219 (+ 66us) service_pool.cc:224] Handling call
0617 07:53:25.233884 (+4162665us) ts_tablet_manager.cc:1151] Deleting tablet 843c2afd54ee451a948cc8b92c556a31
0617 07:53:25.233893 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.233974 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4162457}
I20260617 07:53:25.234611 1862 ts_tablet_manager.cc:1950] T 770a5216299842b890d483ca37b0ee86 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:25.234598 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 843c2afd54ee451a948cc8b92c556a31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 843c2afd54ee451a948cc8b92c556a31 already in progress: creating tablet
I20260617 07:53:25.235496 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 695) took 1241 ms. Trace:
I20260617 07:53:25.235131 1172 consensus_queue.cc:260] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.234913 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 519) took 4163 ms. Trace:
I20260617 07:53:25.235865 2856 tablet.cc:1724] T 956eefc9ac3147bb857a448563c6fb6f P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:25.236176 1170 rpcz_store.cc:276] 0617 07:53:21.071277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.071460 (+ 183us) service_pool.cc:224] Handling call
0617 07:53:25.234813 (+4163353us) ts_tablet_manager.cc:1151] Deleting tablet e9bed1de333b4944a9a72ae26a9f8542
0617 07:53:25.234823 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.234898 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4163192}
W20260617 07:53:25.241117 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e9bed1de333b4944a9a72ae26a9f8542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9bed1de333b4944a9a72ae26a9f8542 already in progress: creating tablet
I20260617 07:53:25.241533 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 520) took 4108 ms. Trace:
I20260617 07:53:25.241900 1170 rpcz_store.cc:276] 0617 07:53:21.132944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.137766 (+ 4822us) service_pool.cc:224] Handling call
0617 07:53:25.241432 (+4103666us) ts_tablet_manager.cc:1151] Deleting tablet e793cbccf5774e95a8316d6298d4646f
0617 07:53:25.241442 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.241518 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4052399}
W20260617 07:53:25.242491 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e793cbccf5774e95a8316d6298d4646f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e793cbccf5774e95a8316d6298d4646f already in progress: creating tablet
I20260617 07:53:25.242158 1172 ts_tablet_manager.cc:1434] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.026s user 0.004s sys 0.000s
I20260617 07:53:25.243677 1846 ts_tablet_manager.cc:1929] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:25.243719 1172 tablet_bootstrap.cc:492] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.245059 1172 tablet_bootstrap.cc:654] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.245762 1170 tablet_replica.cc:333] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.245693 1862 rpcz_store.cc:276] 0617 07:53:23.993891 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.993956 (+ 65us) service_pool.cc:224] Handling call
0617 07:53:25.194028 (+1200072us) ts_tablet_manager.cc:1151] Deleting tablet 770a5216299842b890d483ca37b0ee86
0617 07:53:25.194035 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.218204 (+ 24169us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.228108 (+ 9904us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.235478 (+ 7370us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1199886}
I20260617 07:53:25.246011 1170 raft_consensus.cc:2243] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.246224 1170 raft_consensus.cc:2272] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.246210 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]) successfully deleted
I20260617 07:53:25.246289 1862 tablet_replica.cc:333] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.246457 1862 raft_consensus.cc:2243] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:25.246764 1862 raft_consensus.cc:2272] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.246928 1170 ts_tablet_manager.cc:1916] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.247570 1862 ts_tablet_manager.cc:1916] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.252986 1862 ts_tablet_manager.cc:1929] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:25.256187 1170 ts_tablet_manager.cc:1929] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:25.258414 1170 log.cc:1199] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/b4c9a032007a412e95bbd2b229edd50b
I20260617 07:53:25.259275 1170 ts_tablet_manager.cc:1950] T b4c9a032007a412e95bbd2b229edd50b P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.260775 2729 raft_consensus.cc:493] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.261468 2729 raft_consensus.cc:515] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.262063 2729 leader_election.cc:290] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.261335 1172 tablet_bootstrap.cc:492] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.262861 1172 ts_tablet_manager.cc:1403] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260617 07:53:25.263497 1172 raft_consensus.cc:359] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:25.263705 1172 raft_consensus.cc:385] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.263788 1172 raft_consensus.cc:740] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.264036 1172 consensus_queue.cc:260] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:25.265508 1172 ts_tablet_manager.cc:1434] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 07:53:25.266628 1172 tablet_bootstrap.cc:492] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.262838 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ffa2d61d5942b19aff2b2cf2b1e0b3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:25.267133 1862 log.cc:1199] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/369442b72f754ee08dc6a484d51f2e99
I20260617 07:53:25.267482 1862 ts_tablet_manager.cc:1950] T 369442b72f754ee08dc6a484d51f2e99 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:25.267517 988 leader_election.cc:343] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.268364 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 697) took 1257 ms. Trace:
I20260617 07:53:25.268491 1862 rpcz_store.cc:276] 0617 07:53:24.010723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.011219 (+ 496us) service_pool.cc:224] Handling call
0617 07:53:25.246241 (+1235022us) ts_tablet_manager.cc:1151] Deleting tablet 369442b72f754ee08dc6a484d51f2e99
0617 07:53:25.246253 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.250346 (+ 4093us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.252946 (+ 2600us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.268348 (+ 15402us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1234846}
I20260617 07:53:25.268980 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 699) took 1258 ms. Trace:
I20260617 07:53:25.269579 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 521) took 4131 ms. Trace:
I20260617 07:53:25.269752 1862 rpcz_store.cc:276] 0617 07:53:24.010931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.011416 (+ 485us) service_pool.cc:224] Handling call
0617 07:53:25.268874 (+1257458us) ts_tablet_manager.cc:1151] Deleting tablet f4d8542262864a0ab9d763528502bcbb
0617 07:53:25.268883 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.268965 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1257345}
I20260617 07:53:25.273268 1846 log.cc:1199] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/b4c9a032007a412e95bbd2b229edd50b
I20260617 07:53:25.274317 1862 tablet_replica.cc:333] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.274526 1862 raft_consensus.cc:2243] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:25.274534 1846 ts_tablet_manager.cc:1950] T b4c9a032007a412e95bbd2b229edd50b P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:25.275216 1862 raft_consensus.cc:2272] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.256018 1178 tablet_bootstrap.cc:492] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:25.275888 1178 ts_tablet_manager.cc:1403] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.161s user 0.003s sys 0.000s
I20260617 07:53:25.276502 1170 rpcz_store.cc:276] 0617 07:53:21.137688 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.139600 (+ 1912us) service_pool.cc:224] Handling call
0617 07:53:25.245693 (+4106093us) ts_tablet_manager.cc:1151] Deleting tablet b4c9a032007a412e95bbd2b229edd50b
0617 07:53:25.245702 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.253205 (+ 7503us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.256135 (+ 2930us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.269562 (+ 13427us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4056592}
I20260617 07:53:25.262722 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ffa2d61d5942b19aff2b2cf2b1e0b3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.277035 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet b4c9a032007a412e95bbd2b229edd50b (table default.Table_94149217b8fd42f3a46ed6df137e9f82 [id=251c405acf1c444ca8d6817889ffeed5]) successfully deleted
W20260617 07:53:25.277974 986 leader_election.cc:343] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.278105 986 leader_election.cc:304] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.278445 2729 raft_consensus.cc:2749] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.269752 1172 tablet_bootstrap.cc:654] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.278424 1178 raft_consensus.cc:359] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.279063 1178 raft_consensus.cc:385] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.279278 1178 raft_consensus.cc:740] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.279599 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 522) took 3964 ms. Trace:
I20260617 07:53:25.279728 1170 rpcz_store.cc:276] 0617 07:53:21.315219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.315275 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:25.279492 (+3964217us) ts_tablet_manager.cc:1151] Deleting tablet 421ad54782ac4ea1bef756a0129b3f21
0617 07:53:25.279500 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.279583 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3847949}
I20260617 07:53:25.279850 1178 consensus_queue.cc:260] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:25.280238 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 421ad54782ac4ea1bef756a0129b3f21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 421ad54782ac4ea1bef756a0129b3f21 already in progress: creating tablet
I20260617 07:53:25.280624 1170 tablet_replica.cc:333] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.280848 1170 raft_consensus.cc:2243] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.281023 1170 raft_consensus.cc:2272] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.281538 1170 ts_tablet_manager.cc:1916] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.282373 1862 ts_tablet_manager.cc:1916] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.287281 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3f841679edc0410a9304de3797c3344e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:25.288945 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b5dd820c6a314f5485eca5465c792124" } modify_external_catalogs: true
I20260617 07:53:25.289139 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b5dd820c6a314f5485eca5465c792124" } modify_external_catalogs: true
I20260617 07:53:25.289763 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ad2a6d2f10ea483bab983124a363296c" } modify_external_catalogs: true
I20260617 07:53:25.289934 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ad2a6d2f10ea483bab983124a363296c" } modify_external_catalogs: true
I20260617 07:53:25.293992 1170 ts_tablet_manager.cc:1929] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.295930 1172 tablet_bootstrap.cc:492] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.296026 1862 ts_tablet_manager.cc:1929] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:25.296168 1172 ts_tablet_manager.cc:1403] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.003s
I20260617 07:53:25.296916 1172 raft_consensus.cc:359] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.297070 1172 raft_consensus.cc:385] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.297140 1862 log.cc:1199] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/e55d63a25a2845dbbcce20e560361007
I20260617 07:53:25.297186 1172 raft_consensus.cc:740] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.297472 1172 consensus_queue.cc:260] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.297585 1862 ts_tablet_manager.cc:1950] T e55d63a25a2845dbbcce20e560361007 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:25.298406 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 698) took 1287 ms. Trace:
I20260617 07:53:25.299038 1172 ts_tablet_manager.cc:1434] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:25.300313 1862 rpcz_store.cc:276] 0617 07:53:24.010815 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.011504 (+ 689us) service_pool.cc:224] Handling call
0617 07:53:25.274272 (+1262768us) ts_tablet_manager.cc:1151] Deleting tablet e55d63a25a2845dbbcce20e560361007
0617 07:53:25.274281 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.285328 (+ 11047us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.295972 (+ 10644us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.298388 (+ 2416us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1262601}
I20260617 07:53:25.300905 1172 tablet_bootstrap.cc:492] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.300900 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 700) took 1176 ms. Trace:
I20260617 07:53:25.301033 1862 rpcz_store.cc:276] 0617 07:53:24.124700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.124761 (+ 61us) service_pool.cc:224] Handling call
0617 07:53:25.300780 (+1176019us) ts_tablet_manager.cc:1151] Deleting tablet 345770b456d64fedba27347674a70900
0617 07:53:25.300791 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.300884 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1175829}
I20260617 07:53:25.301424 1862 tablet_replica.cc:333] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.301617 1862 raft_consensus.cc:2243] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.301828 1862 raft_consensus.cc:2272] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.303097 1172 tablet_bootstrap.cc:654] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.303076 1862 ts_tablet_manager.cc:1916] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.303900 1170 log.cc:1199] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/5364dfe28b8d4042941c8d8d4d1cf503
I20260617 07:53:25.304242 1170 ts_tablet_manager.cc:1950] T 5364dfe28b8d4042941c8d8d4d1cf503 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.304898 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 523) took 3989 ms. Trace:
I20260617 07:53:25.305755 1170 rpcz_store.cc:276] 0617 07:53:21.315609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.315687 (+ 78us) service_pool.cc:224] Handling call
0617 07:53:25.280550 (+3964863us) ts_tablet_manager.cc:1151] Deleting tablet 5364dfe28b8d4042941c8d8d4d1cf503
0617 07:53:25.280559 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.284592 (+ 4033us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.293945 (+ 9353us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.304880 (+ 10935us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3848100}
I20260617 07:53:25.306265 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 5364dfe28b8d4042941c8d8d4d1cf503 (table default.Table_665c19b8c9d14ccc9f5beb633b690e13 [id=3ab32aa970c24c1bbde1768b3defee07]) successfully deleted
I20260617 07:53:25.309693 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 528) took 3915 ms. Trace:
I20260617 07:53:25.309851 1170 rpcz_store.cc:276] 0617 07:53:21.394626 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.394706 (+ 80us) service_pool.cc:224] Handling call
0617 07:53:25.306566 (+3911860us) ts_tablet_manager.cc:1151] Deleting tablet 5f4a8b06f77643dcb28f0c3136510253
0617 07:53:25.307469 (+ 903us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.309675 (+ 2206us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3860450}
W20260617 07:53:25.310098 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f841679edc0410a9304de3797c3344e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:25.310526 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 5f4a8b06f77643dcb28f0c3136510253 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f4a8b06f77643dcb28f0c3136510253 already in progress: creating tablet
I20260617 07:53:25.310993 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 529) took 3890 ms. Trace:
I20260617 07:53:25.311131 1170 rpcz_store.cc:276] 0617 07:53:21.420712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.420779 (+ 67us) service_pool.cc:224] Handling call
0617 07:53:25.310863 (+3890084us) ts_tablet_manager.cc:1151] Deleting tablet 6343f3d909ac4438b882283ab2b25a6d
0617 07:53:25.310875 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.310973 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3864680}
I20260617 07:53:25.269049 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 369442b72f754ee08dc6a484d51f2e99 (table default.Table_8d97f61ab92d44008502cff52c36b89d [id=f0165435692349baa81584520f068a56]) successfully deleted
W20260617 07:53:25.311955 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 6343f3d909ac4438b882283ab2b25a6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6343f3d909ac4438b882283ab2b25a6d already in progress: creating tablet
I20260617 07:53:25.312343 1170 tablet_replica.cc:333] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:25.311781 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet f4d8542262864a0ab9d763528502bcbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4d8542262864a0ab9d763528502bcbb already in progress: creating tablet
I20260617 07:53:25.314811 1170 raft_consensus.cc:2243] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.315057 1170 raft_consensus.cc:2272] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.315795 1170 ts_tablet_manager.cc:1916] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.314792 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet e55d63a25a2845dbbcce20e560361007 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]) successfully deleted
W20260617 07:53:25.316465 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 345770b456d64fedba27347674a70900 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 345770b456d64fedba27347674a70900 already in progress: creating tablet
I20260617 07:53:25.319658 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 956eefc9ac3147bb857a448563c6fb6f (table default.Table_11e8915c1fc444049ee51be7f91d14db [id=40dfd0c31d5b4c0c9dcfae02dd246bdb]). Expected version 2 got 0
I20260617 07:53:25.320552 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0a368d484ee648bba50a045dab04f192" } modify_external_catalogs: true
I20260617 07:53:25.320814 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0a368d484ee648bba50a045dab04f192" } modify_external_catalogs: true
I20260617 07:53:25.324126 1862 ts_tablet_manager.cc:1929] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.324266 1862 log.cc:1199] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/4d9ace137c4e496fafac4e729718577f
I20260617 07:53:25.325433 1171 tablet_bootstrap.cc:492] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.325848 1171 ts_tablet_manager.cc:1403] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.207s user 0.042s sys 0.073s
I20260617 07:53:25.325882 2803 raft_consensus.cc:493] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.326058 1862 ts_tablet_manager.cc:1950] T 4d9ace137c4e496fafac4e729718577f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:25.326014 2803 raft_consensus.cc:515] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.326642 2803 leader_election.cc:290] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.326565 1171 raft_consensus.cc:359] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.326778 1171 raft_consensus.cc:385] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.326826 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 696) took 1316 ms. Trace:
I20260617 07:53:25.326908 1862 rpcz_store.cc:276] 0617 07:53:24.010586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.134148 (+123562us) service_pool.cc:224] Handling call
0617 07:53:25.301385 (+1167237us) ts_tablet_manager.cc:1151] Deleting tablet 4d9ace137c4e496fafac4e729718577f
0617 07:53:25.301393 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.316383 (+ 14990us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.324079 (+ 7696us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.326808 (+ 2729us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1166985}
I20260617 07:53:25.326840 1171 raft_consensus.cc:740] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.327282 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f90a0d37cb483faa540451bf4dbe85" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.327893 1171 consensus_queue.cc:260] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:25.328106 716 leader_election.cc:343] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a6f90a0d37cb483faa540451bf4dbe85
I20260617 07:53:25.328217 716 leader_election.cc:304] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:25.328449 1171 ts_tablet_manager.cc:1434] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 07:53:25.328677 2803 raft_consensus.cc:2749] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.328962 1171 tablet_bootstrap.cc:492] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:25.328974 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 4d9ace137c4e496fafac4e729718577f (table default.Table_6f43914efa774fb1b61d4f870c76bad8 [id=7738095992784d1e80554f9f554fb1cd]) successfully deleted
I20260617 07:53:25.328047 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 704) took 1190 ms. Trace:
I20260617 07:53:25.330075 1862 rpcz_store.cc:276] 0617 07:53:24.137235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.137276 (+ 41us) service_pool.cc:224] Handling call
0617 07:53:25.327928 (+1190652us) ts_tablet_manager.cc:1151] Deleting tablet e62175d5cc854d45838454043220954e
0617 07:53:25.327942 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.328031 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190490}
W20260617 07:53:25.330500 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet e62175d5cc854d45838454043220954e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e62175d5cc854d45838454043220954e already in progress: creating tablet
I20260617 07:53:25.330536 1862 tablet_replica.cc:333] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.330710 1862 raft_consensus.cc:2243] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.331199 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 708) took 4194 ms. Trace:
I20260617 07:53:25.331319 1846 rpcz_store.cc:276] 0617 07:53:21.136796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.136848 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:25.027487 (+3890639us) ts_tablet_manager.cc:1151] Deleting tablet b4c9a032007a412e95bbd2b229edd50b
0617 07:53:25.027496 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.043295 (+ 15799us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.243610 (+200315us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.331181 (+ 87571us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3890446}
I20260617 07:53:25.331820 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet b4c9a032007a412e95bbd2b229edd50b (table default.Table_94149217b8fd42f3a46ed6df137e9f82 [id=251c405acf1c444ca8d6817889ffeed5]) successfully deleted
I20260617 07:53:25.332204 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 710) took 4025 ms. Trace:
I20260617 07:53:25.332341 1846 rpcz_store.cc:276] 0617 07:53:21.306768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.316011 (+ 9243us) service_pool.cc:224] Handling call
0617 07:53:25.332089 (+4016078us) ts_tablet_manager.cc:1151] Deleting tablet 421ad54782ac4ea1bef756a0129b3f21
0617 07:53:25.332101 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.332187 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4015860}
I20260617 07:53:25.332595 1178 ts_tablet_manager.cc:1434] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.056s user 0.001s sys 0.002s
W20260617 07:53:25.332747 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 421ad54782ac4ea1bef756a0129b3f21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 421ad54782ac4ea1bef756a0129b3f21 already in progress: creating tablet
I20260617 07:53:25.332877 1178 tablet_bootstrap.cc:492] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:25.334139 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 715) took 3945 ms. Trace:
I20260617 07:53:25.334249 1846 rpcz_store.cc:276] 0617 07:53:21.388920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.395348 (+ 6428us) service_pool.cc:224] Handling call
0617 07:53:25.334050 (+3938702us) ts_tablet_manager.cc:1151] Deleting tablet 5f4a8b06f77643dcb28f0c3136510253
0617 07:53:25.334058 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.334125 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3936867}
W20260617 07:53:25.335148 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 5f4a8b06f77643dcb28f0c3136510253 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f4a8b06f77643dcb28f0c3136510253 already in progress: creating tablet
I20260617 07:53:25.335902 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 716) took 3921 ms. Trace:
I20260617 07:53:25.336010 1846 rpcz_store.cc:276] 0617 07:53:21.414624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.414691 (+ 67us) service_pool.cc:224] Handling call
0617 07:53:25.335793 (+3921102us) ts_tablet_manager.cc:1151] Deleting tablet 6343f3d909ac4438b882283ab2b25a6d
0617 07:53:25.335804 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.335885 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3920849}
W20260617 07:53:25.336623 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6343f3d909ac4438b882283ab2b25a6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6343f3d909ac4438b882283ab2b25a6d already in progress: creating tablet
I20260617 07:53:25.336921 1846 tablet_replica.cc:333] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:25.331523 1171 tablet_bootstrap.cc:654] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.337162 1846 raft_consensus.cc:2243] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.337342 1846 raft_consensus.cc:2272] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.338418 1862 raft_consensus.cc:2272] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.338902 1862 ts_tablet_manager.cc:1916] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.339522 1178 tablet_bootstrap.cc:654] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.340742 2856 tablet.cc:1724] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:25.341763 2861 raft_consensus.cc:493] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc3bec007846459a9da0c7b8211e477b)
I20260617 07:53:25.341871 2861 raft_consensus.cc:515] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.342617 2861 leader_election.cc:290] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.345585 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf4025a0f784cc6868950e51a45da2e" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:25.346897 2629 raft_consensus.cc:493] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.347023 2629 raft_consensus.cc:515] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.347599 2629 leader_election.cc:290] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.347786 2775 raft_consensus.cc:493] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.347914 2775 raft_consensus.cc:515] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.348449 2775 leader_election.cc:290] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.349108 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804126f8451e42748b26c43e31a2a1c4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.349268 1051 raft_consensus.cc:2468] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:25.349334 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf4025a0f784cc6868950e51a45da2e" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.349843 713 leader_election.cc:304] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:25.349997 851 leader_election.cc:304] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:25.350310 2774 raft_consensus.cc:2804] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:25.350395 2774 raft_consensus.cc:493] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:25.350482 2774 raft_consensus.cc:3060] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.350621 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1382fc75785e4b07bf1688fa5385500a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:25.351074 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804126f8451e42748b26c43e31a2a1c4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.351236 988 leader_election.cc:343] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.352662 2861 raft_consensus.cc:2749] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260617 07:53:25.352911 852 leader_election.cc:343] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.353238 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1382fc75785e4b07bf1688fa5385500a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.353354 2774 raft_consensus.cc:515] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:25.353677 986 leader_election.cc:343] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.353789 986 leader_election.cc:304] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.354180 2629 raft_consensus.cc:2749] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.355665 2774 leader_election.cc:290] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.356880 1172 tablet_bootstrap.cc:492] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.357481 1172 ts_tablet_manager.cc:1403] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.002s
I20260617 07:53:25.357873 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804126f8451e42748b26c43e31a2a1c4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:25.358032 1046 raft_consensus.cc:3060] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.358245 2629 raft_consensus.cc:493] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.358322 1172 raft_consensus.cc:359] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.358351 2629 raft_consensus.cc:515] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.358479 1172 raft_consensus.cc:385] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.358527 1172 raft_consensus.cc:740] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.358902 2629 leader_election.cc:290] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.360497 1046 raft_consensus.cc:2468] T 804126f8451e42748b26c43e31a2a1c4 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:25.361354 1172 consensus_queue.cc:260] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.362533 1172 ts_tablet_manager.cc:1434] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 07:53:25.362780 1172 tablet_bootstrap.cc:492] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.362906 459 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 8cf4025a0f784cc6868950e51a45da2e (table default.Table_d36bea18179d4ba992d8795ee73dc19a [id=bf143b9baca647f0b25452d16dff2ae6]). Expected version 2 got 0
I20260617 07:53:25.363550 1862 ts_tablet_manager.cc:1929] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.363667 1862 log.cc:1199] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/9618a5c0c9dd4c368f5763c434f70da5
I20260617 07:53:25.363962 1862 ts_tablet_manager.cc:1950] T 9618a5c0c9dd4c368f5763c434f70da5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:25.364624 1862 tablet_replica.cc:333] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.365284 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1183e1f272da4d5ea6bf70030b6e1432"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:25.366767 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cd66ea6ebc42bda00fbec82da73f16" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.367225 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1183e1f272da4d5ea6bf70030b6e1432 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.367825 2856 tablet.cc:1724] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:25.368474 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804126f8451e42748b26c43e31a2a1c4" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:25.369385 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0e30edc72d824353b77f16a262127628"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.369944 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e30edc72d824353b77f16a262127628 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:25.375984 986 leader_election.cc:343] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.377527 1172 tablet_bootstrap.cc:654] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.380223 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 9618a5c0c9dd4c368f5763c434f70da5 (table default.Table_1f40cdfe73f54202b6223af377958372 [id=347683dc11c24e8e9f2e9eff1d671045]) successfully deleted
W20260617 07:53:25.380508 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d4afe4a3d708447fa7ab8bf53614c4ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4afe4a3d708447fa7ab8bf53614c4ba already in progress: creating tablet
I20260617 07:53:25.383399 1172 tablet_bootstrap.cc:492] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.383538 1172 ts_tablet_manager.cc:1403] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260617 07:53:25.384245 1172 raft_consensus.cc:359] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.384423 1172 raft_consensus.cc:385] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.384478 1172 raft_consensus.cc:740] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.384660 1172 consensus_queue.cc:260] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.366506 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cd66ea6ebc42bda00fbec82da73f16" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:25.369055 852 leader_election.cc:343] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.399194 454 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:25.399228 851 leader_election.cc:304] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.399441 454 catalog_manager.cc:5696] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:25.399748 2774 raft_consensus.cc:2804] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:25.399863 2774 raft_consensus.cc:697] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:25.399868 454 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:25.400074 2774 consensus_queue.cc:237] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.401744 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_62c17ca0481442d58651d8e9a4fa3524" } new_table_name: "default.Table_ee2f3c00a58145bd98a065b0f6df986a" modify_external_catalogs: true
I20260617 07:53:25.404048 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_143edf6137ce4646bda2af36a72fd7af" } new_table_name: "default.Table_726525d4188947d1b1f96cb79cbc3d9b" modify_external_catalogs: true
I20260617 07:53:25.405952 748 tablet_service.cc:1511] Processing CreateTablet for tablet bf17be1552534965989aa9460cc13a6f (DEFAULT_TABLE table=default.Table_f34608efcf844e66b9c7a0e6a63fcd6a [id=d50bf9155a3e48deb5e177e0c83d6832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.406348 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf17be1552534965989aa9460cc13a6f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:25.407047 988 leader_election.cc:343] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.407178 988 leader_election.cc:304] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.410799 1170 ts_tablet_manager.cc:1929] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 07:53:25.410926 1170 log.cc:1199] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/cc4d21f9ad9543b0b90fc66f1a6e3b13
I20260617 07:53:25.411374 1170 ts_tablet_manager.cc:1950] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.411881 1862 raft_consensus.cc:2243] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.412032 1862 raft_consensus.cc:2272] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.413352 756 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f86b53ea143bb9311e5e14d1a9705 (DEFAULT_TABLE table=default.Table_687053e90da743bdb4d74e3d1f368e89 [id=1576890a933741d6908cb897d2b12b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.413744 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f86b53ea143bb9311e5e14d1a9705. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:25.414458 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet ecd880890df5494f8500d623b0524e9c (table default.Table_5ff5f705babb4bf5954fe34e745c20d9 [id=dbc5752bd46a4b92a6399a02b8b9d8dd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ecd880890df5494f8500d623b0524e9c consensus state has no leader
I20260617 07:53:25.414844 887 tablet_service.cc:1511] Processing CreateTablet for tablet bf17be1552534965989aa9460cc13a6f (DEFAULT_TABLE table=default.Table_f34608efcf844e66b9c7a0e6a63fcd6a [id=d50bf9155a3e48deb5e177e0c83d6832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.415127 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8dd1d9e74c1245e1afe42a16f20e57f6" } new_table_name: "default.Table_af123e58c8214911af3d01a540b8f135" modify_external_catalogs: true
I20260617 07:53:25.415284 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf17be1552534965989aa9460cc13a6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.422642 1862 ts_tablet_manager.cc:1916] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.425120 1014 tablet_service.cc:1511] Processing CreateTablet for tablet bf17be1552534965989aa9460cc13a6f (DEFAULT_TABLE table=default.Table_f34608efcf844e66b9c7a0e6a63fcd6a [id=d50bf9155a3e48deb5e177e0c83d6832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.425467 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf17be1552534965989aa9460cc13a6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.426343 1846 ts_tablet_manager.cc:1916] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.429569 742 tablet_service.cc:1511] Processing CreateTablet for tablet 4db34898eb82492da09d4dc99cde92ba (DEFAULT_TABLE table=default.Table_b0e6ecffb0434f9898471fb47b940805 [id=1cf1f33f9287474799d20320cfcb53b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.429940 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db34898eb82492da09d4dc99cde92ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.432287 1846 ts_tablet_manager.cc:1929] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.433800 2861 raft_consensus.cc:493] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.433917 2861 raft_consensus.cc:515] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.434525 2861 leader_election.cc:290] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:25.435951 716 leader_election.cc:343] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 98f7c3f6260c4db690de1a5081bb2493
W20260617 07:53:25.437196 713 leader_election.cc:343] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 98f7c3f6260c4db690de1a5081bb2493
I20260617 07:53:25.437294 713 leader_election.cc:304] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:25.437578 2861 raft_consensus.cc:2749] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.440169 887 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f86b53ea143bb9311e5e14d1a9705 (DEFAULT_TABLE table=default.Table_687053e90da743bdb4d74e3d1f368e89 [id=1576890a933741d6908cb897d2b12b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.440522 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f86b53ea143bb9311e5e14d1a9705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.435287 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f86b53ea143bb9311e5e14d1a9705 (DEFAULT_TABLE table=default.Table_687053e90da743bdb4d74e3d1f368e89 [id=1576890a933741d6908cb897d2b12b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.442202 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f86b53ea143bb9311e5e14d1a9705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.445765 2774 raft_consensus.cc:493] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.445984 744 tablet_service.cc:1511] Processing CreateTablet for tablet 0105f28874994eb2bb00c86e2f6d469c (DEFAULT_TABLE table=default.Table_3695ab67f22046edba88a1e09d1dca29 [id=3e226a437f1349e08b0b659911087f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.446135 2774 raft_consensus.cc:515] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.446348 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0105f28874994eb2bb00c86e2f6d469c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.446894 2774 leader_election.cc:290] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.450433 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb8fbb44e6147be8c9605be886a8aea" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.451066 852 leader_election.cc:343] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.454744 1862 ts_tablet_manager.cc:1929] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.455112 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 4db34898eb82492da09d4dc99cde92ba (DEFAULT_TABLE table=default.Table_b0e6ecffb0434f9898471fb47b940805 [id=1cf1f33f9287474799d20320cfcb53b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.455507 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db34898eb82492da09d4dc99cde92ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.460505 1862 log.cc:1199] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/11794aa70824476e9751a41ab305cc80
I20260617 07:53:25.455109 887 tablet_service.cc:1511] Processing CreateTablet for tablet 4db34898eb82492da09d4dc99cde92ba (DEFAULT_TABLE table=default.Table_b0e6ecffb0434f9898471fb47b940805 [id=1cf1f33f9287474799d20320cfcb53b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.460795 898 tablet_service.cc:1511] Processing CreateTablet for tablet 0105f28874994eb2bb00c86e2f6d469c (DEFAULT_TABLE table=default.Table_3695ab67f22046edba88a1e09d1dca29 [id=3e226a437f1349e08b0b659911087f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.461225 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0105f28874994eb2bb00c86e2f6d469c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.463759 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 0105f28874994eb2bb00c86e2f6d469c (DEFAULT_TABLE table=default.Table_3695ab67f22046edba88a1e09d1dca29 [id=3e226a437f1349e08b0b659911087f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.464098 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0105f28874994eb2bb00c86e2f6d469c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.465795 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 71446fc29bd5413fbfe0f6ecc6c54ada
I20260617 07:53:25.467166 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db34898eb82492da09d4dc99cde92ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.467693 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet c6b85e7ed0a64c128de5cc48c4d4435f
W20260617 07:53:25.467823 852 consensus_peers.cc:597] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260617 07:53:25.468001 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 71446fc29bd5413fbfe0f6ecc6c54ada with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.468202 452 catalog_manager.cc:6784] ReplaceTablet: tablet c6b85e7ed0a64c128de5cc48c4d4435f deleted and replaced by tablet fc904f5b6a9a4b68a785b91427838f48
I20260617 07:53:25.468390 748 tablet_service.cc:1511] Processing CreateTablet for tablet f3dd043e558143679cffd21b512e097e (DEFAULT_TABLE table=default.Table_d410d9dcad68447bbc59efa3eb1c7b9e [id=6987c1ef739e4a239bf7a5d273e4eb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.468983 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd043e558143679cffd21b512e097e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:25.469004 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f55c9a85e6e4b5ea7f2014cd0b7921a consensus state has no leader
I20260617 07:53:25.472903 1862 ts_tablet_manager.cc:1950] T 11794aa70824476e9751a41ab305cc80 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:25.473505 1862 tablet_replica.cc:333] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.473767 1862 raft_consensus.cc:2243] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.473951 1862 raft_consensus.cc:2272] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.474503 1862 ts_tablet_manager.cc:1916] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.475950 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 11794aa70824476e9751a41ab305cc80 (table default.Table_833d659ea3034141bb454daaea8a3d8a [id=fb1c8cff45884121a6fa9d2b53f1029e]) successfully deleted
I20260617 07:53:25.477941 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet c6b85e7ed0a64c128de5cc48c4d4435f with delete_type TABLET_DATA_DELETED (replaced by tablet fc904f5b6a9a4b68a785b91427838f48) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.477674 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 71446fc29bd5413fbfe0f6ecc6c54ada with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.478169 756 tablet_service.cc:1558] Processing DeleteTablet for tablet c6b85e7ed0a64c128de5cc48c4d4435f with delete_type TABLET_DATA_DELETED (replaced by tablet fc904f5b6a9a4b68a785b91427838f48) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.477500 892 tablet_service.cc:1558] Processing DeleteTablet for tablet c6b85e7ed0a64c128de5cc48c4d4435f with delete_type TABLET_DATA_DELETED (replaced by tablet fc904f5b6a9a4b68a785b91427838f48) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.477808 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.477917 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be19ece3a0a4a51abad7b8e2f3b2420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.478107 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 71446fc29bd5413fbfe0f6ecc6c54ada with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.482257 879 tablet_service.cc:1511] Processing CreateTablet for tablet f3dd043e558143679cffd21b512e097e (DEFAULT_TABLE table=default.Table_d410d9dcad68447bbc59efa3eb1c7b9e [id=6987c1ef739e4a239bf7a5d273e4eb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.482985 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd043e558143679cffd21b512e097e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.483891 1014 tablet_service.cc:1511] Processing CreateTablet for tablet f3dd043e558143679cffd21b512e097e (DEFAULT_TABLE table=default.Table_d410d9dcad68447bbc59efa3eb1c7b9e [id=6987c1ef739e4a239bf7a5d273e4eb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.484210 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd043e558143679cffd21b512e097e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.484774 756 tablet_service.cc:1511] Processing CreateTablet for tablet a32f221925ef4b63abe3955027dd24c7 (DEFAULT_TABLE table=default.Table_371edc94a4fe40deb6394344e8ead730 [id=8c7daf1c5aaf4f8e90ec9de4f495ded0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.485127 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f221925ef4b63abe3955027dd24c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:25.489663 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 82621.9us
I20260617 07:53:25.490204 1047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb8fbb44e6147be8c9605be886a8aea" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.490370 1047 raft_consensus.cc:2468] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:25.491022 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 532) took 4052 ms. Trace:
I20260617 07:53:25.491128 1170 rpcz_store.cc:276] 0617 07:53:21.438620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.453345 (+ 14725us) service_pool.cc:224] Handling call
0617 07:53:25.312291 (+3858946us) ts_tablet_manager.cc:1151] Deleting tablet cc4d21f9ad9543b0b90fc66f1a6e3b13
0617 07:53:25.312302 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.379355 (+ 67053us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.410725 (+ 31370us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.491005 (+ 80280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78914,"tablet-delete.queue_time_us":3858721}
I20260617 07:53:25.491701 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 540) took 3980 ms. Trace:
I20260617 07:53:25.491771 1170 rpcz_store.cc:276] 0617 07:53:21.511237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.525428 (+ 14191us) service_pool.cc:224] Handling call
0617 07:53:25.491582 (+3966154us) ts_tablet_manager.cc:1151] Deleting tablet f249a9d29de54c959dbae1751501daee
0617 07:53:25.491591 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.491684 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3965869}
I20260617 07:53:25.492051 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 541) took 3906 ms. Trace:
I20260617 07:53:25.492151 1170 rpcz_store.cc:276] 0617 07:53:21.585583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.605279 (+ 19696us) service_pool.cc:224] Handling call
0617 07:53:25.491962 (+3886683us) ts_tablet_manager.cc:1151] Deleting tablet 83878d63683d49a6836ed0f925397e61
0617 07:53:25.491970 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.492039 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3886116}
I20260617 07:53:25.492211 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_8dd1d9e74c1245e1afe42a16f20e57f6 [id=3824f4c443804be49d851e39e23ce3f7]) successfully deleted
I20260617 07:53:25.492424 1170 tablet_replica.cc:333] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:25.492498 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet f249a9d29de54c959dbae1751501daee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f249a9d29de54c959dbae1751501daee already in progress: creating tablet
I20260617 07:53:25.492596 1170 raft_consensus.cc:2243] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.492753 1170 raft_consensus.cc:2272] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.493294 1170 ts_tablet_manager.cc:1916] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.494254 2729 raft_consensus.cc:2749] T 67cd66ea6ebc42bda00fbec82da73f16 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.495182 851 leader_election.cc:304] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.495828 2710 raft_consensus.cc:2804] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:25.495929 2710 raft_consensus.cc:493] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:25.496003 2710 raft_consensus.cc:3060] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.498571 2710 raft_consensus.cc:515] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.499277 2710 leader_election.cc:290] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.500953 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb8fbb44e6147be8c9605be886a8aea" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:25.501144 1051 raft_consensus.cc:3060] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.501374 744 tablet_service.cc:1511] Processing CreateTablet for tablet 326b2d87b68f441fbe06691341f746f7 (DEFAULT_TABLE table=default.Table_269e9513ae2943ddaf7ee4ecc2a21ab2 [id=0eedf173f9ee4ee49b0cbfeb07a1f67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.501821 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326b2d87b68f441fbe06691341f746f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.503610 1051 raft_consensus.cc:2468] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:25.504180 851 leader_election.cc:304] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:25.504444 2775 raft_consensus.cc:2804] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:25.504563 2775 raft_consensus.cc:697] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:25.504773 2775 consensus_queue.cc:237] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.506717 1862 ts_tablet_manager.cc:1929] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:25.507810 1862 log.cc:1199] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/488cc3a082b14dee8f70153e6f2925a4
I20260617 07:53:25.508163 1862 ts_tablet_manager.cc:1950] T 488cc3a082b14dee8f70153e6f2925a4 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:25.508906 1862 tablet_replica.cc:333] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.512346 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 488cc3a082b14dee8f70153e6f2925a4 (table default.Table_43f3f6d0ce9c485d90bac2d86ec29f39 [id=ab7b996d094f49df9532f308d8615d08]) successfully deleted
I20260617 07:53:25.509850 2709 consensus_queue.cc:1048] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:25.513044 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb8fbb44e6147be8c9605be886a8aea" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:25.513361 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 56e089af99464471b4d5482c3364d20f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56e089af99464471b4d5482c3364d20f already in progress: creating tablet
I20260617 07:53:25.513401 2861 raft_consensus.cc:493] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:25.512789 898 tablet_service.cc:1511] Processing CreateTablet for tablet 326b2d87b68f441fbe06691341f746f7 (DEFAULT_TABLE table=default.Table_269e9513ae2943ddaf7ee4ecc2a21ab2 [id=0eedf173f9ee4ee49b0cbfeb07a1f67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.513515 2861 raft_consensus.cc:515] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:25.513626 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet b62ae096bfd347029ef8d7f0462dd111 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b62ae096bfd347029ef8d7f0462dd111 already in progress: creating tablet
W20260617 07:53:25.513844 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet a4a35e3b7bb74667aa498c58a856cacc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4a35e3b7bb74667aa498c58a856cacc already in progress: creating tablet
I20260617 07:53:25.513924 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326b2d87b68f441fbe06691341f746f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.514153 2861 leader_election.cc:290] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:25.514761 716 leader_election.cc:343] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: d8b83fda0ce74779b4cca2ffd2a9b903
W20260617 07:53:25.515266 852 leader_election.cc:343] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.516095 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b83fda0ce74779b4cca2ffd2a9b903" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
W20260617 07:53:25.516446 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 83878d63683d49a6836ed0f925397e61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83878d63683d49a6836ed0f925397e61 already in progress: creating tablet
I20260617 07:53:25.516404 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 326b2d87b68f441fbe06691341f746f7 (DEFAULT_TABLE table=default.Table_269e9513ae2943ddaf7ee4ecc2a21ab2 [id=0eedf173f9ee4ee49b0cbfeb07a1f67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.516784 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326b2d87b68f441fbe06691341f746f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:25.516832 713 leader_election.cc:343] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Illegal state: Tablet not RUNNING: STOPPED
I20260617 07:53:25.516958 713 leader_election.cc:304] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:25.517207 2861 raft_consensus.cc:2749] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:25.512502 887 tablet_service.cc:1511] Processing CreateTablet for tablet a32f221925ef4b63abe3955027dd24c7 (DEFAULT_TABLE table=default.Table_371edc94a4fe40deb6394344e8ead730 [id=8c7daf1c5aaf4f8e90ec9de4f495ded0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.519219 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f221925ef4b63abe3955027dd24c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.522500 1014 tablet_service.cc:1511] Processing CreateTablet for tablet a32f221925ef4b63abe3955027dd24c7 (DEFAULT_TABLE table=default.Table_371edc94a4fe40deb6394344e8ead730 [id=8c7daf1c5aaf4f8e90ec9de4f495ded0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.522997 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f221925ef4b63abe3955027dd24c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.524802 745 tablet_service.cc:1511] Processing CreateTablet for tablet 877effc0ba8d40a38c9b6da146d8920f (DEFAULT_TABLE table=default.Table_26d9fe80577d4be283ec3e7dfe2fae45 [id=d58caac298f84cc6a8c14560f636e637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.525177 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877effc0ba8d40a38c9b6da146d8920f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.525218 1170 ts_tablet_manager.cc:1929] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:25.525300 1170 log.cc:1199] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d8b83fda0ce74779b4cca2ffd2a9b903
I20260617 07:53:25.526296 879 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb5a39c29f54f4c973412b8845b4b01 (DEFAULT_TABLE table=default.Table_49d8c7380b994564bafb7bb0440015b1 [id=bc05436342e8430f8027ce84c75c91d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.526638 883 tablet_service.cc:1511] Processing CreateTablet for tablet 24c64757a60e40429413bb9b20bff7f9 (DEFAULT_TABLE table=default.Table_143edf6137ce4646bda2af36a72fd7af [id=6090035329da4299ba68a3a299423768]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.529001 2899 tablet.cc:1724] T e3275c99834f404f84b96fcc7944cd00 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 07:53:25.530843 1862 raft_consensus.cc:2243] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:25.531057 1862 pending_rounds.cc:70] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:25.531095 1862 pending_rounds.cc:77] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772769033535488 op_type: NO_OP noop_request { }
I20260617 07:53:25.531172 1862 raft_consensus.cc:2889] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:25.531116 2856 tablet.cc:1724] T e3275c99834f404f84b96fcc7944cd00 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 07:53:25.531258 1862 raft_consensus.cc:2272] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.532230 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 24c64757a60e40429413bb9b20bff7f9 (DEFAULT_TABLE table=default.Table_143edf6137ce4646bda2af36a72fd7af [id=6090035329da4299ba68a3a299423768]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.532593 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c64757a60e40429413bb9b20bff7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.534607 742 tablet_service.cc:1511] Processing CreateTablet for tablet 24c64757a60e40429413bb9b20bff7f9 (DEFAULT_TABLE table=default.Table_143edf6137ce4646bda2af36a72fd7af [id=6090035329da4299ba68a3a299423768]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.535100 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c64757a60e40429413bb9b20bff7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.538019 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb5a39c29f54f4c973412b8845b4b01 (DEFAULT_TABLE table=default.Table_49d8c7380b994564bafb7bb0440015b1 [id=bc05436342e8430f8027ce84c75c91d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.538405 2629 raft_consensus.cc:493] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.538473 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb5a39c29f54f4c973412b8845b4b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.538630 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb5a39c29f54f4c973412b8845b4b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.538525 2629 raft_consensus.cc:515] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.538986 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c64757a60e40429413bb9b20bff7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.539170 2629 leader_election.cc:290] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.539485 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet c31e808cf0604b3099230d8c2e0d609e
I20260617 07:53:25.545114 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8ffe940130474ca09d3680e470918a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.545760 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet c31e808cf0604b3099230d8c2e0d609e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:25.545796 986 leader_election.cc:343] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.546010 745 tablet_service.cc:1558] Processing DeleteTablet for tablet c31e808cf0604b3099230d8c2e0d609e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.547297 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet cc8bf9876afc48bf81bf3020701a2939
I20260617 07:53:25.547351 1862 ts_tablet_manager.cc:1916] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.548604 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8bf9876afc48bf81bf3020701a2939 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.549292 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ded53073ce884013b1b0ab3cd23849e1
I20260617 07:53:25.549851 2861 raft_consensus.cc:493] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.549949 460 master_service.cc:960] ReplaceTablet: received request to replace tablet f659b794a08745d2a111016332e604b8 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:25.549998 2861 raft_consensus.cc:515] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.550630 2861 leader_election.cc:290] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:25.551771 716 leader_election.cc:343] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 65bf5384ec244d36ba3d4e781c5eb8a3
W20260617 07:53:25.553009 713 leader_election.cc:343] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 65bf5384ec244d36ba3d4e781c5eb8a3
I20260617 07:53:25.553125 713 leader_election.cc:304] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:25.553493 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet ded53073ce884013b1b0ab3cd23849e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.553745 1170 ts_tablet_manager.cc:1950] T d8b83fda0ce74779b4cca2ffd2a9b903 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.554293 2861 raft_consensus.cc:2749] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.554489 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 542) took 3796 ms. Trace:
I20260617 07:53:25.555166 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_6af87dd49de84cf98ec173dc808e8c1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.555929 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6af87dd49de84cf98ec173dc808e8c1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.558656 458 catalog_manager.cc:5696] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:25.559404 458 catalog_manager.cc:5696] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:25.560107 458 catalog_manager.cc:5696] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:25.560776 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_4afb3bd966014d8dad4fc839499c4170"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.561389 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4afb3bd966014d8dad4fc839499c4170 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.562232 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_30c725b6fb74488092e2d1ca6c8e31c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.562775 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30c725b6fb74488092e2d1ca6c8e31c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.563472 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet a900aecf46e4430cb7ccdecd54376193 (table default.Table_f8fdaf8ec0fa40559b6b78c88b53dc12 [id=6f01f358e78946148639240e134b48e0]). Expected version 1 got 0
I20260617 07:53:25.563967 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 979087485af94e159d3d0f2cb873899e (table default.Table_5238d7f8a8b649df9298e622257465f5 [id=7a23152402da4e608156935807a7b61b]). Expected version 1 got 0
I20260617 07:53:25.564631 457 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1b8ffe940130474ca09d3680e470918a (table default.Table_db0d2ffd1da141af81f7841dbe39b064 [id=36382a6d7a5b4ad4b40d94994f91f627]). Expected version 2 got 0
I20260617 07:53:25.564708 2775 raft_consensus.cc:493] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.564352 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8f5d892448b24a808ff432a9d8f85bdc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:25.564844 2775 raft_consensus.cc:515] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:25.565141 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f5d892448b24a808ff432a9d8f85bdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.565284 883 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8bf9876afc48bf81bf3020701a2939 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.565446 2775 leader_election.cc:290] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.565840 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8ffe940130474ca09d3680e470918a" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:25.566576 879 tablet_service.cc:1558] Processing DeleteTablet for tablet ded53073ce884013b1b0ab3cd23849e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.566751 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e757e6f4ce4c6eb8223c4b6955245e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.570052 852 leader_election.cc:343] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.571687 887 tablet_service.cc:1558] Processing DeleteTablet for tablet c31e808cf0604b3099230d8c2e0d609e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.573558 2898 tablet.cc:1724] T e3275c99834f404f84b96fcc7944cd00 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 07:53:25.566207 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e757e6f4ce4c6eb8223c4b6955245e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.574200 1051 raft_consensus.cc:2468] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:25.574472 1170 rpcz_store.cc:276] 0617 07:53:21.757770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.770616 (+ 12846us) service_pool.cc:224] Handling call
0617 07:53:25.492383 (+3721767us) ts_tablet_manager.cc:1151] Deleting tablet d8b83fda0ce74779b4cca2ffd2a9b903
0617 07:53:25.492391 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.509108 (+ 16717us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.525168 (+ 16060us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.554470 (+ 29302us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3721554}
I20260617 07:53:25.575002 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]) successfully deleted
I20260617 07:53:25.576301 1170 tablet_replica.cc:333] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:25.566552 988 leader_election.cc:343] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.571615 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e8e9692227147d6a8c6854133941b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.573228 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 5942eea42c7541349ad7b6560e6777c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ffa87a4304b43a89be0faa3c5ce0b2c) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.576545 988 leader_election.cc:304] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.577185 2629 raft_consensus.cc:2749] T 1b8ffe940130474ca09d3680e470918a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.577239 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 67cd66ea6ebc42bda00fbec82da73f16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.577651 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.577049 851 leader_election.cc:304] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.578195 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.578104 2709 raft_consensus.cc:2804] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:25.578413 2709 raft_consensus.cc:493] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:25.578522 2709 raft_consensus.cc:3060] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.578904 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 9436fb7fca094eaab925748e254b1a62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.579411 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet e897b111e65c497591c7daaa81d783c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.576546 1170 raft_consensus.cc:2243] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.582734 1172 ts_tablet_manager.cc:1434] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.199s user 0.001s sys 0.001s
W20260617 07:53:25.587972 852 consensus_peers.cc:597] T 1cdf8f714539449d8862cd2a2336fbe9 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:25.588600 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.590363 1170 raft_consensus.cc:2272] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.591413 1170 ts_tablet_manager.cc:1916] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.592147 1172 tablet_bootstrap.cc:492] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.596393 744 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb5a39c29f54f4c973412b8845b4b01 (DEFAULT_TABLE table=default.Table_49d8c7380b994564bafb7bb0440015b1 [id=bc05436342e8430f8027ce84c75c91d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.596774 1171 tablet_bootstrap.cc:492] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.596943 1171 ts_tablet_manager.cc:1403] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.268s user 0.032s sys 0.035s
I20260617 07:53:25.597288 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb5a39c29f54f4c973412b8845b4b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.597579 1171 raft_consensus.cc:359] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.597805 1171 raft_consensus.cc:385] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.597882 1171 raft_consensus.cc:740] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.598097 1171 consensus_queue.cc:260] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.598788 1171 ts_tablet_manager.cc:1434] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:25.599074 1171 tablet_bootstrap.cc:492] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:25.600028 2629 raft_consensus.cc:493] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.600158 2629 raft_consensus.cc:515] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.600752 2629 leader_election.cc:290] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.600813 1171 tablet_bootstrap.cc:654] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.601302 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5942eea42c7541349ad7b6560e6777c8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.601701 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5942eea42c7541349ad7b6560e6777c8" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:25.602190 988 leader_election.cc:343] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:25.602382 986 leader_election.cc:343] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.602495 986 leader_election.cc:304] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.602845 2629 raft_consensus.cc:2749] T 5942eea42c7541349ad7b6560e6777c8 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.607173 887 tablet_service.cc:1511] Processing CreateTablet for tablet 877effc0ba8d40a38c9b6da146d8920f (DEFAULT_TABLE table=default.Table_26d9fe80577d4be283ec3e7dfe2fae45 [id=d58caac298f84cc6a8c14560f636e637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.607748 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 877effc0ba8d40a38c9b6da146d8920f (DEFAULT_TABLE table=default.Table_26d9fe80577d4be283ec3e7dfe2fae45 [id=d58caac298f84cc6a8c14560f636e637]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.607834 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877effc0ba8d40a38c9b6da146d8920f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:25.607826 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 63293.8us
I20260617 07:53:25.608088 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877effc0ba8d40a38c9b6da146d8920f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.608640 742 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8bf9876afc48bf81bf3020701a2939 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.608840 748 tablet_service.cc:1558] Processing DeleteTablet for tablet ded53073ce884013b1b0ab3cd23849e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.432372 1846 log.cc:1199] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/f15dcc10552d4747bad436538662bb66
I20260617 07:53:25.609320 1846 ts_tablet_manager.cc:1950] T f15dcc10552d4747bad436538662bb66 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:25.613777 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 717) took 4194 ms. Trace:
I20260617 07:53:25.618363 765 raft_consensus.cc:3060] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.622056 1171 tablet_bootstrap.cc:492] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.617125 1846 rpcz_store.cc:276] 0617 07:53:21.419333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.421345 (+ 2012us) service_pool.cc:224] Handling call
0617 07:53:25.336874 (+3915529us) ts_tablet_manager.cc:1151] Deleting tablet f15dcc10552d4747bad436538662bb66
0617 07:53:25.336886 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.429596 (+ 92710us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.432223 (+ 2627us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.613753 (+181530us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3914184}
I20260617 07:53:25.622189 1171 ts_tablet_manager.cc:1403] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260617 07:53:25.622864 1171 raft_consensus.cc:359] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.622974 1846 tablet_replica.cc:333] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:25.623056 1171 raft_consensus.cc:385] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.623126 1171 raft_consensus.cc:740] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.623359 1171 consensus_queue.cc:260] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.623836 1171 ts_tablet_manager.cc:1434] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:25.624298 1171 tablet_bootstrap.cc:492] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:25.625819 1171 tablet_bootstrap.cc:654] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.626730 1862 ts_tablet_manager.cc:1929] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:25.624650 1846 raft_consensus.cc:2243] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.627615 1846 raft_consensus.cc:2272] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.628487 1846 ts_tablet_manager.cc:1916] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.633181 2709 raft_consensus.cc:515] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.642256 1862 log.cc:1199] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/b7d4fc81456445518c1158f912dd2f8f
I20260617 07:53:25.642660 1862 ts_tablet_manager.cc:1950] T b7d4fc81456445518c1158f912dd2f8f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:25.642716 2709 leader_election.cc:290] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.636226 1171 tablet_bootstrap.cc:492] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.642995 1171 ts_tablet_manager.cc:1403] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.003s
I20260617 07:53:25.643657 1171 raft_consensus.cc:359] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.643821 1171 raft_consensus.cc:385] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.643874 1171 raft_consensus.cc:740] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.644049 1171 consensus_queue.cc:260] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.644493 1171 ts_tablet_manager.cc:1434] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260617 07:53:25.644804 1171 tablet_bootstrap.cc:492] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:25.641047 2856 tablet.cc:1724] T 2777cf575a914f59b3459f3ce96f5d9a P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:25.643095 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e757e6f4ce4c6eb8223c4b6955245e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:25.647143 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e757e6f4ce4c6eb8223c4b6955245e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
W20260617 07:53:25.647208 852 leader_election.cc:343] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.647318 1051 raft_consensus.cc:3060] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.648708 1171 tablet_bootstrap.cc:654] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.649924 1051 raft_consensus.cc:2468] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:25.650405 851 leader_election.cc:304] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.650836 2709 raft_consensus.cc:2804] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:25.650951 2709 raft_consensus.cc:697] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:25.651166 2709 consensus_queue.cc:237] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.651659 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet b7d4fc81456445518c1158f912dd2f8f (table default.Table_acb19b0a19f54fe9a4be9d22be8f44b7 [id=18b40cd6665e42f793ddb27a1dacbe73]) successfully deleted
I20260617 07:53:25.652591 2629 raft_consensus.cc:493] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.652710 2629 raft_consensus.cc:515] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.653244 2629 leader_election.cc:290] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.654058 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db4fdde370e4d30bbf14285923644a1" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.654662 986 leader_election.cc:343] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.655752 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db4fdde370e4d30bbf14285923644a1" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:25.656656 988 leader_election.cc:343] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.656751 988 leader_election.cc:304] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.658669 2729 raft_consensus.cc:2749] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.658819 2729 raft_consensus.cc:493] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.658913 2729 raft_consensus.cc:515] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.659456 2729 leader_election.cc:290] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.660156 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b1b128ce484d9ab371fa3c5edc6ea6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:25.660454 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b1b128ce484d9ab371fa3c5edc6ea6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.661063 988 leader_election.cc:343] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:25.661293 986 leader_election.cc:343] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.661387 986 leader_election.cc:304] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:25.661458 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 047da1717bf545a9b3a23a9d9136f66f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 047da1717bf545a9b3a23a9d9136f66f already in progress: creating tablet
I20260617 07:53:25.661798 2729 raft_consensus.cc:2749] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.661940 2729 raft_consensus.cc:493] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.662047 2729 raft_consensus.cc:515] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.662590 2729 leader_election.cc:290] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.663087 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436fb7fca094eaab925748e254b1a62" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:25.663259 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436fb7fca094eaab925748e254b1a62" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.663623 988 leader_election.cc:343] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:25.663751 986 leader_election.cc:343] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.663869 986 leader_election.cc:304] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.664237 2629 raft_consensus.cc:2749] T 9436fb7fca094eaab925748e254b1a62 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.664662 1171 tablet_bootstrap.cc:492] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.664865 1171 ts_tablet_manager.cc:1403] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.003s
I20260617 07:53:25.666052 1178 tablet_bootstrap.cc:492] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:25.666185 1178 ts_tablet_manager.cc:1403] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.333s user 0.002s sys 0.006s
I20260617 07:53:25.666965 1862 tablet_replica.cc:333] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.666901 1178 raft_consensus.cc:359] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.667048 1178 raft_consensus.cc:385] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.667095 1178 raft_consensus.cc:740] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.667296 1178 consensus_queue.cc:260] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.667809 1178 ts_tablet_manager.cc:1434] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:25.668087 1178 tablet_bootstrap.cc:492] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:25.669802 1178 tablet_bootstrap.cc:654] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.667162 1862 raft_consensus.cc:2243] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.675611 1171 raft_consensus.cc:359] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.675884 1171 raft_consensus.cc:385] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.675989 1171 raft_consensus.cc:740] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.676272 1171 consensus_queue.cc:260] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.676836 1171 ts_tablet_manager.cc:1434] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:25.678086 1171 tablet_bootstrap.cc:492] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:25.679325 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 3ec0ac6bf0cf445293553691d902033b
I20260617 07:53:25.679541 1171 tablet_bootstrap.cc:654] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.682693 1862 raft_consensus.cc:2272] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.683421 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet f659b794a08745d2a111016332e604b8
I20260617 07:53:25.686878 1170 ts_tablet_manager.cc:1929] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 07:53:25.687040 1170 log.cc:1199] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/a6f90a0d37cb483faa540451bf4dbe85
I20260617 07:53:25.687475 1170 ts_tablet_manager.cc:1950] T a6f90a0d37cb483faa540451bf4dbe85 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.687460 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:25.688344 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 543) took 3884 ms. Trace:
I20260617 07:53:25.688436 1170 rpcz_store.cc:276] 0617 07:53:21.803556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.805466 (+ 1910us) service_pool.cc:224] Handling call
0617 07:53:25.575332 (+3769866us) ts_tablet_manager.cc:1151] Deleting tablet a6f90a0d37cb483faa540451bf4dbe85
0617 07:53:25.575343 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.627242 (+ 51899us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.686810 (+ 59568us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.688319 (+ 1509us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3768952}
I20260617 07:53:25.688882 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 544) took 3853 ms. Trace:
I20260617 07:53:25.688953 1170 rpcz_store.cc:276] 0617 07:53:21.835810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.839842 (+ 4032us) service_pool.cc:224] Handling call
0617 07:53:25.688744 (+3848902us) ts_tablet_manager.cc:1151] Deleting tablet 2c60d917996341109ae66b9af24f6cb4
0617 07:53:25.688757 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.688864 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3848588}
I20260617 07:53:25.689296 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 545) took 3822 ms. Trace:
I20260617 07:53:25.689363 1170 rpcz_store.cc:276] 0617 07:53:21.866720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.868399 (+ 1679us) service_pool.cc:224] Handling call
0617 07:53:25.689185 (+3820786us) ts_tablet_manager.cc:1151] Deleting tablet ed5563cfe75940168702bf237d8647cd
0617 07:53:25.689195 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.689281 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3820466}
I20260617 07:53:25.689599 1170 tablet_replica.cc:333] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.689764 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_94e77b59e906420289e6014bb64dd340" } new_table_name: "default.Table_9d767955a4454812817b5d512450193b" modify_external_catalogs: true
W20260617 07:53:25.693382 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7c5ec941f083497380896277365be5c9 consensus state has no leader
I20260617 07:53:25.693828 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_dc7b26c228a74cf59483d84b3b7cd896"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:25.696120 1862 ts_tablet_manager.cc:1916] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:25.696245 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24c64757a60e40429413bb9b20bff7f9 consensus state has no leader
I20260617 07:53:25.696658 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a564737f655341da8a4a4ca4705af0dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:25.697501 1171 tablet_bootstrap.cc:492] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.697628 1171 ts_tablet_manager.cc:1403] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260617 07:53:25.698272 1171 raft_consensus.cc:359] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.698499 1171 raft_consensus.cc:385] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.698611 1171 raft_consensus.cc:740] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.698849 1171 consensus_queue.cc:260] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.700383 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet a6f90a0d37cb483faa540451bf4dbe85 (table default.Table_a760668e4e954d438ebe1331c429627f [id=3d306a3bde784759bd8e3a45fa8cddec]) successfully deleted
I20260617 07:53:25.700537 1171 ts_tablet_manager.cc:1434] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260617 07:53:25.700659 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2c60d917996341109ae66b9af24f6cb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c60d917996341109ae66b9af24f6cb4 already in progress: creating tablet
W20260617 07:53:25.700913 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ed5563cfe75940168702bf237d8647cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed5563cfe75940168702bf237d8647cd already in progress: creating tablet
I20260617 07:53:25.701557 1171 tablet_bootstrap.cc:492] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:25.702862 1171 tablet_bootstrap.cc:654] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.715308 2709 raft_consensus.cc:493] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.715572 2709 raft_consensus.cc:515] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.716706 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14a3cb5e50b42b18ffda6f38cdfdd73" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.716841 2709 leader_election.cc:290] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:25.717406 852 leader_election.cc:343] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.717532 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14a3cb5e50b42b18ffda6f38cdfdd73" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.717823 1051 raft_consensus.cc:2468] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:25.718348 1171 tablet_bootstrap.cc:492] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.718413 851 leader_election.cc:304] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.718525 1171 ts_tablet_manager.cc:1403] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260617 07:53:25.718865 2709 raft_consensus.cc:2804] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:25.718999 2709 raft_consensus.cc:493] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:25.719121 2709 raft_consensus.cc:3060] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.719250 1171 raft_consensus.cc:359] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.719462 1171 raft_consensus.cc:385] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.719549 1171 raft_consensus.cc:740] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.719816 1171 consensus_queue.cc:260] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.721148 1171 ts_tablet_manager.cc:1434] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:25.722237 1171 tablet_bootstrap.cc:492] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:25.723690 1171 tablet_bootstrap.cc:654] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.723291 2709 raft_consensus.cc:515] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.729784 1170 raft_consensus.cc:2243] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.733278 1170 raft_consensus.cc:2272] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.737490 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0da48fe3fdde4465a7439aba33ec5d15" } new_table_name: "default.Table_5bd1190146104a0a8688fb382c963a75" modify_external_catalogs: true
I20260617 07:53:25.738873 879 tablet_service.cc:1511] Processing CreateTablet for tablet 2b039642779b400585fcf4133d5b19b1 (DEFAULT_TABLE table=default.Table_232d7a605a2843cbb5ff6907fd1cf808 [id=a74ccbd79b7a489597054e1b40f16ca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.739970 883 tablet_service.cc:1511] Processing CreateTablet for tablet 106e5bb1a0e44a9abb4b94e9db4623ce (DEFAULT_TABLE table=default.Table_3505000e2b554bbbb5f2f22603a741e2 [id=b0efb63af0ac4fd1ac81994b2a61d401]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.740617 460 catalog_manager.cc:6784] ReplaceTablet: tablet f659b794a08745d2a111016332e604b8 deleted and replaced by tablet 741e986ebfb2428ba2bd08c145a6df61
I20260617 07:53:25.741007 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_791c961f99a042ceb156fb16875c9a0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.741602 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_791c961f99a042ceb156fb16875c9a0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.741746 898 tablet_service.cc:1558] Processing DeleteTablet for tablet f659b794a08745d2a111016332e604b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 741e986ebfb2428ba2bd08c145a6df61) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.743487 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0b652f051b410b86c85c84fff86e58 (DEFAULT_TABLE table=default.Table_f09297492f89469786c6549162e1b05a [id=55b27ac369b24b98a42e58deb1d7bac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.743655 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ec0ac6bf0cf445293553691d902033b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.744031 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 2b039642779b400585fcf4133d5b19b1 (DEFAULT_TABLE table=default.Table_232d7a605a2843cbb5ff6907fd1cf808 [id=a74ccbd79b7a489597054e1b40f16ca6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:25.744170 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a564737f655341da8a4a4ca4705af0dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.744385 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b039642779b400585fcf4133d5b19b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.744992 884 tablet_service.cc:1511] Processing CreateTablet for tablet b1f90dbdb633479290270579125126c9 (DEFAULT_TABLE table=default.Table_934c26f5636144099ec19d04a50b090a [id=925a81d161e640488bfac01b3d76f94a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:25.745268 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc7b26c228a74cf59483d84b3b7cd896 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.745955 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 106e5bb1a0e44a9abb4b94e9db4623ce (DEFAULT_TABLE table=default.Table_3505000e2b554bbbb5f2f22603a741e2 [id=b0efb63af0ac4fd1ac81994b2a61d401]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.746256 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106e5bb1a0e44a9abb4b94e9db4623ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.746721 1170 ts_tablet_manager.cc:1916] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.749310 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0b652f051b410b86c85c84fff86e58 (DEFAULT_TABLE table=default.Table_f09297492f89469786c6549162e1b05a [id=55b27ac369b24b98a42e58deb1d7bac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.749647 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14a3cb5e50b42b18ffda6f38cdfdd73" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:25.749850 1051 raft_consensus.cc:3060] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.750546 2709 leader_election.cc:290] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.750872 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14a3cb5e50b42b18ffda6f38cdfdd73" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:25.751528 1172 tablet_bootstrap.cc:654] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.752713 1051 raft_consensus.cc:2468] T f14a3cb5e50b42b18ffda6f38cdfdd73 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:25.753233 851 leader_election.cc:304] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:25.753616 2709 raft_consensus.cc:2804] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:25.753875 2709 raft_consensus.cc:697] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:25.754114 1018 tablet_service.cc:1558] Processing DeleteTablet for tablet f659b794a08745d2a111016332e604b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 741e986ebfb2428ba2bd08c145a6df61) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.754182 2709 consensus_queue.cc:237] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.754639 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0b652f051b410b86c85c84fff86e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.756058 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet f15dcc10552d4747bad436538662bb66 (table default.Table_f1b008ef7b254737ab725b7bb9ffd48d [id=6dc33e63e97d46aba866c6ef9a87ba2b]) successfully deleted
I20260617 07:53:25.756474 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ec0ac6bf0cf445293553691d902033b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.758486 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ec0ac6bf0cf445293553691d902033b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.758695 742 tablet_service.cc:1511] Processing CreateTablet for tablet 106e5bb1a0e44a9abb4b94e9db4623ce (DEFAULT_TABLE table=default.Table_3505000e2b554bbbb5f2f22603a741e2 [id=b0efb63af0ac4fd1ac81994b2a61d401]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.758836 758 tablet_service.cc:1511] Processing CreateTablet for tablet b1f90dbdb633479290270579125126c9 (DEFAULT_TABLE table=default.Table_934c26f5636144099ec19d04a50b090a [id=925a81d161e640488bfac01b3d76f94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.759064 756 tablet_service.cc:1558] Processing DeleteTablet for tablet f659b794a08745d2a111016332e604b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 741e986ebfb2428ba2bd08c145a6df61) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.759405 745 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0b652f051b410b86c85c84fff86e58 (DEFAULT_TABLE table=default.Table_f09297492f89469786c6549162e1b05a [id=55b27ac369b24b98a42e58deb1d7bac5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:25.759779 852 leader_election.cc:343] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.762145 744 tablet_service.cc:1511] Processing CreateTablet for tablet 2b039642779b400585fcf4133d5b19b1 (DEFAULT_TABLE table=default.Table_232d7a605a2843cbb5ff6907fd1cf808 [id=a74ccbd79b7a489597054e1b40f16ca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.762342 1171 tablet_bootstrap.cc:492] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.762491 1171 ts_tablet_manager.cc:1403] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.002s
I20260617 07:53:25.767277 2629 raft_consensus.cc:493] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.767433 2629 raft_consensus.cc:515] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.768056 2629 leader_election.cc:290] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.768630 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8cd6ff8fa44536acdd84a107ab1525" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.771225 986 leader_election.cc:343] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.771229 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8cd6ff8fa44536acdd84a107ab1525" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:25.772063 988 leader_election.cc:343] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.772157 988 leader_election.cc:304] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.772516 2629 raft_consensus.cc:2749] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.774976 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106e5bb1a0e44a9abb4b94e9db4623ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.775542 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0b652f051b410b86c85c84fff86e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.775923 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f90dbdb633479290270579125126c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:25.788707 452 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 38168b7946eb487f91cc7dc47eedfcd8 consensus state has no leader
I20260617 07:53:25.788987 452 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f4a8b06f77643dcb28f0c3136510253 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:25.790735 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e657348efd7440349c9bc05f437dd7aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.791343 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e657348efd7440349c9bc05f437dd7aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.792665 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_fe7d438c96ae4f7d845929f138eef545"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.793181 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe7d438c96ae4f7d845929f138eef545 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.794384 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_489156baa9ad47d0b71d7437dec196cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.794894 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_489156baa9ad47d0b71d7437dec196cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.796422 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e90ad53742c6427a87f6e2dfad5f9e54" } modify_external_catalogs: true
I20260617 07:53:25.796593 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_e90ad53742c6427a87f6e2dfad5f9e54" } modify_external_catalogs: true
I20260617 07:53:25.798345 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b039642779b400585fcf4133d5b19b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.799162 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_9b6c04843afa4dea84e4ac76ab7cc48b [id=6a3de6cd076144ecabdfe3c5fe5498bb] alter complete (version 4)
I20260617 07:53:25.800987 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0ebdf4b1d9ba4845958bccb5883ec491" } new_table_name: "default.Table_6e1d6fa3d4c244b5a86ba8377b1367b6" modify_external_catalogs: true
I20260617 07:53:25.803618 455 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_af6270e3aac64c5f83403a481f16f0fc" } modify_external_catalogs: true
I20260617 07:53:25.803813 455 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_af6270e3aac64c5f83403a481f16f0fc" } modify_external_catalogs: true
I20260617 07:53:25.805869 1846 ts_tablet_manager.cc:1929] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 07:53:25.805941 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8fd650978f1f476f81cdd48faa9f9b0e" } modify_external_catalogs: true
I20260617 07:53:25.806134 1846 log.cc:1199] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/cc4d21f9ad9543b0b90fc66f1a6e3b13
I20260617 07:53:25.806105 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8fd650978f1f476f81cdd48faa9f9b0e" } modify_external_catalogs: true
I20260617 07:53:25.809794 1846 ts_tablet_manager.cc:1950] T cc4d21f9ad9543b0b90fc66f1a6e3b13 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:25.810616 2629 raft_consensus.cc:493] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.810662 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 720) took 4371 ms. Trace:
I20260617 07:53:25.810746 1846 rpcz_store.cc:276] 0617 07:53:21.438846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.439345 (+ 499us) service_pool.cc:224] Handling call
0617 07:53:25.622913 (+4183568us) ts_tablet_manager.cc:1151] Deleting tablet cc4d21f9ad9543b0b90fc66f1a6e3b13
0617 07:53:25.622929 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.706603 (+ 83674us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.805812 (+ 99209us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.810644 (+ 4832us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4183390}
I20260617 07:53:25.810799 2629 raft_consensus.cc:515] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.811563 2629 leader_election.cc:290] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.811671 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 727) took 4298 ms. Trace:
I20260617 07:53:25.811748 1846 rpcz_store.cc:276] 0617 07:53:21.513284 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.513888 (+ 604us) service_pool.cc:224] Handling call
0617 07:53:25.811544 (+4297656us) ts_tablet_manager.cc:1151] Deleting tablet f249a9d29de54c959dbae1751501daee
0617 07:53:25.811555 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.811654 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4297456}
I20260617 07:53:25.812201 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d846e5951d400ebc4ba6552406c63c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:25.812366 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d846e5951d400ebc4ba6552406c63c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.812415 913 raft_consensus.cc:2468] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 0.
I20260617 07:53:25.812805 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 728) took 4199 ms. Trace:
W20260617 07:53:25.812909 986 leader_election.cc:343] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.812883 1846 rpcz_store.cc:276] 0617 07:53:21.613450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.613509 (+ 59us) service_pool.cc:224] Handling call
0617 07:53:25.812694 (+4199185us) ts_tablet_manager.cc:1151] Deleting tablet 83878d63683d49a6836ed0f925397e61
0617 07:53:25.812705 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.812789 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4198951}
I20260617 07:53:25.813406 988 leader_election.cc:304] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.813812 2629 raft_consensus.cc:2804] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:25.813890 2629 raft_consensus.cc:493] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:25.813954 2629 raft_consensus.cc:3060] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.815132 1015 tablet_service.cc:1511] Processing CreateTablet for tablet b1f90dbdb633479290270579125126c9 (DEFAULT_TABLE table=default.Table_934c26f5636144099ec19d04a50b090a [id=925a81d161e640488bfac01b3d76f94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.815608 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f90dbdb633479290270579125126c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.816545 2629 raft_consensus.cc:515] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.817711 2629 leader_election.cc:290] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.818058 1014 tablet_service.cc:1511] Processing CreateTablet for tablet ee1fb40b39fe4246b1d0d89b444143da (DEFAULT_TABLE table=default.Table_fb378325bac84e01b6f0ac7f7216f632 [id=4b56d62dc4294aeeadfd468ccbe1e76a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.818428 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1fb40b39fe4246b1d0d89b444143da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.818617 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d846e5951d400ebc4ba6552406c63c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba"
I20260617 07:53:25.818786 913 raft_consensus.cc:3060] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.818883 892 tablet_service.cc:1511] Processing CreateTablet for tablet ee1fb40b39fe4246b1d0d89b444143da (DEFAULT_TABLE table=default.Table_fb378325bac84e01b6f0ac7f7216f632 [id=4b56d62dc4294aeeadfd468ccbe1e76a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.818958 885 tablet_service.cc:1511] Processing CreateTablet for tablet dd0022292956415f9c66cb14ef72d846 (DEFAULT_TABLE table=default.Table_3613e9b67ed84a848431deed188ba5f2 [id=e155a26c6ce7479ea8b5667d6d53a058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.821283 913 raft_consensus.cc:2468] T f2d846e5951d400ebc4ba6552406c63c P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc3bec007846459a9da0c7b8211e477b in term 1.
I20260617 07:53:25.822378 1020 tablet_service.cc:1511] Processing CreateTablet for tablet dd0022292956415f9c66cb14ef72d846 (DEFAULT_TABLE table=default.Table_3613e9b67ed84a848431deed188ba5f2 [id=e155a26c6ce7479ea8b5667d6d53a058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.822727 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0022292956415f9c66cb14ef72d846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.824963 988 leader_election.cc:304] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:25.825279 2629 raft_consensus.cc:2804] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:25.825701 2629 raft_consensus.cc:697] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Becoming Leader. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Running, Role: LEADER
I20260617 07:53:25.825977 2629 consensus_queue.cc:237] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.825978 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d846e5951d400ebc4ba6552406c63c" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
W20260617 07:53:25.826604 986 leader_election.cc:343] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.828719 887 tablet_service.cc:1558] Processing DeleteTablet for tablet beb8fbb44e6147be8c9605be886a8aea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.831799 1172 tablet_bootstrap.cc:492] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.831990 1172 ts_tablet_manager.cc:1403] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.240s user 0.004s sys 0.000s
I20260617 07:53:25.781260 1171 raft_consensus.cc:359] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.832545 1171 raft_consensus.cc:385] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.832644 1171 raft_consensus.cc:740] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.833837 457 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1cdf8f714539449d8862cd2a2336fbe9 (table default.Table_f0b12a6999e7444cb768e6f57b809481 [id=a9cd6e01bc8e4d3db42dc5b57fe60d07]). Expected version 1 got 0
I20260617 07:53:25.834409 457 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_0a3622a666594847848eb4982fd1316a [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 3 got 0
I20260617 07:53:25.834787 457 catalog_manager.cc:5696] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
W20260617 07:53:25.835872 446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:36505, user_credentials={real_user=slave}} blocked reactor thread for 78920.4us
I20260617 07:53:25.836556 1172 raft_consensus.cc:359] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.836859 1172 raft_consensus.cc:385] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.836973 1172 raft_consensus.cc:740] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.837283 1172 consensus_queue.cc:260] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.838647 1172 ts_tablet_manager.cc:1434] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:25.839057 745 tablet_service.cc:1511] Processing CreateTablet for tablet dd0022292956415f9c66cb14ef72d846 (DEFAULT_TABLE table=default.Table_3613e9b67ed84a848431deed188ba5f2 [id=e155a26c6ce7479ea8b5667d6d53a058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.840006 1172 tablet_bootstrap.cc:492] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:25.840037 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0022292956415f9c66cb14ef72d846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.841930 1172 tablet_bootstrap.cc:654] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.834021 879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b039642779b400585fcf4133d5b19b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.842417 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f90dbdb633479290270579125126c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.842610 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0022292956415f9c66cb14ef72d846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.845839 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 106e5bb1a0e44a9abb4b94e9db4623ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.847025 2898 tablet.cc:1724] T ce1cb2c879e6451886c55907678792de P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:25.847616 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0b652f051b410b86c85c84fff86e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.848188 1171 consensus_queue.cc:260] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.848663 1171 ts_tablet_manager.cc:1434] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.086s user 0.001s sys 0.001s
I20260617 07:53:25.848951 1171 tablet_bootstrap.cc:492] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:25.850927 1171 tablet_bootstrap.cc:654] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.852746 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1fb40b39fe4246b1d0d89b444143da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.854475 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet cc4d21f9ad9543b0b90fc66f1a6e3b13 (table default.Table_af123e58c8214911af3d01a540b8f135 [id=3824f4c443804be49d851e39e23ce3f7]) successfully deleted
W20260617 07:53:25.855175 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f249a9d29de54c959dbae1751501daee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f249a9d29de54c959dbae1751501daee already in progress: creating tablet
W20260617 07:53:25.855422 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 83878d63683d49a6836ed0f925397e61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83878d63683d49a6836ed0f925397e61 already in progress: creating tablet
I20260617 07:53:25.834110 1862 ts_tablet_manager.cc:1929] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 07:53:25.839654 852 consensus_peers.cc:597] T 24066965db7141a6a970ec08f835a820 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260617 07:53:25.857024 2856 tablet.cc:1724] T ce1cb2c879e6451886c55907678792de P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:25.857342 2774 raft_consensus.cc:493] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.857460 2774 raft_consensus.cc:515] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.858018 2774 leader_election.cc:290] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.858531 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03a26e301e747febc4d5bafdc1a49c6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:25.859226 1178 tablet_bootstrap.cc:492] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:25.859365 1178 ts_tablet_manager.cc:1403] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.191s user 0.000s sys 0.003s
W20260617 07:53:25.859411 852 leader_election.cc:343] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.859599 1862 log.cc:1199] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/037539021d1743bb9a66403b8a01662f
I20260617 07:53:25.859982 1862 ts_tablet_manager.cc:1950] T 037539021d1743bb9a66403b8a01662f P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:25.860222 1178 raft_consensus.cc:359] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.860365 1178 raft_consensus.cc:385] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.860412 1178 raft_consensus.cc:740] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.860642 1178 consensus_queue.cc:260] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.861411 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03a26e301e747febc4d5bafdc1a49c6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.861491 1862 tablet_replica.cc:333] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:25.861604 1046 raft_consensus.cc:2468] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:25.861666 1862 raft_consensus.cc:2243] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:25.861882 1862 pending_rounds.cc:70] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:25.861994 1862 pending_rounds.cc:77] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772771944386560 op_type: NO_OP noop_request { }
I20260617 07:53:25.862130 851 leader_election.cc:304] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.862561 2774 raft_consensus.cc:2804] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:25.862641 2774 raft_consensus.cc:493] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:25.862699 2774 raft_consensus.cc:3060] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.863600 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 037539021d1743bb9a66403b8a01662f (table default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]) successfully deleted
W20260617 07:53:25.863860 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c6b85e7ed0a64c128de5cc48c4d4435f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6b85e7ed0a64c128de5cc48c4d4435f already in progress: creating tablet
I20260617 07:53:25.865000 2774 raft_consensus.cc:515] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.865888 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03a26e301e747febc4d5bafdc1a49c6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:25.866010 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03a26e301e747febc4d5bafdc1a49c6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:25.866173 1046 raft_consensus.cc:3060] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:25.866365 852 leader_election.cc:343] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.867065 1178 ts_tablet_manager.cc:1434] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260617 07:53:25.868582 1046 raft_consensus.cc:2468] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:25.869201 2774 leader_election.cc:290] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.869513 851 leader_election.cc:304] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.869985 2774 raft_consensus.cc:2804] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:25.870381 2774 raft_consensus.cc:697] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:25.870694 2774 consensus_queue.cc:237] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.873163 744 tablet_service.cc:1511] Processing CreateTablet for tablet ee1fb40b39fe4246b1d0d89b444143da (DEFAULT_TABLE table=default.Table_fb378325bac84e01b6f0ac7f7216f632 [id=4b56d62dc4294aeeadfd468ccbe1e76a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.874388 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1fb40b39fe4246b1d0d89b444143da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.877440 1178 tablet_bootstrap.cc:492] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:25.883190 1846 tablet_replica.cc:333] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:25.862133 1862 raft_consensus.cc:2889] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:25.883980 1846 raft_consensus.cc:2243] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.884285 1862 raft_consensus.cc:2272] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.891135 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_deda97e12ba647f29d61a0ab49f6d3a7" } modify_external_catalogs: true
I20260617 07:53:25.892377 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_deda97e12ba647f29d61a0ab49f6d3a7" } modify_external_catalogs: true
I20260617 07:53:25.903635 2899 tablet.cc:1724] T ce1cb2c879e6451886c55907678792de P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:25.894160 2709 raft_consensus.cc:493] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.926723 2709 raft_consensus.cc:515] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.927412 1862 ts_tablet_manager.cc:1916] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.927564 2709 leader_election.cc:290] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.929519 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1382fc75785e4b07bf1688fa5385500a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:25.929739 1051 raft_consensus.cc:2468] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:25.930239 851 leader_election.cc:304] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:25.904632 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fcf87953dc14bf190ac74101547e52f with delete_type TABLET_DATA_DELETED (replaced by tablet 67cd66ea6ebc42bda00fbec82da73f16) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.930545 2775 raft_consensus.cc:2804] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:25.930642 2775 raft_consensus.cc:493] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:25.930698 1846 raft_consensus.cc:2272] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.930739 2775 raft_consensus.cc:3060] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.931262 1846 ts_tablet_manager.cc:1916] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.910256 1178 tablet_bootstrap.cc:654] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.928642 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1382fc75785e4b07bf1688fa5385500a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.933596 852 leader_election.cc:343] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.935562 2775 raft_consensus.cc:515] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.936609 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1382fc75785e4b07bf1688fa5385500a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:25.936786 1051 raft_consensus.cc:3060] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:25.938221 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1382fc75785e4b07bf1688fa5385500a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:25.938335 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4076d3e53fc247d18b63d1b1fd665399 (DEFAULT_TABLE table=default.Table_444ae499f85c4d64948904dcaa1e9884 [id=c5df6d91d6c04027848ff8890e2833d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.938700 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4076d3e53fc247d18b63d1b1fd665399. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:25.938879 852 leader_election.cc:343] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.940740 1051 raft_consensus.cc:2468] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:25.941126 851 leader_election.cc:304] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:25.941689 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 4076d3e53fc247d18b63d1b1fd665399 (DEFAULT_TABLE table=default.Table_444ae499f85c4d64948904dcaa1e9884 [id=c5df6d91d6c04027848ff8890e2833d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.944037 745 tablet_service.cc:1511] Processing CreateTablet for tablet 4076d3e53fc247d18b63d1b1fd665399 (DEFAULT_TABLE table=default.Table_444ae499f85c4d64948904dcaa1e9884 [id=c5df6d91d6c04027848ff8890e2833d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:25.944417 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4076d3e53fc247d18b63d1b1fd665399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:25.945959 2710 raft_consensus.cc:2804] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:25.946211 2710 raft_consensus.cc:697] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:25.946238 2629 raft_consensus.cc:493] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.946374 2629 raft_consensus.cc:515] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.946528 2710 consensus_queue.cc:237] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.946959 2629 leader_election.cc:290] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:25.947786 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737e9344fc824714a2c2596170637158" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:25.948216 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737e9344fc824714a2c2596170637158" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:25.949020 986 leader_election.cc:343] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:25.950098 988 leader_election.cc:343] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:25.950197 988 leader_election.cc:304] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:25.950469 1178 tablet_bootstrap.cc:492] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:25.950596 1178 ts_tablet_manager.cc:1403] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.000s
I20260617 07:53:25.951419 2629 raft_consensus.cc:2749] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:25.951582 1178 raft_consensus.cc:359] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.951798 1178 raft_consensus.cc:385] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.951843 1178 raft_consensus.cc:740] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.952014 1178 consensus_queue.cc:260] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.952483 1178 ts_tablet_manager.cc:1434] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:25.952513 2709 raft_consensus.cc:493] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:25.952513 2775 leader_election.cc:290] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:25.952661 2709 raft_consensus.cc:515] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.953195 2709 leader_election.cc:290] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:25.955305 851 leader_election.cc:343] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: d965aa4e8dc244cdb93dd15cdee9070c
W20260617 07:53:25.959434 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 73346.2us
I20260617 07:53:25.962777 453 catalog_manager.cc:5696] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b reported cstate change: term changed from 0 to 1, leader changed from <none> to dc3bec007846459a9da0c7b8211e477b (127.0.105.131). New cstate: current_term: 1 leader_uuid: "dc3bec007846459a9da0c7b8211e477b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: HEALTHY } } }
I20260617 07:53:25.966313 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0ccedc77aa4847729517007c4a956aea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.966980 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ccedc77aa4847729517007c4a956aea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.971016 1172 tablet_bootstrap.cc:492] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:25.971369 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_10b6a1799bb344f0b323fa581c74c027"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:25.971922 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10b6a1799bb344f0b323fa581c74c027 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:25.973824 1172 ts_tablet_manager.cc:1403] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.134s user 0.002s sys 0.017s
I20260617 07:53:25.976047 1170 ts_tablet_manager.cc:1929] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:25.976172 1170 log.cc:1199] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/56c70f5c41e04ad0b913c15aa315353f
I20260617 07:53:25.976504 1170 ts_tablet_manager.cc:1950] T 56c70f5c41e04ad0b913c15aa315353f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:25.977394 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet d7b981da1d2e4862824e933dc8babefc
I20260617 07:53:25.977591 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 546) took 3916 ms. Trace:
I20260617 07:53:25.977664 1170 rpcz_store.cc:276] 0617 07:53:22.061298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.061352 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:25.689556 (+3628204us) ts_tablet_manager.cc:1151] Deleting tablet 56c70f5c41e04ad0b913c15aa315353f
0617 07:53:25.689566 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.881196 (+191630us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.975987 (+ 94791us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:25.977570 (+ 1583us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3627998}
I20260617 07:53:25.978116 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 547) took 3916 ms. Trace:
I20260617 07:53:25.978194 1170 rpcz_store.cc:276] 0617 07:53:22.061800 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.061856 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:25.977998 (+3916142us) ts_tablet_manager.cc:1151] Deleting tablet 543fd8173b174946830d6228e47b2caa
0617 07:53:25.978007 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.978101 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3915923}
I20260617 07:53:25.978427 1170 tablet_replica.cc:333] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:25.978590 1170 raft_consensus.cc:2243] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:25.978747 1170 raft_consensus.cc:2272] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:25.979409 758 tablet_service.cc:1558] Processing DeleteTablet for tablet d7b981da1d2e4862824e933dc8babefc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:25.979722 898 tablet_service.cc:1558] Processing DeleteTablet for tablet d7b981da1d2e4862824e933dc8babefc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:25.980322 1171 tablet_bootstrap.cc:492] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:25.980446 1171 ts_tablet_manager.cc:1403] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.132s user 0.005s sys 0.000s
I20260617 07:53:25.981081 1171 raft_consensus.cc:359] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.981253 1171 raft_consensus.cc:385] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:25.981307 1171 raft_consensus.cc:740] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:25.981503 1171 consensus_queue.cc:260] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:25.981980 1171 ts_tablet_manager.cc:1434] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260617 07:53:25.981961 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]) successfully deleted
I20260617 07:53:25.982260 1171 tablet_bootstrap.cc:492] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:25.982308 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 543fd8173b174946830d6228e47b2caa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 543fd8173b174946830d6228e47b2caa already in progress: creating tablet
I20260617 07:53:25.983822 1171 tablet_bootstrap.cc:654] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:25.996114 1862 ts_tablet_manager.cc:1929] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:26.009855 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d965aa4e8dc244cdb93dd15cdee9070c" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.026292 452 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_66e18dae23c5456d8125c43c3c21fbac" } new_table_name: "default.Table_e91a294b722e4fa78fe4da45cb992b73" modify_external_catalogs: true
I20260617 07:53:26.027868 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_35df243dcbf147028c18e6e47085e771" } new_table_name: "default.Table_474650feb3844fcd98e2e7b6adea7640" modify_external_catalogs: true
I20260617 07:53:26.040499 1846 ts_tablet_manager.cc:1929] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:26.040745 1846 log.cc:1199] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/d8b83fda0ce74779b4cca2ffd2a9b903
I20260617 07:53:26.041260 1846 ts_tablet_manager.cc:1950] T d8b83fda0ce74779b4cca2ffd2a9b903 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:25.979249 1170 ts_tablet_manager.cc:1916] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:25.982983 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet d7b981da1d2e4862824e933dc8babefc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:25.983395 1172 raft_consensus.cc:359] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.041563 1172 raft_consensus.cc:385] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.002305 2629 raft_consensus.cc:493] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.033833 2729 raft_consensus.cc:493] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.041909 1862 log.cc:1199] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/51e757e6f4ce4c6eb8223c4b6955245e
I20260617 07:53:26.041920 2729 raft_consensus.cc:515] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.041886 2629 raft_consensus.cc:515] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.042280 1862 ts_tablet_manager.cc:1950] T 51e757e6f4ce4c6eb8223c4b6955245e P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:26.042508 2729 leader_election.cc:290] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:26.010349 852 leader_election.cc:343] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.041648 1172 raft_consensus.cc:740] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.042714 1862 tablet_replica.cc:333] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:26.042681 852 leader_election.cc:304] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.042886 1862 raft_consensus.cc:2243] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.042877 1172 consensus_queue.cc:260] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.043015 1862 raft_consensus.cc:2272] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.043354 1172 ts_tablet_manager.cc:1434] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.069s user 0.002s sys 0.000s
I20260617 07:53:26.043514 1862 ts_tablet_manager.cc:1916] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.043696 1172 tablet_bootstrap.cc:492] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.043789 2710 raft_consensus.cc:2749] T d965aa4e8dc244cdb93dd15cdee9070c P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.043947 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 51e757e6f4ce4c6eb8223c4b6955245e (table default.Table_69167a2936fa47a08d1f53dfec14f52b [id=8738ee5e888742f9a7c0aa0c9085dc75]) successfully deleted
I20260617 07:53:26.045627 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979087485af94e159d3d0f2cb873899e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.046578 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8e9692227147d6a8c6854133941b44" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.046631 986 leader_election.cc:343] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.042512 2629 leader_election.cc:290] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.048206 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8e9692227147d6a8c6854133941b44" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:26.049398 986 leader_election.cc:343] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.050757 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979087485af94e159d3d0f2cb873899e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:26.058897 852 consensus_peers.cc:597] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:26.061764 1178 tablet_bootstrap.cc:492] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.035840 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4076d3e53fc247d18b63d1b1fd665399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.063704 1178 tablet_bootstrap.cc:654] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.067414 1172 tablet_bootstrap.cc:654] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.070912 1171 tablet_bootstrap.cc:492] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.071072 1171 ts_tablet_manager.cc:1403] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.001s
I20260617 07:53:26.072428 1171 raft_consensus.cc:359] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.072640 1171 raft_consensus.cc:385] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.072688 1171 raft_consensus.cc:740] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.072959 1171 consensus_queue.cc:260] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.073599 1171 ts_tablet_manager.cc:1434] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:26.075911 1171 tablet_bootstrap.cc:492] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:26.078006 1171 tablet_bootstrap.cc:654] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.079787 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 729) took 4316 ms. Trace:
I20260617 07:53:26.079741 2898 tablet.cc:1724] T 70e4068fdcbb41de966bcc72a4d1d426 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:26.079970 1846 rpcz_store.cc:276] 0617 07:53:21.763044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.765859 (+ 2815us) service_pool.cc:224] Handling call
0617 07:53:25.883137 (+4117278us) ts_tablet_manager.cc:1151] Deleting tablet d8b83fda0ce74779b4cca2ffd2a9b903
0617 07:53:25.883147 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:25.987435 (+104288us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.040428 (+ 52993us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.079766 (+ 39338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37714,"tablet-delete.queue_time_us":4117055}
I20260617 07:53:26.080523 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet d8b83fda0ce74779b4cca2ffd2a9b903 (table default.Table_828befbda7ff41f3adf71e43e7adf2e3 [id=8eab4afce86c4e1e99cbc62ae9a2f7a6]) successfully deleted
I20260617 07:53:26.080797 1846 tablet_replica.cc:333] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:26.081014 1846 raft_consensus.cc:2243] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.081111 2856 tablet.cc:1724] T 70e4068fdcbb41de966bcc72a4d1d426 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:26.081405 1846 raft_consensus.cc:2272] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.081976 1846 ts_tablet_manager.cc:1916] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.082454 1172 tablet_bootstrap.cc:492] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.082644 1172 ts_tablet_manager.cc:1403] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.007s
I20260617 07:53:26.083467 1172 raft_consensus.cc:359] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.083702 1172 raft_consensus.cc:385] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.083797 1172 raft_consensus.cc:740] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.084049 1172 consensus_queue.cc:260] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.084558 1172 ts_tablet_manager.cc:1434] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:26.091749 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 01abd7aed0fd4d2b90db9f40029b5b37
I20260617 07:53:26.092509 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_11b717f1db3545778db3e785dec6d463" } modify_external_catalogs: true
I20260617 07:53:26.092731 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_11b717f1db3545778db3e785dec6d463" } modify_external_catalogs: true
I20260617 07:53:26.092823 459 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_5bd1190146104a0a8688fb382c963a75 [id=03ababcd2bda4c96a8ead4f4fd3ae578] alter complete (version 3)
W20260617 07:53:26.093029 988 leader_election.cc:343] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.093144 988 leader_election.cc:304] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:26.093314 459 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f97ee5f17fc4fc0847a10b0b4c2f892 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:26.094033 2729 raft_consensus.cc:2749] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.094173 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_0b7dbffe5422405dba60a8ad9491a5b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.094573 988 leader_election.cc:343] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.094666 988 leader_election.cc:304] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:26.094800 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b7dbffe5422405dba60a8ad9491a5b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.095203 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ef67fe2d23444f77bf415fc9aad1db62
I20260617 07:53:26.095271 2729 raft_consensus.cc:2749] T 979087485af94e159d3d0f2cb873899e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.095388 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8b18ee371b3345c597ad326b0645d2a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:26.095830 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d3149ace5367458db7d2f835bc7d88fe" } new_table_name: "default.Table_e8d5433908044c5fbf9c88d7390b18e4" modify_external_catalogs: true
I20260617 07:53:26.097477 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 75f32eb8ec894e029a428bbd62caa0f5
I20260617 07:53:26.098145 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_fec69fdf7c354420b12cb589a9d86f5f" } new_table_name: "default.Table_a02ff39b444b4de68e52a2e2ec75497a" modify_external_catalogs: true
I20260617 07:53:26.098295 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 01abd7aed0fd4d2b90db9f40029b5b37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.098603 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 24ba13170e864dfa96cddfb1a76b8c40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.098765 898 tablet_service.cc:1558] Processing DeleteTablet for tablet e03a26e301e747febc4d5bafdc1a49c6 with delete_type TABLET_DATA_DELETED (replaced by tablet d7b981da1d2e4862824e933dc8babefc) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.098910 884 tablet_service.cc:1558] Processing DeleteTablet for tablet e9f8492f127243eca07b2ffbabddded5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.099040 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 51e757e6f4ce4c6eb8223c4b6955245e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.099210 892 tablet_service.cc:1558] Processing DeleteTablet for tablet ef67fe2d23444f77bf415fc9aad1db62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.099362 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4f81daf583464e988521e189ca39b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.099535 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_38930fa6fb03412e8256e4828be1254d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:26.099746 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 75f32eb8ec894e029a428bbd62caa0f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:26.099949 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38930fa6fb03412e8256e4828be1254d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.101123 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_bed6a31c5b494a2c9217775f1275b9c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.101533 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bed6a31c5b494a2c9217775f1275b9c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.102380 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet ef67fe2d23444f77bf415fc9aad1db62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.102489 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 01abd7aed0fd4d2b90db9f40029b5b37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:26.095851 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b18ee371b3345c597ad326b0645d2a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.106009 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 75f32eb8ec894e029a428bbd62caa0f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.112722 1172 tablet_bootstrap.cc:492] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.115062 1172 tablet_bootstrap.cc:654] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.115839 2899 tablet.cc:1724] T 70e4068fdcbb41de966bcc72a4d1d426 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:26.121827 2709 raft_consensus.cc:493] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.121989 2709 raft_consensus.cc:515] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.122653 2709 leader_election.cc:290] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.127040 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4f81daf583464e988521e189ca39b6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:26.127312 1051 raft_consensus.cc:2468] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:26.127729 851 leader_election.cc:304] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:26.128217 2709 raft_consensus.cc:2804] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:26.128310 2709 raft_consensus.cc:493] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:26.128386 2709 raft_consensus.cc:3060] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:26.129736 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e77241217a0a4d65b6adac5428f269b1 consensus state has no leader
I20260617 07:53:26.131790 461 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet c019792d23484fb789378bf377547415 (table default.Table_c4040af1ae434f4daa66c3e47f38cc64 [id=b20987ff1f1c43098b1408b126b32913]). Expected version 3 got 0
I20260617 07:53:26.131804 2709 raft_consensus.cc:515] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.132624 2709 leader_election.cc:290] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:26.133024 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 741e986ebfb2428ba2bd08c145a6df61 has no consensus state
I20260617 07:53:26.133965 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4f81daf583464e988521e189ca39b6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:26.134137 1051 raft_consensus.cc:3060] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:26.135438 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9780f9700e842e9b09fa223cf5d6a68 consensus state has no leader
I20260617 07:53:26.135748 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_3e88b34d122b4cdc89a76f67615e2bb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.136274 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e88b34d122b4cdc89a76f67615e2bb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.137054 1051 raft_consensus.cc:2468] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:26.137435 851 leader_election.cc:304] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:26.137928 2775 raft_consensus.cc:2804] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:26.138037 2775 raft_consensus.cc:697] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:26.138258 2775 consensus_queue.cc:237] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.139726 2928 raft_consensus.cc:493] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.139885 2928 raft_consensus.cc:515] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.140144 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 70610822c57e45c7add7e1f5ce96d889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.140498 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet c9657e0dd2a8459cb728bdfe8a68b840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.141446 2928 leader_election.cc:290] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:26.142189 852 consensus_peers.cc:597] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:26.142663 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846ed8a3525f4fb5af0e7e66d8ffe7e1" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:26.143210 988 leader_election.cc:343] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.148721 1862 ts_tablet_manager.cc:1929] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:26.151547 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 846ed8a3525f4fb5af0e7e66d8ffe7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.111753 758 tablet_service.cc:1558] Processing DeleteTablet for tablet ef67fe2d23444f77bf415fc9aad1db62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.111886 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 75f32eb8ec894e029a428bbd62caa0f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.113559 744 tablet_service.cc:1558] Processing DeleteTablet for tablet eba5976fcadd4add9c671300b431617b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.117813 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 01abd7aed0fd4d2b90db9f40029b5b37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.135797 1178 tablet_bootstrap.cc:492] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:26.137312 2861 raft_consensus.cc:493] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:26.154534 2861 raft_consensus.cc:515] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.155200 2861 leader_election.cc:290] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.137667 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4f81daf583464e988521e189ca39b6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:26.141085 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "846ed8a3525f4fb5af0e7e66d8ffe7e1" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.156482 716 leader_election.cc:343] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 56c70f5c41e04ad0b913c15aa315353f
W20260617 07:53:26.156865 986 leader_election.cc:343] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.156975 986 leader_election.cc:304] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:26.146085 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4f81daf583464e988521e189ca39b6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.157892 1178 ts_tablet_manager.cc:1403] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.000s
W20260617 07:53:26.159435 713 leader_election.cc:343] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 56c70f5c41e04ad0b913c15aa315353f
I20260617 07:53:26.159550 713 leader_election.cc:304] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.159945 2861 raft_consensus.cc:2749] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 07:53:26.158699 1178 raft_consensus.cc:359] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.161065 1178 raft_consensus.cc:385] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.161194 1178 raft_consensus.cc:740] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.162989 1170 ts_tablet_manager.cc:1929] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:26.164094 1178 consensus_queue.cc:260] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.171670 1178 ts_tablet_manager.cc:1434] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260617 07:53:26.177356 1178 tablet_bootstrap.cc:492] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.179095 1178 tablet_bootstrap.cc:654] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:26.156002 852 leader_election.cc:343] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.189795 2775 consensus_queue.cc:1048] T 7de5420edefc47ed9dcdf1eea02a22fa P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 07:53:26.190236 852 leader_election.cc:343] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.190591 1862 log.cc:1199] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/0be19ece3a0a4a51abad7b8e2f3b2420
I20260617 07:53:26.190514 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e5a4efb78d224baea198c245066b0ff1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:26.190907 1862 ts_tablet_manager.cc:1950] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
W20260617 07:53:26.191161 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5a4efb78d224baea198c245066b0ff1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.192284 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 0be19ece3a0a4a51abad7b8e2f3b2420 (table default.Table_00d654600a8a474d84c1678c529d4489 [id=9776f24641614e23a1ea878c6aad0efa]) successfully deleted
I20260617 07:53:26.176398 2928 raft_consensus.cc:2749] T 846ed8a3525f4fb5af0e7e66d8ffe7e1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.193871 1170 log.cc:1199] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/df5bbdbcf3044128a4cb274f83d5d29b
I20260617 07:53:26.194268 1170 ts_tablet_manager.cc:1950] T df5bbdbcf3044128a4cb274f83d5d29b P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:26.195004 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 548) took 4059 ms. Trace:
I20260617 07:53:26.195082 1170 rpcz_store.cc:276] 0617 07:53:22.135420 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.140216 (+ 4796us) service_pool.cc:224] Handling call
0617 07:53:25.978388 (+3838172us) ts_tablet_manager.cc:1151] Deleting tablet df5bbdbcf3044128a4cb274f83d5d29b
0617 07:53:25.978396 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.067851 (+ 89455us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.162928 (+ 95077us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.194987 (+ 32059us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3837491}
I20260617 07:53:26.180704 1172 tablet_bootstrap.cc:492] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.195431 1172 ts_tablet_manager.cc:1403] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.000s
I20260617 07:53:26.195493 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet df5bbdbcf3044128a4cb274f83d5d29b (table default.Table_aab2b789b2dc48719838e0704687a406 [id=e42c6141367a4922ace753fd8ccf8463]) successfully deleted
I20260617 07:53:26.196170 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 552) took 3933 ms. Trace:
I20260617 07:53:26.196290 1172 raft_consensus.cc:359] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.196504 1172 raft_consensus.cc:385] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.196563 1172 raft_consensus.cc:740] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.196785 1172 consensus_queue.cc:260] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.197391 1172 ts_tablet_manager.cc:1434] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:26.197741 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_47b539845ac346bf94ec809570b60ba6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.198278 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47b539845ac346bf94ec809570b60ba6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.199025 1172 tablet_bootstrap.cc:492] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.202838 1172 tablet_bootstrap.cc:654] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:26.203009 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 71446fc29bd5413fbfe0f6ecc6c54ada because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71446fc29bd5413fbfe0f6ecc6c54ada already in progress: creating tablet
W20260617 07:53:26.206419 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet cc8bf9876afc48bf81bf3020701a2939 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc8bf9876afc48bf81bf3020701a2939 already in progress: creating tablet
W20260617 07:53:26.207980 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ded53073ce884013b1b0ab3cd23849e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ded53073ce884013b1b0ab3cd23849e1 already in progress: creating tablet
W20260617 07:53:26.208194 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet c31e808cf0604b3099230d8c2e0d609e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c31e808cf0604b3099230d8c2e0d609e already in progress: creating tablet
I20260617 07:53:26.211125 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 87583f583c13496a816062a70f62905b
I20260617 07:53:26.214107 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 87583f583c13496a816062a70f62905b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.214496 457 master_service.cc:960] ReplaceTablet: received request to replace tablet da1d2f5f9b0441e8bbfd6571570f4f88 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:26.214565 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 5f97ee5f17fc4fc0847a10b0b4c2f892
I20260617 07:53:26.215070 459 catalog_manager.cc:6784] ReplaceTablet: tablet 5f97ee5f17fc4fc0847a10b0b4c2f892 deleted and replaced by tablet 765f4b147edc4386bb30df7ae1e635be
I20260617 07:53:26.215327 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_aae2ee49ba404f10a9133db568c68406" } modify_external_catalogs: true
I20260617 07:53:26.215513 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_aae2ee49ba404f10a9133db568c68406" } modify_external_catalogs: true
I20260617 07:53:26.216625 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f97ee5f17fc4fc0847a10b0b4c2f892 with delete_type TABLET_DATA_DELETED (replaced by tablet 765f4b147edc4386bb30df7ae1e635be) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.217126 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f97ee5f17fc4fc0847a10b0b4c2f892 with delete_type TABLET_DATA_DELETED (replaced by tablet 765f4b147edc4386bb30df7ae1e635be) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.217041 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9785506a8a56487581a2f11ab8cb65b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.217623 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9785506a8a56487581a2f11ab8cb65b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:26.218114 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet f659b794a08745d2a111016332e604b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f659b794a08745d2a111016332e604b8 already in progress: creating tablet
I20260617 07:53:26.218997 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 87583f583c13496a816062a70f62905b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.219194 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f97ee5f17fc4fc0847a10b0b4c2f892 with delete_type TABLET_DATA_DELETED (replaced by tablet 765f4b147edc4386bb30df7ae1e635be) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.220254 1862 tablet_replica.cc:333] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:26.220494 1862 raft_consensus.cc:2243] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:26.221248 1862 pending_rounds.cc:70] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:26.221370 1862 pending_rounds.cc:77] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772771344633856 op_type: NO_OP noop_request { }
I20260617 07:53:26.221871 1862 raft_consensus.cc:2889] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:26.222092 1862 raft_consensus.cc:2272] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:26.222204 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 3ec0ac6bf0cf445293553691d902033b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ec0ac6bf0cf445293553691d902033b already in progress: creating tablet
I20260617 07:53:26.224089 1862 ts_tablet_manager.cc:1916] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.224350 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_b672313e82be462e8bb8adaec42d9ee2" } new_table_name: "default.Table_73d67c2fa9ee488f8bc97c270976eafc" modify_external_catalogs: true
W20260617 07:53:26.227370 852 consensus_peers.cc:597] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:26.229297 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 87583f583c13496a816062a70f62905b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.234629 1171 tablet_bootstrap.cc:492] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.234771 1171 ts_tablet_manager.cc:1403] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.161s user 0.003s sys 0.000s
I20260617 07:53:26.236135 1178 tablet_bootstrap.cc:492] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:26.237572 1178 ts_tablet_manager.cc:1403] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260617 07:53:26.238447 1178 raft_consensus.cc:359] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.238888 1171 raft_consensus.cc:359] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.239038 1171 raft_consensus.cc:385] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.239099 1171 raft_consensus.cc:740] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.239207 1178 raft_consensus.cc:385] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.239315 1178 raft_consensus.cc:740] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.239298 1171 consensus_queue.cc:260] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.239787 1171 ts_tablet_manager.cc:1434] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:26.240056 1171 tablet_bootstrap.cc:492] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:26.241266 1178 consensus_queue.cc:260] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.244760 1178 ts_tablet_manager.cc:1434] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260617 07:53:26.246260 1178 tablet_bootstrap.cc:492] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.196242 1170 rpcz_store.cc:276] 0617 07:53:22.262761 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.267769 (+ 5008us) service_pool.cc:224] Handling call
0617 07:53:26.196043 (+3928274us) ts_tablet_manager.cc:1151] Deleting tablet 18e866278bb64196ba96e7d870195362
0617 07:53:26.196054 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.196152 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3928026}
I20260617 07:53:26.247951 1178 tablet_bootstrap.cc:654] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:26.249142 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 18e866278bb64196ba96e7d870195362 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18e866278bb64196ba96e7d870195362 already in progress: creating tablet
I20260617 07:53:26.251343 1171 tablet_bootstrap.cc:654] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.252679 1170 tablet_replica.cc:333] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:26.252856 1170 raft_consensus.cc:2243] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.252987 1170 raft_consensus.cc:2272] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.253477 1170 ts_tablet_manager.cc:1916] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.248520 1172 tablet_bootstrap.cc:492] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.256920 1172 ts_tablet_manager.cc:1403] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.007s
I20260617 07:53:26.257980 1172 raft_consensus.cc:359] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.260855 1172 raft_consensus.cc:385] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.260994 1172 raft_consensus.cc:740] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.261471 1172 consensus_queue.cc:260] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.262022 2898 tablet.cc:1724] T 4ecf80e090494539ae3d20448f8d1126 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:26.263366 1846 ts_tablet_manager.cc:1929] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:26.263587 1846 log.cc:1199] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/a6f90a0d37cb483faa540451bf4dbe85
I20260617 07:53:26.263743 2856 tablet.cc:1724] T 4ecf80e090494539ae3d20448f8d1126 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:26.263933 1846 ts_tablet_manager.cc:1950] T a6f90a0d37cb483faa540451bf4dbe85 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:26.264601 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 730) took 4458 ms. Trace:
I20260617 07:53:26.268596 1846 rpcz_store.cc:276] 0617 07:53:21.806586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.806657 (+ 71us) service_pool.cc:224] Handling call
0617 07:53:26.080742 (+4274085us) ts_tablet_manager.cc:1151] Deleting tablet a6f90a0d37cb483faa540451bf4dbe85
0617 07:53:26.080753 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.157580 (+ 76827us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.263299 (+105719us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.264585 (+ 1286us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4273779}
I20260617 07:53:26.269536 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet a6f90a0d37cb483faa540451bf4dbe85 (table default.Table_a760668e4e954d438ebe1331c429627f [id=3d306a3bde784759bd8e3a45fa8cddec]) successfully deleted
I20260617 07:53:26.271660 1172 ts_tablet_manager.cc:1434] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260617 07:53:26.272236 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet da1d2f5f9b0441e8bbfd6571570f4f88
I20260617 07:53:26.272794 457 catalog_manager.cc:6784] ReplaceTablet: tablet da1d2f5f9b0441e8bbfd6571570f4f88 deleted and replaced by tablet bd2623a9d807412fa46b435dfde3f762
I20260617 07:53:26.273231 892 tablet_service.cc:1558] Processing DeleteTablet for tablet da1d2f5f9b0441e8bbfd6571570f4f88 with delete_type TABLET_DATA_DELETED (replaced by tablet bd2623a9d807412fa46b435dfde3f762) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.275182 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet da1d2f5f9b0441e8bbfd6571570f4f88 with delete_type TABLET_DATA_DELETED (replaced by tablet bd2623a9d807412fa46b435dfde3f762) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.275892 745 tablet_service.cc:1558] Processing DeleteTablet for tablet da1d2f5f9b0441e8bbfd6571570f4f88 with delete_type TABLET_DATA_DELETED (replaced by tablet bd2623a9d807412fa46b435dfde3f762) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.276666 1172 tablet_bootstrap.cc:492] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.285872 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 731) took 4452 ms. Trace:
I20260617 07:53:26.286121 1846 rpcz_store.cc:276] 0617 07:53:21.833402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.833452 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:26.282823 (+4449371us) ts_tablet_manager.cc:1151] Deleting tablet 2c60d917996341109ae66b9af24f6cb4
0617 07:53:26.282836 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.285851 (+ 3015us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4448887}
I20260617 07:53:26.288499 1172 tablet_bootstrap.cc:654] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:26.288936 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2c60d917996341109ae66b9af24f6cb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c60d917996341109ae66b9af24f6cb4 already in progress: creating tablet
I20260617 07:53:26.289732 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 732) took 4422 ms. Trace:
I20260617 07:53:26.289875 1846 rpcz_store.cc:276] 0617 07:53:21.867497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.867566 (+ 69us) service_pool.cc:224] Handling call
0617 07:53:26.289236 (+4421670us) ts_tablet_manager.cc:1151] Deleting tablet ed5563cfe75940168702bf237d8647cd
0617 07:53:26.289246 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.289695 (+ 449us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4408443}
W20260617 07:53:26.290403 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ed5563cfe75940168702bf237d8647cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed5563cfe75940168702bf237d8647cd already in progress: creating tablet
I20260617 07:53:26.290730 1846 tablet_replica.cc:333] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:26.290935 1846 raft_consensus.cc:2243] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.291145 1846 raft_consensus.cc:2272] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.291700 1846 ts_tablet_manager.cc:1916] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.292258 1172 tablet_bootstrap.cc:492] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.292404 1172 ts_tablet_manager.cc:1403] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260617 07:53:26.292965 1862 ts_tablet_manager.cc:1929] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:26.295634 2899 tablet.cc:1724] T 4ecf80e090494539ae3d20448f8d1126 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260617 07:53:26.296895 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6c112433d54458e8cefa35caeb09024 consensus state has no leader
I20260617 07:53:26.300961 1178 tablet_bootstrap.cc:492] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:26.301182 1178 ts_tablet_manager.cc:1403] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.000s
I20260617 07:53:26.302091 1178 raft_consensus.cc:359] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.302330 1178 raft_consensus.cc:385] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.302423 1178 raft_consensus.cc:740] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.302652 1178 consensus_queue.cc:260] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.304133 2629 raft_consensus.cc:493] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.304267 2629 raft_consensus.cc:515] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.304858 2629 leader_election.cc:290] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.305832 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8542262864a0ab9d763528502bcbb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.306360 1178 ts_tablet_manager.cc:1434] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
W20260617 07:53:26.306384 986 leader_election.cc:343] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.307502 1178 tablet_bootstrap.cc:492] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.309409 1178 tablet_bootstrap.cc:654] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.312223 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2d516117840d45a0b36733f1f4cc08d5" } modify_external_catalogs: true
I20260617 07:53:26.312433 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2d516117840d45a0b36733f1f4cc08d5" } modify_external_catalogs: true
I20260617 07:53:26.312956 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_af123e58c8214911af3d01a540b8f135" } modify_external_catalogs: true
I20260617 07:53:26.313114 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_af123e58c8214911af3d01a540b8f135" } modify_external_catalogs: true
I20260617 07:53:26.313592 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a91055837a9343b382d1cfe2137d03db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.314206 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a91055837a9343b382d1cfe2137d03db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.315431 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_81bb1dfa2f954da1a4974542d74c7eed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.315919 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81bb1dfa2f954da1a4974542d74c7eed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.317378 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9b4e5d09d2f2490983e5b3a74b033d65" } modify_external_catalogs: true
I20260617 07:53:26.317425 1172 raft_consensus.cc:359] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.317536 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9b4e5d09d2f2490983e5b3a74b033d65" } modify_external_catalogs: true
I20260617 07:53:26.317612 1172 raft_consensus.cc:385] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.318634 1170 ts_tablet_manager.cc:1929] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:26.319509 1170 log.cc:1199] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/e55d63a25a2845dbbcce20e560361007
I20260617 07:53:26.321408 1170 ts_tablet_manager.cc:1950] T e55d63a25a2845dbbcce20e560361007 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:26.317667 1172 raft_consensus.cc:740] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.322193 1172 consensus_queue.cc:260] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.323454 1172 ts_tablet_manager.cc:1434] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260617 07:53:26.328542 1172 tablet_bootstrap.cc:492] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.333154 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 569) took 3970 ms. Trace:
I20260617 07:53:26.333141 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_539fd5773b6749b7aa922ab7ba5250ad" } new_table_name: "default.Table_155f90a8cf9948f6a632a08f04f9d6a9" modify_external_catalogs: true
I20260617 07:53:26.336743 1170 rpcz_store.cc:276] 0617 07:53:22.362536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.363000 (+ 464us) service_pool.cc:224] Handling call
0617 07:53:26.252631 (+3889631us) ts_tablet_manager.cc:1151] Deleting tablet e55d63a25a2845dbbcce20e560361007
0617 07:53:26.252641 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.283061 (+ 30420us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.318584 (+ 35523us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.333135 (+ 14551us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3889454}
I20260617 07:53:26.338757 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet e55d63a25a2845dbbcce20e560361007 (table default.Table_d175a3c6daf849a68772a50df0940f7e [id=65758195b79f43a2954a2c3371d757c8]) successfully deleted
I20260617 07:53:26.339094 1170 tablet_replica.cc:333] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:26.339336 1170 raft_consensus.cc:2243] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.339529 1170 raft_consensus.cc:2272] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.339563 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_920f71d2a7bb466ea8426518f300ac86" } new_table_name: "default.Table_362c6ba80a5940979549809f18b8374a" modify_external_catalogs: true
I20260617 07:53:26.340051 1170 ts_tablet_manager.cc:1916] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.334149 1172 tablet_bootstrap.cc:654] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.349215 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0ef664bf28d1471db39370a9172cc5b7" } new_table_name: "default.Table_31c1b703cd654005914290cf0a58700d" modify_external_catalogs: true
I20260617 07:53:26.353024 1846 ts_tablet_manager.cc:1929] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:26.353457 1846 log.cc:1199] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/56c70f5c41e04ad0b913c15aa315353f
I20260617 07:53:26.353956 1846 ts_tablet_manager.cc:1950] T 56c70f5c41e04ad0b913c15aa315353f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
W20260617 07:53:26.355158 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f395f963a5a5400a966a8d4cc62aadf1 consensus state has no leader
I20260617 07:53:26.358038 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 733) took 4394 ms. Trace:
I20260617 07:53:26.358139 1846 rpcz_store.cc:276] 0617 07:53:21.963503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.963653 (+ 150us) service_pool.cc:224] Handling call
0617 07:53:26.290688 (+4327035us) ts_tablet_manager.cc:1151] Deleting tablet 56c70f5c41e04ad0b913c15aa315353f
0617 07:53:26.290696 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.323539 (+ 32843us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.352965 (+ 29426us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.358013 (+ 5048us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4326833}
I20260617 07:53:26.358582 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 56c70f5c41e04ad0b913c15aa315353f (table default.Table_92c8821eb1ef48fcb303b919f55c6b58 [id=27c9cf5e8d154b13a0de73ee2c60c357]) successfully deleted
I20260617 07:53:26.359337 1172 tablet_bootstrap.cc:492] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.359473 1172 ts_tablet_manager.cc:1403] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260617 07:53:26.360181 1172 raft_consensus.cc:359] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.360345 1172 raft_consensus.cc:385] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.360391 1172 raft_consensus.cc:740] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.360611 1172 consensus_queue.cc:260] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.361891 1172 ts_tablet_manager.cc:1434] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:26.362782 1172 tablet_bootstrap.cc:492] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.363176 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3608b494fe704c4eb01d58181b1f7c83" } new_table_name: "default.Table_7c8ec6646a7449f59ff45741000e4d4c" modify_external_catalogs: true
I20260617 07:53:26.364156 1172 tablet_bootstrap.cc:654] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.362324 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 734) took 4398 ms. Trace:
I20260617 07:53:26.365578 1846 rpcz_store.cc:276] 0617 07:53:21.963626 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:21.963693 (+ 67us) service_pool.cc:224] Handling call
0617 07:53:26.358419 (+4394726us) ts_tablet_manager.cc:1151] Deleting tablet 543fd8173b174946830d6228e47b2caa
0617 07:53:26.358429 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.362296 (+ 3867us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4394541}
I20260617 07:53:26.365737 1170 ts_tablet_manager.cc:1929] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:26.365831 1170 log.cc:1199] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/369442b72f754ee08dc6a484d51f2e99
I20260617 07:53:26.366544 1846 tablet_replica.cc:333] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:26.367018 1170 ts_tablet_manager.cc:1950] T 369442b72f754ee08dc6a484d51f2e99 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:26.367174 1846 raft_consensus.cc:2243] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:26.366218 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 543fd8173b174946830d6228e47b2caa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 543fd8173b174946830d6228e47b2caa already in progress: creating tablet
I20260617 07:53:26.369778 1172 tablet_bootstrap.cc:492] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.369905 1172 ts_tablet_manager.cc:1403] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260617 07:53:26.370558 1172 raft_consensus.cc:359] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.370743 1172 raft_consensus.cc:385] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.370805 1172 raft_consensus.cc:740] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.371047 1172 consensus_queue.cc:260] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.373232 1172 ts_tablet_manager.cc:1434] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:26.294335 2775 consensus_queue.cc:1048] T 4e700810cd024dacbadd9ab109d0d87c P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:26.295540 1171 tablet_bootstrap.cc:492] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.375684 1171 ts_tablet_manager.cc:1403] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.136s user 0.003s sys 0.000s
I20260617 07:53:26.376058 1862 log.cc:1199] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/beb8fbb44e6147be8c9605be886a8aea
I20260617 07:53:26.376475 1862 ts_tablet_manager.cc:1950] T beb8fbb44e6147be8c9605be886a8aea P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:26.376453 1171 raft_consensus.cc:359] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.376638 1171 raft_consensus.cc:385] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.376730 1171 raft_consensus.cc:740] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.376928 1171 consensus_queue.cc:260] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.377362 1171 ts_tablet_manager.cc:1434] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:26.377617 1171 tablet_bootstrap.cc:492] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:26.378193 1862 tablet_replica.cc:333] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
W20260617 07:53:26.378396 988 consensus_peers.cc:597] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b -> Peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Couldn't send request to peer 8b7080d37ca245fe914d3dc90f17e3ba. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 037539021d1743bb9a66403b8a01662f. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:26.379230 1171 tablet_bootstrap.cc:654] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.301793 2709 raft_consensus.cc:493] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.305938 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d8542262864a0ab9d763528502bcbb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:26.380122 2709 raft_consensus.cc:515] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.380628 2709 leader_election.cc:290] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.381794 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f8492f127243eca07b2ffbabddded5" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.382269 988 leader_election.cc:343] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.382369 988 leader_election.cc:304] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:26.382686 2629 raft_consensus.cc:2749] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:26.382966 852 leader_election.cc:343] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.345611 2710 raft_consensus.cc:493] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.383833 2710 raft_consensus.cc:515] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.384333 2710 leader_election.cc:290] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.350106 2774 raft_consensus.cc:493] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.384706 2774 raft_consensus.cc:515] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.384999 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216614d066e9446f91e53d2a382b5f6e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.385185 2774 leader_election.cc:290] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.385200 766 raft_consensus.cc:3060] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:26.372012 2922 consensus_queue.cc:1048] T 804126f8451e42748b26c43e31a2a1c4 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:26.389601 1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216614d066e9446f91e53d2a382b5f6e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:26.389801 1052 raft_consensus.cc:2468] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:26.390986 852 leader_election.cc:343] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.391319 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ba13170e864dfa96cddfb1a76b8c40" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.392650 1862 raft_consensus.cc:2243] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:26.393042 851 leader_election.cc:343] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: e9f8492f127243eca07b2ffbabddded5
I20260617 07:53:26.393200 851 leader_election.cc:304] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.393456 2922 raft_consensus.cc:2749] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.393656 851 leader_election.cc:304] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:26.393914 2922 raft_consensus.cc:2804] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:26.393988 2922 raft_consensus.cc:493] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:26.394048 2922 raft_consensus.cc:3060] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:26.394068 851 leader_election.cc:343] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 24ba13170e864dfa96cddfb1a76b8c40
W20260617 07:53:26.395148 852 leader_election.cc:343] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.395284 852 leader_election.cc:304] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.395845 2709 raft_consensus.cc:2706] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Received pre-election callback for term 1 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260617 07:53:26.395963 1178 tablet_bootstrap.cc:492] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:26.396088 1178 ts_tablet_manager.cc:1403] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.000s
I20260617 07:53:26.396628 2922 raft_consensus.cc:515] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.396816 1178 raft_consensus.cc:359] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.396951 1178 raft_consensus.cc:385] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.396997 1178 raft_consensus.cc:740] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.397162 2922 leader_election.cc:290] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.397181 1178 consensus_queue.cc:260] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.398036 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216614d066e9446f91e53d2a382b5f6e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:26.398420 1862 raft_consensus.cc:2272] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.398979 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216614d066e9446f91e53d2a382b5f6e" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:26.399207 1045 raft_consensus.cc:3060] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:26.402195 1045 raft_consensus.cc:2468] T 216614d066e9446f91e53d2a382b5f6e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:26.402598 851 leader_election.cc:304] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:26.402827 2774 raft_consensus.cc:2804] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:26.403486 1178 ts_tablet_manager.cc:1434] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:26.404906 1178 tablet_bootstrap.cc:492] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.405455 2861 raft_consensus.cc:493] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.405580 2861 raft_consensus.cc:515] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.406632 2861 leader_election.cc:290] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.407078 1178 tablet_bootstrap.cc:654] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:26.407635 716 leader_election.cc:343] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 9d94915d96694d6f9a86063640e5fe18
W20260617 07:53:26.410491 713 leader_election.cc:343] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 9d94915d96694d6f9a86063640e5fe18
I20260617 07:53:26.410597 713 leader_election.cc:304] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.410815 2861 raft_consensus.cc:2749] T 9d94915d96694d6f9a86063640e5fe18 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:26.411620 852 leader_election.cc:343] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.415181 1862 ts_tablet_manager.cc:1916] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.416891 1172 tablet_bootstrap.cc:492] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.420125 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 568) took 4057 ms. Trace:
I20260617 07:53:26.421053 1170 rpcz_store.cc:276] 0617 07:53:22.362456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.364045 (+ 1589us) service_pool.cc:224] Handling call
0617 07:53:26.339046 (+3975001us) ts_tablet_manager.cc:1151] Deleting tablet 369442b72f754ee08dc6a484d51f2e99
0617 07:53:26.339056 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.350975 (+ 11919us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.365660 (+ 14685us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.420095 (+ 54435us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3974820}
I20260617 07:53:26.421813 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet beb8fbb44e6147be8c9605be886a8aea (table default.Table_f8e68ee7c0bf43b08f9c84454484121d [id=2ce20b981b024427aca662385456a101]) successfully deleted
W20260617 07:53:26.422127 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet d7b981da1d2e4862824e933dc8babefc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7b981da1d2e4862824e933dc8babefc already in progress: creating tablet
W20260617 07:53:26.422372 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 01abd7aed0fd4d2b90db9f40029b5b37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01abd7aed0fd4d2b90db9f40029b5b37 already in progress: creating tablet
W20260617 07:53:26.422706 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet f395f963a5a5400a966a8d4cc62aadf1 (table default.Table_155f90a8cf9948f6a632a08f04f9d6a9 [id=4d565f22e74c4c9d97a5b367e2b016b4], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f395f963a5a5400a966a8d4cc62aadf1 consensus state has no leader
I20260617 07:53:26.423029 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 563) took 4064 ms. Trace:
I20260617 07:53:26.423100 1170 rpcz_store.cc:276] 0617 07:53:22.358360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.371817 (+ 13457us) service_pool.cc:224] Handling call
0617 07:53:26.422581 (+4050764us) ts_tablet_manager.cc:1151] Deleting tablet 9c86376216db4788b38bd55248e03f73
0617 07:53:26.422592 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.423011 (+ 419us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4050561}
I20260617 07:53:26.423338 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 369442b72f754ee08dc6a484d51f2e99 (table default.Table_8d97f61ab92d44008502cff52c36b89d [id=f0165435692349baa81584520f068a56]) successfully deleted
W20260617 07:53:26.423591 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 9c86376216db4788b38bd55248e03f73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c86376216db4788b38bd55248e03f73 already in progress: creating tablet
I20260617 07:53:26.423792 456 master_service.cc:960] ReplaceTablet: received request to replace tablet 8f5f6a0bf3624c8eaefee902a46b9d9f from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:26.424086 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 565) took 4061 ms. Trace:
I20260617 07:53:26.424192 1170 rpcz_store.cc:276] 0617 07:53:22.362184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.372049 (+ 9865us) service_pool.cc:224] Handling call
0617 07:53:26.423984 (+4051935us) ts_tablet_manager.cc:1151] Deleting tablet 35120ce002f24f2bb1ea0fdc59fbfc9d
0617 07:53:26.423997 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.424067 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4051734}
W20260617 07:53:26.424695 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 35120ce002f24f2bb1ea0fdc59fbfc9d because the tablet was not found. No further retry: Not found: Tablet not found: 35120ce002f24f2bb1ea0fdc59fbfc9d
I20260617 07:53:26.425758 1172 tablet_bootstrap.cc:654] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.426977 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 562) took 4068 ms. Trace:
I20260617 07:53:26.427521 765 raft_consensus.cc:3060] T 2735f7dd40e54aec9004b9b38702607c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:26.427484 1170 rpcz_store.cc:276] 0617 07:53:22.358248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.377754 (+ 19506us) service_pool.cc:224] Handling call
0617 07:53:26.426835 (+4049081us) ts_tablet_manager.cc:1151] Deleting tablet 6a6e2bb6577648d2ab958cfaa6f4a948
0617 07:53:26.426848 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.426955 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4048921}
W20260617 07:53:26.428045 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a6e2bb6577648d2ab958cfaa6f4a948 already in progress: creating tablet
I20260617 07:53:26.428733 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 572) took 3864 ms. Trace:
I20260617 07:53:26.428813 1170 rpcz_store.cc:276] 0617 07:53:22.564448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.568485 (+ 4037us) service_pool.cc:224] Handling call
0617 07:53:26.428602 (+3860117us) ts_tablet_manager.cc:1151] Deleting tablet f30f0bbfdf404569a417662861b06f73
0617 07:53:26.428615 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.428713 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3859928}
W20260617 07:53:26.429338 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet f30f0bbfdf404569a417662861b06f73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f30f0bbfdf404569a417662861b06f73 already in progress: creating tablet
W20260617 07:53:26.430974 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe52884fb6784b10a7da0bbb1b667031 consensus state has no leader
I20260617 07:53:26.434579 2861 raft_consensus.cc:493] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.434741 2861 raft_consensus.cc:515] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.435493 2861 leader_election.cc:290] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:26.436342 716 leader_election.cc:343] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 66140c5d364f453a8089f143cc96ede8
I20260617 07:53:26.437414 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_69c3ba19e7584094b3015b54aa67d1e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.438179 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69c3ba19e7584094b3015b54aa67d1e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:26.438477 713 leader_election.cc:343] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 66140c5d364f453a8089f143cc96ede8
I20260617 07:53:26.438578 713 leader_election.cc:304] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.439510 2861 raft_consensus.cc:2749] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.442569 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 581) took 3409 ms. Trace:
I20260617 07:53:26.442844 1170 rpcz_store.cc:276] 0617 07:53:23.032698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.033187 (+ 489us) service_pool.cc:224] Handling call
0617 07:53:26.442421 (+3409234us) ts_tablet_manager.cc:1151] Deleting tablet 146d1b46891a416aafe55aa740e1569e
0617 07:53:26.442433 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.442545 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3408958}
W20260617 07:53:26.444648 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83b75957083e4eb9b132280dbd7c5b9d consensus state has no leader
W20260617 07:53:26.444684 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 146d1b46891a416aafe55aa740e1569e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 146d1b46891a416aafe55aa740e1569e already in progress: creating tablet
I20260617 07:53:26.445082 1170 tablet_replica.cc:333] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:26.445254 1170 raft_consensus.cc:2243] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.445384 1170 raft_consensus.cc:2272] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.447606 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a090d99b416c43b38cff612ba5c45a1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.448154 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a090d99b416c43b38cff612ba5c45a1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.450083 1171 tablet_bootstrap.cc:492] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.450229 1171 ts_tablet_manager.cc:1403] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.000s
I20260617 07:53:26.450387 1170 ts_tablet_manager.cc:1916] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.458887 2856 tablet.cc:1724] T c019792d23484fb789378bf377547415 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:26.467110 1172 tablet_bootstrap.cc:492] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.467255 1172 ts_tablet_manager.cc:1403] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.093s user 0.004s sys 0.000s
I20260617 07:53:26.468060 1172 raft_consensus.cc:359] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.468221 1172 raft_consensus.cc:385] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.468266 1172 raft_consensus.cc:740] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.468472 1172 consensus_queue.cc:260] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.450939 1171 raft_consensus.cc:359] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.471872 1171 raft_consensus.cc:385] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.471941 1171 raft_consensus.cc:740] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.472755 1172 ts_tablet_manager.cc:1434] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 07:53:26.473858 1171 consensus_queue.cc:260] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.473997 1172 tablet_bootstrap.cc:492] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.474365 1171 ts_tablet_manager.cc:1434] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.024s user 0.001s sys 0.000s
W20260617 07:53:26.475612 986 consensus_peers.cc:597] T 361845f7627b4b9f8481b4a66bc53e9c P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260617 07:53:26.479194 1172 tablet_bootstrap.cc:654] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.486869 2629 raft_consensus.cc:493] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.487008 2629 raft_consensus.cc:515] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.487612 2629 leader_election.cc:290] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.488588 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5053b7c24964dee880890fbb803ce7b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.489195 986 leader_election.cc:343] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.490334 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 8f5f6a0bf3624c8eaefee902a46b9d9f
I20260617 07:53:26.490862 456 catalog_manager.cc:6784] ReplaceTablet: tablet 8f5f6a0bf3624c8eaefee902a46b9d9f deleted and replaced by tablet 706d533b026e44b6b344876046d92966
I20260617 07:53:26.491578 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f with delete_type TABLET_DATA_DELETED (replaced by tablet 706d533b026e44b6b344876046d92966) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.491786 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f with delete_type TABLET_DATA_DELETED (replaced by tablet 706d533b026e44b6b344876046d92966) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.492976 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f5f6a0bf3624c8eaefee902a46b9d9f with delete_type TABLET_DATA_DELETED (replaced by tablet 706d533b026e44b6b344876046d92966) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.496423 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6f43914efa774fb1b61d4f870c76bad8" } modify_external_catalogs: true
I20260617 07:53:26.496656 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6f43914efa774fb1b61d4f870c76bad8" } modify_external_catalogs: true
W20260617 07:53:26.497154 988 leader_election.cc:343] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: f5053b7c24964dee880890fbb803ce7b
I20260617 07:53:26.497315 988 leader_election.cc:304] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:26.497936 2629 raft_consensus.cc:2749] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.499925 2775 raft_consensus.cc:493] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.500061 2775 raft_consensus.cc:515] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.500370 455 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:26.500635 2775 leader_election.cc:290] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.500624 455 catalog_manager.cc:5696] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:26.500875 1178 tablet_bootstrap.cc:492] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:26.500847 2898 tablet.cc:1724] T d1c7ced951c34afa8dff243d275bfb36 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260617 07:53:26.500996 1178 ts_tablet_manager.cc:1403] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.000s
I20260617 07:53:26.501024 455 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_0a3622a666594847848eb4982fd1316a [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 3 got 0
I20260617 07:53:26.501621 461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_6e1d6fa3d4c244b5a86ba8377b1367b6 [id=369a4a7b1948442aa0520b679c3cf974] alter complete (version 1)
I20260617 07:53:26.502478 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_475b62f628cb4fedb0a078c5d9d1c41c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:26.502728 2899 tablet.cc:1724] T d1c7ced951c34afa8dff243d275bfb36 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260617 07:53:26.502985 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_475b62f628cb4fedb0a078c5d9d1c41c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.504345 1171 tablet_bootstrap.cc:492] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:26.504453 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_83b0a019b32c4c7fb0ff00b2f14a0c36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:26.504505 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 039ec69971ff46bd8904147e58cf4aee (DEFAULT_TABLE table=default.Table_e657348efd7440349c9bc05f437dd7aa [id=c0fcff2eb1ee48068364d79ee84642f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.504890 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039ec69971ff46bd8904147e58cf4aee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:26.504961 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83b0a019b32c4c7fb0ff00b2f14a0c36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.506603 2774 raft_consensus.cc:697] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:26.507810 1170 ts_tablet_manager.cc:1929] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:26.506901 2774 consensus_queue.cc:237] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.508703 884 tablet_service.cc:1511] Processing CreateTablet for tablet 039ec69971ff46bd8904147e58cf4aee (DEFAULT_TABLE table=default.Table_e657348efd7440349c9bc05f437dd7aa [id=c0fcff2eb1ee48068364d79ee84642f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.509080 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039ec69971ff46bd8904147e58cf4aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.509478 1171 tablet_bootstrap.cc:654] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.510254 2709 raft_consensus.cc:493] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.510365 2709 raft_consensus.cc:515] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.510931 2709 leader_election.cc:290] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.511611 1170 log.cc:1199] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/51e757e6f4ce4c6eb8223c4b6955245e
I20260617 07:53:26.511924 1170 ts_tablet_manager.cc:1950] T 51e757e6f4ce4c6eb8223c4b6955245e P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:26.511876 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc1d9ce2ab5b428893719d9acd272d88" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.512720 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 584) took 3358 ms. Trace:
I20260617 07:53:26.512856 745 tablet_service.cc:1511] Processing CreateTablet for tablet 039ec69971ff46bd8904147e58cf4aee (DEFAULT_TABLE table=default.Table_e657348efd7440349c9bc05f437dd7aa [id=c0fcff2eb1ee48068364d79ee84642f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.512804 1170 rpcz_store.cc:276] 0617 07:53:23.154586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.154744 (+ 158us) service_pool.cc:224] Handling call
0617 07:53:26.445022 (+3290278us) ts_tablet_manager.cc:1151] Deleting tablet 51e757e6f4ce4c6eb8223c4b6955245e
0617 07:53:26.445031 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.484808 (+ 39777us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.507756 (+ 22948us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.512701 (+ 4945us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3290101}
I20260617 07:53:26.513195 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039ec69971ff46bd8904147e58cf4aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.513302 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 51e757e6f4ce4c6eb8223c4b6955245e (table default.Table_69167a2936fa47a08d1f53dfec14f52b [id=8738ee5e888742f9a7c0aa0c9085dc75]) successfully deleted
I20260617 07:53:26.511495 1172 tablet_bootstrap.cc:492] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.513613 1172 ts_tablet_manager.cc:1403] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260617 07:53:26.514842 1172 raft_consensus.cc:359] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.515034 1172 raft_consensus.cc:385] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.515097 1172 raft_consensus.cc:740] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.515308 1172 consensus_queue.cc:260] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.516011 1172 ts_tablet_manager.cc:1434] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:26.516379 1172 tablet_bootstrap.cc:492] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:26.519325 851 leader_election.cc:343] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: cc1d9ce2ab5b428893719d9acd272d88
I20260617 07:53:26.519493 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9777d3619743cf8df19cf93f97f50a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:26.519663 1051 raft_consensus.cc:2468] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:26.520244 851 leader_election.cc:304] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:26.520776 2710 raft_consensus.cc:2804] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:26.520852 2710 raft_consensus.cc:493] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:26.520917 2710 raft_consensus.cc:3060] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:26.522957 852 leader_election.cc:343] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.523061 852 leader_election.cc:304] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.523277 2775 raft_consensus.cc:2749] T cc1d9ce2ab5b428893719d9acd272d88 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.523500 2710 raft_consensus.cc:515] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.524133 2710 leader_election.cc:290] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.524698 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9777d3619743cf8df19cf93f97f50a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:26.524763 2856 tablet.cc:1724] T d1c7ced951c34afa8dff243d275bfb36 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260617 07:53:26.526674 852 leader_election.cc:343] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.528532 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9777d3619743cf8df19cf93f97f50a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:26.528709 1051 raft_consensus.cc:3060] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:26.529438 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9777d3619743cf8df19cf93f97f50a" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.530014 852 leader_election.cc:343] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.531728 1051 raft_consensus.cc:2468] T cd9777d3619743cf8df19cf93f97f50a P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:26.532892 851 leader_election.cc:304] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:26.533429 2922 raft_consensus.cc:2804] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:26.533555 2922 raft_consensus.cc:697] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:26.533809 2922 consensus_queue.cc:237] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.539839 1178 raft_consensus.cc:359] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.540105 1178 raft_consensus.cc:385] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.541851 1178 raft_consensus.cc:740] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.542171 1178 consensus_queue.cc:260] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.545917 745 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6571b352894d37aed7bfdc5088bfb1 (DEFAULT_TABLE table=default.Table_a564737f655341da8a4a4ca4705af0dc [id=1ec63ce9d0104b928c10746a139a8fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.546411 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6571b352894d37aed7bfdc5088bfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.547586 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6571b352894d37aed7bfdc5088bfb1 (DEFAULT_TABLE table=default.Table_a564737f655341da8a4a4ca4705af0dc [id=1ec63ce9d0104b928c10746a139a8fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.547996 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6571b352894d37aed7bfdc5088bfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.550488 884 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6571b352894d37aed7bfdc5088bfb1 (DEFAULT_TABLE table=default.Table_a564737f655341da8a4a4ca4705af0dc [id=1ec63ce9d0104b928c10746a139a8fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.550804 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 583) took 3495 ms. Trace:
I20260617 07:53:26.550876 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6571b352894d37aed7bfdc5088bfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.550887 1170 rpcz_store.cc:276] 0617 07:53:23.055177 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.161798 (+106621us) service_pool.cc:224] Handling call
0617 07:53:26.550657 (+3388859us) ts_tablet_manager.cc:1151] Deleting tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1
0617 07:53:26.550669 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.550780 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3388642}
W20260617 07:53:26.551393 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 already in progress: creating tablet
I20260617 07:53:26.551497 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 589) took 3354 ms. Trace:
I20260617 07:53:26.551584 1170 rpcz_store.cc:276] 0617 07:53:23.196586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.241550 (+ 44964us) service_pool.cc:224] Handling call
0617 07:53:26.551381 (+3309831us) ts_tablet_manager.cc:1151] Deleting tablet 2372cb9ae6e343be945b1e8d2db86894
0617 07:53:26.551392 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.551480 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3309669}
W20260617 07:53:26.551962 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2372cb9ae6e343be945b1e8d2db86894 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2372cb9ae6e343be945b1e8d2db86894 already in progress: creating tablet
I20260617 07:53:26.552035 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 591) took 3339 ms. Trace:
I20260617 07:53:26.552106 1170 rpcz_store.cc:276] 0617 07:53:23.212118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.239155 (+ 27037us) service_pool.cc:224] Handling call
0617 07:53:26.551931 (+3312776us) ts_tablet_manager.cc:1151] Deleting tablet 7ca7af3d86d741f482a1f5f97de9c767
0617 07:53:26.551940 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.552021 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3295300}
I20260617 07:53:26.552398 2629 raft_consensus.cc:493] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.552510 2629 raft_consensus.cc:515] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.552739 1178 ts_tablet_manager.cc:1434] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.052s user 0.002s sys 0.001s
I20260617 07:53:26.553154 2629 leader_election.cc:290] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.553632 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07431acc9208489aaea2f8c4205e46a5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.554279 986 leader_election.cc:343] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.554458 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 599) took 3143 ms. Trace:
I20260617 07:53:26.556392 1170 rpcz_store.cc:276] 0617 07:53:23.410850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.410914 (+ 64us) service_pool.cc:224] Handling call
0617 07:53:26.554357 (+3143443us) ts_tablet_manager.cc:1151] Deleting tablet a0f7775846454e96a9f433e84e90a229
0617 07:53:26.554367 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.554441 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3134742}
I20260617 07:53:26.554152 1172 tablet_bootstrap.cc:654] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.557006 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07431acc9208489aaea2f8c4205e46a5" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:26.557531 988 leader_election.cc:343] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.557639 988 leader_election.cc:304] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:26.557876 2629 raft_consensus.cc:2749] T 07431acc9208489aaea2f8c4205e46a5 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.558151 1171 tablet_bootstrap.cc:492] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.558261 1171 ts_tablet_manager.cc:1403] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.000s
I20260617 07:53:26.558360 1178 tablet_bootstrap.cc:492] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.558856 1171 raft_consensus.cc:359] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.558991 1171 raft_consensus.cc:385] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.559041 1171 raft_consensus.cc:740] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.559248 1171 consensus_queue.cc:260] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.559650 1171 ts_tablet_manager.cc:1434] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260617 07:53:26.560164 1171 tablet_bootstrap.cc:492] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
W20260617 07:53:26.560424 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 7ca7af3d86d741f482a1f5f97de9c767 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ca7af3d86d741f482a1f5f97de9c767 already in progress: creating tablet
W20260617 07:53:26.560680 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a0f7775846454e96a9f433e84e90a229 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0f7775846454e96a9f433e84e90a229 already in progress: creating tablet
I20260617 07:53:26.561805 1862 ts_tablet_manager.cc:1929] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:26.560891 1170 tablet_replica.cc:333] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:26.562949 1170 raft_consensus.cc:2243] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.563016 2629 raft_consensus.cc:493] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.563156 1170 raft_consensus.cc:2272] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.563126 2629 raft_consensus.cc:515] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.563654 2629 leader_election.cc:290] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.563791 1170 ts_tablet_manager.cc:1916] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.564181 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7cb453c7b647f298a6ebe20fd0e45b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.564662 986 leader_election.cc:343] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.565454 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e01ba3682fbb4093b41ced5b097b9547"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:26.566027 1178 tablet_bootstrap.cc:654] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:26.566111 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e01ba3682fbb4093b41ced5b097b9547 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.567083 1862 log.cc:1199] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/24ba13170e864dfa96cddfb1a76b8c40
I20260617 07:53:26.567389 1862 ts_tablet_manager.cc:1950] T 24ba13170e864dfa96cddfb1a76b8c40 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:26.562649 1171 tablet_bootstrap.cc:654] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.564975 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7cb453c7b647f298a6ebe20fd0e45b" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:26.566509 2774 raft_consensus.cc:493] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.567953 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 24ba13170e864dfa96cddfb1a76b8c40 (table default.Table_bfa59190ca144c4d9d0cbab7a39eef9c [id=214df2f2d641469c91a78dfd5bb3aba8]) successfully deleted
I20260617 07:53:26.567953 2774 raft_consensus.cc:515] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.568766 2774 leader_election.cc:290] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.569016 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8cd6ff8fa44536acdd84a107ab1525" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:26.569190 1051 raft_consensus.cc:2468] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
W20260617 07:53:26.568980 988 leader_election.cc:343] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.569559 988 leader_election.cc:304] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:26.570045 2629 raft_consensus.cc:2749] T ce7cb453c7b647f298a6ebe20fd0e45b P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.570225 851 leader_election.cc:304] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:26.570650 2774 raft_consensus.cc:2804] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:26.571142 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8cd6ff8fa44536acdd84a107ab1525" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.570786 2774 raft_consensus.cc:493] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:26.571674 2774 raft_consensus.cc:3060] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
W20260617 07:53:26.571810 852 leader_election.cc:343] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.573931 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 4db586d78afa45bdaf4525fb39a9e2e5
I20260617 07:53:26.574626 2774 raft_consensus.cc:515] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.575316 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 4db586d78afa45bdaf4525fb39a9e2e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.575984 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 4db586d78afa45bdaf4525fb39a9e2e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.575935 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8cd6ff8fa44536acdd84a107ab1525" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:26.576368 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8cd6ff8fa44536acdd84a107ab1525" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
W20260617 07:53:26.576515 852 leader_election.cc:343] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.576574 1051 raft_consensus.cc:3060] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:26.577759 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 4db586d78afa45bdaf4525fb39a9e2e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.579762 1051 raft_consensus.cc:2468] T 2f8cd6ff8fa44536acdd84a107ab1525 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:26.580246 851 leader_election.cc:304] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7
I20260617 07:53:26.580513 2922 raft_consensus.cc:2804] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:26.580607 2922 raft_consensus.cc:697] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:26.580817 2922 consensus_queue.cc:237] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.581668 1862 tablet_replica.cc:333] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:26.582810 1862 raft_consensus.cc:2243] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:26.583047 1862 pending_rounds.cc:70] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:26.583138 1862 pending_rounds.cc:77] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772772846145536 op_type: NO_OP noop_request { }
I20260617 07:53:26.583272 1862 raft_consensus.cc:2889] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:26.583407 1862 raft_consensus.cc:2272] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.586289 745 tablet_service.cc:1511] Processing CreateTablet for tablet e6da949796fb43fdb504650f33390c8a (DEFAULT_TABLE table=default.Table_791c961f99a042ceb156fb16875c9a0f [id=702adb0b9bc548d28d818ca1e2774df4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.586764 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6da949796fb43fdb504650f33390c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.587659 744 tablet_service.cc:1511] Processing CreateTablet for tablet 0e73557880e840a1ae307dee6d5f5599 (DEFAULT_TABLE table=default.Table_8f5d892448b24a808ff432a9d8f85bdc [id=5f3219980b55404799338617ab06db3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.587978 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e73557880e840a1ae307dee6d5f5599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.588215 1172 tablet_bootstrap.cc:492] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.588371 1172 ts_tablet_manager.cc:1403] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.000s
I20260617 07:53:26.589974 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 0e73557880e840a1ae307dee6d5f5599 (DEFAULT_TABLE table=default.Table_8f5d892448b24a808ff432a9d8f85bdc [id=5f3219980b55404799338617ab06db3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.590129 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca06b4db5a64f4bb273dd364d9c7478 (DEFAULT_TABLE table=default.Table_30c725b6fb74488092e2d1ca6c8e31c8 [id=b1e646267f5e414daaf438724657fcda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.590314 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e73557880e840a1ae307dee6d5f5599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.590533 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca06b4db5a64f4bb273dd364d9c7478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.591413 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9743c949d80545a48ccfba13aca5060e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.591941 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9743c949d80545a48ccfba13aca5060e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.595387 742 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca06b4db5a64f4bb273dd364d9c7478 (DEFAULT_TABLE table=default.Table_30c725b6fb74488092e2d1ca6c8e31c8 [id=b1e646267f5e414daaf438724657fcda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.595752 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca06b4db5a64f4bb273dd364d9c7478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.597966 758 tablet_service.cc:1511] Processing CreateTablet for tablet 8582c22dcdad492490fc06dabccab989 (DEFAULT_TABLE table=default.Table_1183e1f272da4d5ea6bf70030b6e1432 [id=9c4876c2c43a47a69deca48d60b90eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.598055 2774 leader_election.cc:290] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.598297 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8582c22dcdad492490fc06dabccab989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.599247 1172 raft_consensus.cc:359] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.599463 1172 raft_consensus.cc:385] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.599522 1172 raft_consensus.cc:740] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.599757 1172 consensus_queue.cc:260] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.601121 454 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 07431acc9208489aaea2f8c4205e46a5 (table default.Table_a5cdd598297a4c71917c34f4e77c68fb [id=05666e345323450596af21c68fa06dad]). Expected version 1 got 0
I20260617 07:53:26.601637 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 744736166fa2405082ea3a87ef6b1790
I20260617 07:53:26.604385 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 744736166fa2405082ea3a87ef6b1790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.605250 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c9969ad843874b2993320579749281bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.605822 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9969ad843874b2993320579749281bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.613489 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 7c5ec941f083497380896277365be5c9
I20260617 07:53:26.614135 457 master_service.cc:960] ReplaceTablet: received request to replace tablet 40900f4b7a604abd9b020c2b396fb942 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:26.614849 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c5ec941f083497380896277365be5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.616010 1172 ts_tablet_manager.cc:1434] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20260617 07:53:26.616246 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 744736166fa2405082ea3a87ef6b1790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.616315 1172 tablet_bootstrap.cc:492] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.617877 2629 raft_consensus.cc:493] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.618005 2629 raft_consensus.cc:515] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.618577 2629 leader_election.cc:290] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.618911 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744736166fa2405082ea3a87ef6b1790" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.619777 986 leader_election.cc:343] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.620183 884 tablet_service.cc:1511] Processing CreateTablet for tablet e6da949796fb43fdb504650f33390c8a (DEFAULT_TABLE table=default.Table_791c961f99a042ceb156fb16875c9a0f [id=702adb0b9bc548d28d818ca1e2774df4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.620288 879 tablet_service.cc:1558] Processing DeleteTablet for tablet 744736166fa2405082ea3a87ef6b1790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.620332 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c5ec941f083497380896277365be5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.620604 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6da949796fb43fdb504650f33390c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.620651 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "744736166fa2405082ea3a87ef6b1790" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:26.621655 2967 raft_consensus.cc:493] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.621832 2967 raft_consensus.cc:515] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:26.621938 988 leader_election.cc:343] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.622045 988 leader_election.cc:304] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:26.622658 2629 raft_consensus.cc:2749] T 744736166fa2405082ea3a87ef6b1790 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:26.622969 716 leader_election.cc:343] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 3fcf87953dc14bf190ac74101547e52f
W20260617 07:53:26.623966 713 leader_election.cc:343] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 3fcf87953dc14bf190ac74101547e52f
I20260617 07:53:26.624085 713 leader_election.cc:304] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.624356 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c5ec941f083497380896277365be5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.624660 2967 leader_election.cc:290] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.624907 2967 raft_consensus.cc:2749] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.626204 898 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca06b4db5a64f4bb273dd364d9c7478 (DEFAULT_TABLE table=default.Table_30c725b6fb74488092e2d1ca6c8e31c8 [id=b1e646267f5e414daaf438724657fcda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.626602 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca06b4db5a64f4bb273dd364d9c7478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.626960 1014 tablet_service.cc:1511] Processing CreateTablet for tablet e6da949796fb43fdb504650f33390c8a (DEFAULT_TABLE table=default.Table_791c961f99a042ceb156fb16875c9a0f [id=702adb0b9bc548d28d818ca1e2774df4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.627287 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6da949796fb43fdb504650f33390c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.628471 1172 tablet_bootstrap.cc:654] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.629982 883 tablet_service.cc:1511] Processing CreateTablet for tablet 8582c22dcdad492490fc06dabccab989 (DEFAULT_TABLE table=default.Table_1183e1f272da4d5ea6bf70030b6e1432 [id=9c4876c2c43a47a69deca48d60b90eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.630331 1170 ts_tablet_manager.cc:1929] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:26.630363 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8582c22dcdad492490fc06dabccab989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.630419 1170 log.cc:1199] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/f5053b7c24964dee880890fbb803ce7b
I20260617 07:53:26.631513 1170 ts_tablet_manager.cc:1950] T f5053b7c24964dee880890fbb803ce7b P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:26.632489 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 600) took 3123 ms. Trace:
I20260617 07:53:26.632563 1170 rpcz_store.cc:276] 0617 07:53:23.509162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.520816 (+ 11654us) service_pool.cc:224] Handling call
0617 07:53:26.560845 (+3040029us) ts_tablet_manager.cc:1151] Deleting tablet f5053b7c24964dee880890fbb803ce7b
0617 07:53:26.560854 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.618128 (+ 57274us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.630281 (+ 12153us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.632473 (+ 2192us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3039849}
I20260617 07:53:26.633067 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 601) took 2979 ms. Trace:
I20260617 07:53:26.633132 1170 rpcz_store.cc:276] 0617 07:53:23.654088 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.656017 (+ 1929us) service_pool.cc:224] Handling call
0617 07:53:26.632935 (+2976918us) ts_tablet_manager.cc:1151] Deleting tablet 92d1398b4b604f75be1a3b46e5ac9b77
0617 07:53:26.632943 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.633051 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2976725}
I20260617 07:53:26.633548 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 602) took 2976 ms. Trace:
W20260617 07:53:26.633659 446 consensus_peers.cc:597] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f -> Peer 29a94ff9f875443ab6aeac00922cda0d (127.0.105.189:36505): Couldn't send request to peer 29a94ff9f875443ab6aeac00922cda0d. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.189:36505: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260617 07:53:26.633610 1170 rpcz_store.cc:276] 0617 07:53:23.657532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.657598 (+ 66us) service_pool.cc:224] Handling call
0617 07:53:26.633456 (+2975858us) ts_tablet_manager.cc:1151] Deleting tablet 0b479c2984934852a864699b66416538
0617 07:53:26.633464 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.633533 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2975659}
I20260617 07:53:26.633880 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet f5053b7c24964dee880890fbb803ce7b (table default.Table_0548ac2c93a44a47b27c0d3e662dd0f2 [id=7a56001e416e4428ae182d851d149550]) successfully deleted
W20260617 07:53:26.634091 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 92d1398b4b604f75be1a3b46e5ac9b77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92d1398b4b604f75be1a3b46e5ac9b77 already in progress: creating tablet
I20260617 07:53:26.634060 892 tablet_service.cc:1511] Processing CreateTablet for tablet 0e73557880e840a1ae307dee6d5f5599 (DEFAULT_TABLE table=default.Table_8f5d892448b24a808ff432a9d8f85bdc [id=5f3219980b55404799338617ab06db3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.634155 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 603) took 2975 ms. Trace:
W20260617 07:53:26.634275 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 0b479c2984934852a864699b66416538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b479c2984934852a864699b66416538 already in progress: creating tablet
I20260617 07:53:26.634399 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e73557880e840a1ae307dee6d5f5599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.634213 1170 rpcz_store.cc:276] 0617 07:53:23.658690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.658937 (+ 247us) service_pool.cc:224] Handling call
0617 07:53:26.634062 (+2975125us) ts_tablet_manager.cc:1151] Deleting tablet 8d58c09bfda64ad2aa42ecfbd413c6ef
0617 07:53:26.634071 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.634141 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2974979}
I20260617 07:53:26.635093 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 604) took 2973 ms. Trace:
I20260617 07:53:26.635157 1170 rpcz_store.cc:276] 0617 07:53:23.661862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.661918 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:26.634995 (+2973077us) ts_tablet_manager.cc:1151] Deleting tablet 8607c3a4744a4eeb882f1e913875ee1f
0617 07:53:26.635003 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.635079 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2972923}
I20260617 07:53:26.635870 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 605) took 2972 ms. Trace:
I20260617 07:53:26.635932 1170 rpcz_store.cc:276] 0617 07:53:23.663813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.663868 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:26.635786 (+2971918us) ts_tablet_manager.cc:1151] Deleting tablet 12727ad13f0747ce8d9710a71ba2c075
0617 07:53:26.635793 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.635857 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2971765}
I20260617 07:53:26.636663 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 606) took 2964 ms. Trace:
I20260617 07:53:26.636725 1170 rpcz_store.cc:276] 0617 07:53:23.672120 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.672172 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:26.636578 (+2964406us) ts_tablet_manager.cc:1151] Deleting tablet 213d76d2aa1a41d5951aa093d09d9ce6
0617 07:53:26.636585 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.636649 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2964227}
W20260617 07:53:26.637635 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d58c09bfda64ad2aa42ecfbd413c6ef already in progress: creating tablet
W20260617 07:53:26.637866 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 8607c3a4744a4eeb882f1e913875ee1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8607c3a4744a4eeb882f1e913875ee1f already in progress: creating tablet
W20260617 07:53:26.638033 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 12727ad13f0747ce8d9710a71ba2c075 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12727ad13f0747ce8d9710a71ba2c075 already in progress: creating tablet
I20260617 07:53:26.638108 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 614) took 2884 ms. Trace:
W20260617 07:53:26.638217 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 213d76d2aa1a41d5951aa093d09d9ce6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 213d76d2aa1a41d5951aa093d09d9ce6 already in progress: creating tablet
I20260617 07:53:26.638170 1170 rpcz_store.cc:276] 0617 07:53:23.753589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.759366 (+ 5777us) service_pool.cc:224] Handling call
0617 07:53:26.637427 (+2878061us) ts_tablet_manager.cc:1151] Deleting tablet d3f843a058bd449796d59b89e2470d8c
0617 07:53:26.637434 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.638092 (+ 658us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2877907}
W20260617 07:53:26.638545 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d3f843a058bd449796d59b89e2470d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3f843a058bd449796d59b89e2470d8c already in progress: creating tablet
I20260617 07:53:26.639926 1172 tablet_bootstrap.cc:492] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.640061 1172 ts_tablet_manager.cc:1403] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260617 07:53:26.640884 1172 raft_consensus.cc:359] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.641068 1172 raft_consensus.cc:385] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.641135 1172 raft_consensus.cc:740] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.641360 1172 consensus_queue.cc:260] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.642807 1178 tablet_bootstrap.cc:492] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:26.642938 1178 ts_tablet_manager.cc:1403] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.000s
I20260617 07:53:26.643621 1178 raft_consensus.cc:359] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.643814 1178 raft_consensus.cc:385] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.643867 1178 raft_consensus.cc:740] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.644471 1862 ts_tablet_manager.cc:1916] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.645633 2629 raft_consensus.cc:493] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.645772 2629 raft_consensus.cc:515] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.645817 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 8aec6545fc714008b397e880e5ab40e3
I20260617 07:53:26.646296 2629 leader_election.cc:290] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.648233 1172 ts_tablet_manager.cc:1434] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260617 07:53:26.648734 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 8aec6545fc714008b397e880e5ab40e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.649638 1172 tablet_bootstrap.cc:492] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.650158 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 8aec6545fc714008b397e880e5ab40e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.650601 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e8f7118aaf4c6a9b9caab5abc030fa" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.651153 986 leader_election.cc:343] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.662886 1171 tablet_bootstrap.cc:492] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.663121 1171 ts_tablet_manager.cc:1403] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.002s
I20260617 07:53:26.663870 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_e73f6422ff26458a96af1b9a3759bd47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:26.663937 1171 raft_consensus.cc:359] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.664070 1171 raft_consensus.cc:385] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.664119 1171 raft_consensus.cc:740] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.664270 1171 consensus_queue.cc:260] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:26.664529 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e73f6422ff26458a96af1b9a3759bd47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.664959 1170 tablet_replica.cc:333] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:26.665150 1170 raft_consensus.cc:2243] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.665275 1170 raft_consensus.cc:2272] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.665792 1170 ts_tablet_manager.cc:1916] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.667237 1171 ts_tablet_manager.cc:1434] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 07:53:26.667570 1171 tablet_bootstrap.cc:492] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:26.668927 1171 tablet_bootstrap.cc:654] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.669697 1178 consensus_queue.cc:260] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.670804 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 8582c22dcdad492490fc06dabccab989 (DEFAULT_TABLE table=default.Table_1183e1f272da4d5ea6bf70030b6e1432 [id=9c4876c2c43a47a69deca48d60b90eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.666376 1172 tablet_bootstrap.cc:654] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.671391 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8582c22dcdad492490fc06dabccab989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.672778 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 8aec6545fc714008b397e880e5ab40e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.673032 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e8f7118aaf4c6a9b9caab5abc030fa" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:26.674299 988 leader_election.cc:343] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.674415 988 leader_election.cc:304] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:26.674808 2629 raft_consensus.cc:2749] T 71e8f7118aaf4c6a9b9caab5abc030fa P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:26.682879 852 consensus_peers.cc:597] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:26.684962 1172 tablet_bootstrap.cc:492] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:26.685189 1172 ts_tablet_manager.cc:1403] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260617 07:53:26.686077 1172 raft_consensus.cc:359] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.686183 1178 ts_tablet_manager.cc:1434] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.043s user 0.002s sys 0.000s
I20260617 07:53:26.686332 1172 raft_consensus.cc:385] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.686426 1172 raft_consensus.cc:740] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.686535 744 tablet_service.cc:1511] Processing CreateTablet for tablet 222c2596b6aa4cb18aa7a68657309545 (DEFAULT_TABLE table=default.Table_0e30edc72d824353b77f16a262127628 [id=816e133930cf46ac83f566c9cb93b4b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.686960 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222c2596b6aa4cb18aa7a68657309545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.686726 1172 consensus_queue.cc:260] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.689121 2629 raft_consensus.cc:493] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.689247 2629 raft_consensus.cc:515] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:26.689349 2852 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 07:53:26.689781 2852 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260617 07:53:26.689800 2629 leader_election.cc:290] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:26.689893 2852 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260617 07:53:26.690526 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9657e0dd2a8459cb728bdfe8a68b840" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.690999 986 leader_election.cc:343] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.694355 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 2a61124fa6f846a6be1a208f2eaa7c20
I20260617 07:53:26.698024 742 tablet_service.cc:1511] Processing CreateTablet for tablet 0030162ec9f840a59549649e9680a604 (DEFAULT_TABLE table=default.Table_3b2792fc15244bbf828a27c4156aca04 [id=57ccf11f50df47d68bb7fb2064782a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.698431 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0030162ec9f840a59549649e9680a604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.698951 756 tablet_service.cc:1511] Processing CreateTablet for tablet 35ab52c4bf1c4504a808d55198d44688 (DEFAULT_TABLE table=default.Table_b65ffd246e534b13b1963ce42362edb3 [id=2597faa18551439ca5948fe79679c626]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.699075 748 tablet_service.cc:1511] Processing CreateTablet for tablet 6a25507fd659408599b6681ebc067406 (DEFAULT_TABLE table=default.Table_0e521eaa5cf042d4a77d12fe71871ae2 [id=42d571fe6ae74c2aaf4b09096ba31418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.699244 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ab52c4bf1c4504a808d55198d44688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.699388 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a25507fd659408599b6681ebc067406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.703864 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a61124fa6f846a6be1a208f2eaa7c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.704280 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 0030162ec9f840a59549649e9680a604 (DEFAULT_TABLE table=default.Table_3b2792fc15244bbf828a27c4156aca04 [id=57ccf11f50df47d68bb7fb2064782a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.704608 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0030162ec9f840a59549649e9680a604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.706081 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 35ab52c4bf1c4504a808d55198d44688 (DEFAULT_TABLE table=default.Table_b65ffd246e534b13b1963ce42362edb3 [id=2597faa18551439ca5948fe79679c626]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.706284 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a61124fa6f846a6be1a208f2eaa7c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.706403 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ab52c4bf1c4504a808d55198d44688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.709949 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 6a25507fd659408599b6681ebc067406 (DEFAULT_TABLE table=default.Table_0e521eaa5cf042d4a77d12fe71871ae2 [id=42d571fe6ae74c2aaf4b09096ba31418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.710271 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a25507fd659408599b6681ebc067406. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:26.712100 2852 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260617 07:53:26.712185 2852 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 07:53:26.712256 2852 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 07:53:26.712345 2852 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 07:53:26.713086 2968 raft_consensus.cc:493] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.713207 2968 raft_consensus.cc:515] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.713894 2968 leader_election.cc:290] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:26.714555 716 leader_election.cc:343] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 49f0f68dcef34228a1b2a018e8aa329e
I20260617 07:53:26.716552 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 222c2596b6aa4cb18aa7a68657309545 (DEFAULT_TABLE table=default.Table_0e30edc72d824353b77f16a262127628 [id=816e133930cf46ac83f566c9cb93b4b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.716897 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222c2596b6aa4cb18aa7a68657309545. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:26.717015 713 leader_election.cc:343] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 49f0f68dcef34228a1b2a018e8aa329e
I20260617 07:53:26.717124 713 leader_election.cc:304] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.719013 2922 raft_consensus.cc:493] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.719148 2922 raft_consensus.cc:515] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.719717 2922 leader_election.cc:290] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.719975 742 tablet_service.cc:1511] Processing CreateTablet for tablet a0ef418967b34ad68a472ee9edc452a6 (DEFAULT_TABLE table=default.Table_fe72d813417e44f1af5c5a831d6db626 [id=46f1072e47fc406e89107cc58a4943fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.720748 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ef418967b34ad68a472ee9edc452a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.721154 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b111e65c497591c7daaa81d783c7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:26.721336 1051 raft_consensus.cc:2468] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:26.721839 851 leader_election.cc:304] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:26.722079 2922 raft_consensus.cc:2804] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:26.722159 2922 raft_consensus.cc:493] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:26.722213 2922 raft_consensus.cc:3060] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:26.724752 2922 raft_consensus.cc:515] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.725356 2922 leader_election.cc:290] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.725785 744 tablet_service.cc:1511] Processing CreateTablet for tablet c1104053d2f346db8c2d115f2e59025b (DEFAULT_TABLE table=default.Table_7696e2ad0ad344399a63554bebb4c01b [id=d8292bb58b7a482c8da8e17a632c9604]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.725796 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b111e65c497591c7daaa81d783c7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:26.725970 1051 raft_consensus.cc:3060] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:26.726229 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1104053d2f346db8c2d115f2e59025b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.727429 756 tablet_service.cc:1511] Processing CreateTablet for tablet 465fe925861e4225b94990d568c56eb7 (DEFAULT_TABLE table=default.Table_fe7d438c96ae4f7d845929f138eef545 [id=5dfe9a566efd4a3b8b7f32cf0bd710a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.727725 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465fe925861e4225b94990d568c56eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.728497 1051 raft_consensus.cc:2468] T e897b111e65c497591c7daaa81d783c7 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:26.728838 2852 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:37851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:41615,127.0.105.189:36505,127.0.105.188:33087
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:36505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.189
--webserver_port=38635
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 23b10557f461bc2be3d2c282748d8de96f9c46ec
build type FASTDEBUG
built by None at 17 Jun 2026 07:43:25 UTC on bdcb31816ec0
build id 12434
ASAN enabled
I20260617 07:53:26.729264 851 leader_election.cc:304] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:26.730316 758 tablet_service.cc:1511] Processing CreateTablet for tablet e9ce1ab3a01f48a4b744b2459b74ce33 (DEFAULT_TABLE table=default.Table_6af87dd49de84cf98ec173dc808e8c1f [id=1a88b95bc8bc4fcfb3173e4630ff0a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.730635 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ce1ab3a01f48a4b744b2459b74ce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.731226 2852 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 07:53:26.731617 755 tablet_service.cc:1511] Processing CreateTablet for tablet fa54cca4112d46f8890bb7f83512f8c0 (DEFAULT_TABLE table=default.Table_96bbd20483414a0fb8cd5558573b1567 [id=a6f5a3e990cc41718d82384faa2fe22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.731895 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa54cca4112d46f8890bb7f83512f8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.733673 2852 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260617 07:53:26.736929 2629 raft_consensus.cc:493] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.737092 2629 raft_consensus.cc:515] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.737738 2629 leader_election.cc:290] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.739207 1020 tablet_service.cc:1511] Processing CreateTablet for tablet a0ef418967b34ad68a472ee9edc452a6 (DEFAULT_TABLE table=default.Table_fe72d813417e44f1af5c5a831d6db626 [id=46f1072e47fc406e89107cc58a4943fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.739385 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70610822c57e45c7add7e1f5ce96d889" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.739585 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ef418967b34ad68a472ee9edc452a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.739889 2629 raft_consensus.cc:493] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.740027 2629 raft_consensus.cc:515] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.740558 2629 leader_election.cc:290] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:26.740899 986 leader_election.cc:343] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.741261 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306742b9da81497991d58947bf3c1ebb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.742111 1019 tablet_service.cc:1511] Processing CreateTablet for tablet 465fe925861e4225b94990d568c56eb7 (DEFAULT_TABLE table=default.Table_fe7d438c96ae4f7d845929f138eef545 [id=5dfe9a566efd4a3b8b7f32cf0bd710a2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:26.742511 986 leader_election.cc:343] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.742592 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465fe925861e4225b94990d568c56eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.745190 1178 tablet_bootstrap.cc:492] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.745597 1014 tablet_service.cc:1511] Processing CreateTablet for tablet c1104053d2f346db8c2d115f2e59025b (DEFAULT_TABLE table=default.Table_7696e2ad0ad344399a63554bebb4c01b [id=d8292bb58b7a482c8da8e17a632c9604]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:26.745779 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 95158.5us
I20260617 07:53:26.746136 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1104053d2f346db8c2d115f2e59025b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.746068 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e9ce1ab3a01f48a4b744b2459b74ce33 (DEFAULT_TABLE table=default.Table_6af87dd49de84cf98ec173dc808e8c1f [id=1a88b95bc8bc4fcfb3173e4630ff0a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.746675 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ce1ab3a01f48a4b744b2459b74ce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.750835 1178 tablet_bootstrap.cc:654] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.754367 755 tablet_service.cc:1511] Processing CreateTablet for tablet 73a2776154a34a7e9ef795e2e6bf95bd (DEFAULT_TABLE table=default.Table_4afb3bd966014d8dad4fc839499c4170 [id=3563b752a0e74d019042ae99be9632a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.754581 2629 raft_consensus.cc:493] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.754874 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a2776154a34a7e9ef795e2e6bf95bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.754782 2629 raft_consensus.cc:515] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.755789 2629 leader_election.cc:290] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.756399 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b06f77643dcb28f0c3136510253" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.756927 986 leader_election.cc:343] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.764065 2629 raft_consensus.cc:493] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.764269 2629 raft_consensus.cc:515] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.764941 1862 ts_tablet_manager.cc:1929] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:26.765120 1862 log.cc:1199] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/e03a26e301e747febc4d5bafdc1a49c6
I20260617 07:53:26.765328 2629 leader_election.cc:290] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.765419 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4afe4a3d708447fa7ab8bf53614c4ba" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.697685 456 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:26.765662 1862 ts_tablet_manager.cc:1950] T e03a26e301e747febc4d5bafdc1a49c6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:26.713569 455 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a2fb3ae720774615a6f2baf5ad675502" } new_table_name: "default.Table_a0a63ae5c835499ab66e8c9ab40f6968" modify_external_catalogs: true
I20260617 07:53:26.766868 1171 tablet_bootstrap.cc:492] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.766983 1171 ts_tablet_manager.cc:1403] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.099s user 0.002s sys 0.000s
I20260617 07:53:26.759847 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9f1c5148c98f470a88b93558ee1c10bc" } new_table_name: "default.Table_128f3daebe924878b11f8e247996538e" modify_external_catalogs: true
I20260617 07:53:26.767493 1030 tablet_service.cc:1511] Processing CreateTablet for tablet fa54cca4112d46f8890bb7f83512f8c0 (DEFAULT_TABLE table=default.Table_96bbd20483414a0fb8cd5558573b1567 [id=a6f5a3e990cc41718d82384faa2fe22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.767678 1171 raft_consensus.cc:359] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.767823 1171 raft_consensus.cc:385] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.767874 1171 raft_consensus.cc:740] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.768038 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa54cca4112d46f8890bb7f83512f8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.760072 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d36bea18179d4ba992d8795ee73dc19a" } new_table_name: "default.Table_8e65059cd2404d328ae4a38e6c883053" modify_external_catalogs: true
I20260617 07:53:26.768101 1171 consensus_queue.cc:260] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.768376 2774 raft_consensus.cc:2804] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:26.768476 2774 raft_consensus.cc:697] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:26.768672 2774 consensus_queue.cc:237] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.760288 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_53dd7ff956424419834c0bf475a02c5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.769557 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53dd7ff956424419834c0bf475a02c5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.760710 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_c656669c861245268eabb46173ee73d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.771436 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c656669c861245268eabb46173ee73d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:26.773000 986 leader_election.cc:343] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.765955 456 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 24066965db7141a6a970ec08f835a820 (table default.Table_50456ce872334470a5d513d6d074b0eb [id=8193bedf37784197bebc39d711a8eb2b]). Expected version 3 got 0
I20260617 07:53:26.781253 745 tablet_service.cc:1511] Processing CreateTablet for tablet 96479936187446439b68db81835801ba (DEFAULT_TABLE table=default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.781831 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96479936187446439b68db81835801ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.782214 755 tablet_service.cc:1511] Processing CreateTablet for tablet 7a41b1609c574c74848daba422fa2c2c (DEFAULT_TABLE table=default.Table_ecf79d16ff9b4ab3839a33f052ed19fd [id=107a3afbcbc741f79e1d5ca2f6cfdfa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.788501 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 96479936187446439b68db81835801ba (DEFAULT_TABLE table=default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.786676 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a41b1609c574c74848daba422fa2c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.789044 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96479936187446439b68db81835801ba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:26.790997 2861 raft_consensus.cc:670] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260617 07:53:26.791236 2861 raft_consensus.cc:2749] T 49f0f68dcef34228a1b2a018e8aa329e P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.791374 2861 raft_consensus.cc:493] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.791461 2861 raft_consensus.cc:515] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.792037 2861 leader_election.cc:290] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:26.793103 716 leader_election.cc:343] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: eba5976fcadd4add9c671300b431617b
I20260617 07:53:26.793478 1178 tablet_bootstrap.cc:492] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:26.796155 1171 ts_tablet_manager.cc:1434] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20260617 07:53:26.796495 1178 ts_tablet_manager.cc:1403] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260617 07:53:26.798076 1178 raft_consensus.cc:359] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.804456 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 8782bbb12c504b569995fb61f3571e02 (DEFAULT_TABLE table=default.Table_ed779c8a02e144ef81280862481c4efc [id=ddb966cd841d464dbef85e1b85b4f2a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.804914 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8782bbb12c504b569995fb61f3571e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.802243 2709 consensus_queue.cc:1048] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:26.808190 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 73a2776154a34a7e9ef795e2e6bf95bd (DEFAULT_TABLE table=default.Table_4afb3bd966014d8dad4fc839499c4170 [id=3563b752a0e74d019042ae99be9632a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.804190 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 7a41b1609c574c74848daba422fa2c2c (DEFAULT_TABLE table=default.Table_ecf79d16ff9b4ab3839a33f052ed19fd [id=107a3afbcbc741f79e1d5ca2f6cfdfa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.811383 1171 tablet_bootstrap.cc:492] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:26.812902 1171 tablet_bootstrap.cc:654] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.814415 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a2776154a34a7e9ef795e2e6bf95bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.815395 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a41b1609c574c74848daba422fa2c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.814556 1025 tablet_service.cc:1511] Processing CreateTablet for tablet a182ccfbf302402c9861c54dcac9e767 (DEFAULT_TABLE table=default.Table_d3613cd799784e968908338ef2f15b3b [id=1ab9f591a6b8482ba282ef37ebe4e02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.815878 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a182ccfbf302402c9861c54dcac9e767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.819344 1178 raft_consensus.cc:385] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.819435 1178 raft_consensus.cc:740] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.819644 1178 consensus_queue.cc:260] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.795511 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9561a1b846a24b1abb0b16bb82b417ad (DEFAULT_TABLE table=default.Table_0e2e4f2458344f1c842bef1b61a48f91 [id=1c4a857722e24a77b7f42504c2346aac]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:26.798873 713 leader_election.cc:343] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: eba5976fcadd4add9c671300b431617b
I20260617 07:53:26.819974 713 leader_election.cc:304] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.820132 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9561a1b846a24b1abb0b16bb82b417ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.807453 2968 raft_consensus.cc:493] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.820524 2968 raft_consensus.cc:515] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.821695 2968 leader_election.cc:290] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.821877 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24066965db7141a6a970ec08f835a820" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:26.824738 1862 tablet_replica.cc:333] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:26.827594 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b111e65c497591c7daaa81d783c7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:26.827731 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e897b111e65c497591c7daaa81d783c7" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:26.828190 2861 raft_consensus.cc:2749] T eba5976fcadd4add9c671300b431617b P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.828696 1172 ts_tablet_manager.cc:1434] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.143s user 0.001s sys 0.000s
I20260617 07:53:26.830368 748 tablet_service.cc:1511] Processing CreateTablet for tablet 1423177df804464ba83253b662c02c3c (DEFAULT_TABLE table=default.Table_dc7b26c228a74cf59483d84b3b7cd896 [id=7723e515b3e84a3c98fc2a9a31bcde7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.830775 741 tablet_service.cc:1511] Processing CreateTablet for tablet d95a7e6fda324402a7a59a335f876c08 (DEFAULT_TABLE table=default.Table_92b0d73b0ca04fd4bfb2980b6975bded [id=2bbb1b1be1b343e38b929eba3a4dc143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.831037 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1423177df804464ba83253b662c02c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.831326 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95a7e6fda324402a7a59a335f876c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.830802 758 tablet_service.cc:1511] Processing CreateTablet for tablet 07fd74bf93f84665a43a66c9f401b487 (DEFAULT_TABLE table=default.Table_3f841679edc0410a9304de3797c3344e [id=512f6d9b248a4cae8f306c9544deb1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.831653 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fd74bf93f84665a43a66c9f401b487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.831581 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24066965db7141a6a970ec08f835a820" candidate_uuid: "6438857e0a7741ceaadf84cb9dc979e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:26.834730 713 leader_election.cc:304] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.835632 2967 raft_consensus.cc:2749] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.838027 755 tablet_service.cc:1511] Processing CreateTablet for tablet 8782bbb12c504b569995fb61f3571e02 (DEFAULT_TABLE table=default.Table_ed779c8a02e144ef81280862481c4efc [id=ddb966cd841d464dbef85e1b85b4f2a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.838511 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8782bbb12c504b569995fb61f3571e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.840152 742 tablet_service.cc:1511] Processing CreateTablet for tablet 29702371305a435b92fa3bb0956fce14 (DEFAULT_TABLE table=default.Table_1c2e353824df416c8aa1877db624a6fe [id=613a6c85fc354feca86a805cc86bf2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.840484 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29702371305a435b92fa3bb0956fce14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.842175 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 07fd74bf93f84665a43a66c9f401b487 (DEFAULT_TABLE table=default.Table_3f841679edc0410a9304de3797c3344e [id=512f6d9b248a4cae8f306c9544deb1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.842868 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fd74bf93f84665a43a66c9f401b487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.844931 1846 raft_consensus.cc:2272] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.845563 1846 ts_tablet_manager.cc:1916] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.850344 1178 ts_tablet_manager.cc:1434] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.053s user 0.001s sys 0.000s
I20260617 07:53:26.851107 1178 tablet_bootstrap.cc:492] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.852651 1178 tablet_bootstrap.cc:654] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.857735 745 tablet_service.cc:1511] Processing CreateTablet for tablet 741e986ebfb2428ba2bd08c145a6df61 (DEFAULT_TABLE table=default.Table_e8d5433908044c5fbf9c88d7390b18e4 [id=79ea96f126514fe4ae239d26cae2c51d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.858778 744 tablet_service.cc:1511] Processing CreateTablet for tablet a182ccfbf302402c9861c54dcac9e767 (DEFAULT_TABLE table=default.Table_d3613cd799784e968908338ef2f15b3b [id=1ab9f591a6b8482ba282ef37ebe4e02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.859092 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741e986ebfb2428ba2bd08c145a6df61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.863117 1862 raft_consensus.cc:2243] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.863372 1862 raft_consensus.cc:2272] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.864027 1862 ts_tablet_manager.cc:1916] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.854943 1171 tablet_bootstrap.cc:492] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.865222 1171 ts_tablet_manager.cc:1403] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.054s user 0.001s sys 0.002s
I20260617 07:53:26.865967 1171 raft_consensus.cc:359] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.866186 1171 raft_consensus.cc:385] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.866276 1171 raft_consensus.cc:740] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.866539 1171 consensus_queue.cc:260] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.866866 1846 ts_tablet_manager.cc:1929] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:26.867192 1171 ts_tablet_manager.cc:1434] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:26.867492 1171 tablet_bootstrap.cc:492] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:26.868995 1171 tablet_bootstrap.cc:654] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:26.876428 2980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:53:26.878708 1846 log.cc:1199] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/df5bbdbcf3044128a4cb274f83d5d29b
I20260617 07:53:26.879215 1846 ts_tablet_manager.cc:1950] T df5bbdbcf3044128a4cb274f83d5d29b P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:26.869836 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a182ccfbf302402c9861c54dcac9e767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.843282 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 29702371305a435b92fa3bb0956fce14 (DEFAULT_TABLE table=default.Table_1c2e353824df416c8aa1877db624a6fe [id=613a6c85fc354feca86a805cc86bf2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.850932 2629 raft_consensus.cc:493] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.853111 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 9561a1b846a24b1abb0b16bb82b417ad (DEFAULT_TABLE table=default.Table_0e2e4f2458344f1c842bef1b61a48f91 [id=1c4a857722e24a77b7f42504c2346aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.859443 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 1423177df804464ba83253b662c02c3c (DEFAULT_TABLE table=default.Table_dc7b26c228a74cf59483d84b3b7cd896 [id=7723e515b3e84a3c98fc2a9a31bcde7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.882006 2629 raft_consensus.cc:515] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.882287 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9561a1b846a24b1abb0b16bb82b417ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.882522 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1423177df804464ba83253b662c02c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.882938 2629 leader_election.cc:290] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:26.884230 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29702371305a435b92fa3bb0956fce14. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:26.884804 986 consensus_peers.cc:597] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:26.885083 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b93b31475c4f29a7fdc387ffbff0cd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:26.885738 986 leader_election.cc:343] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:26.861143 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 741e986ebfb2428ba2bd08c145a6df61 (DEFAULT_TABLE table=default.Table_e8d5433908044c5fbf9c88d7390b18e4 [id=79ea96f126514fe4ae239d26cae2c51d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.887135 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741e986ebfb2428ba2bd08c145a6df61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.890277 1178 tablet_bootstrap.cc:492] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:26.862813 1019 tablet_service.cc:1511] Processing CreateTablet for tablet d95a7e6fda324402a7a59a335f876c08 (DEFAULT_TABLE table=default.Table_92b0d73b0ca04fd4bfb2980b6975bded [id=2bbb1b1be1b343e38b929eba3a4dc143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.891007 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95a7e6fda324402a7a59a335f876c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.893644 1178 ts_tablet_manager.cc:1403] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260617 07:53:26.864701 1020 tablet_service.cc:1511] Processing CreateTablet for tablet fc904f5b6a9a4b68a785b91427838f48 (DEFAULT_TABLE table=default.Table_eaa315a1ff0a47b2847c9e698da128eb [id=e91a97d0e77f48c294816c2837ff3f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.867816 2729 raft_consensus.cc:493] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.893863 2729 raft_consensus.cc:515] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:26.894043 756 tablet_service.cc:1511] Processing CreateTablet for tablet fc904f5b6a9a4b68a785b91427838f48 (DEFAULT_TABLE table=default.Table_eaa315a1ff0a47b2847c9e698da128eb [id=e91a97d0e77f48c294816c2837ff3f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.894403 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc904f5b6a9a4b68a785b91427838f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.894482 1178 raft_consensus.cc:359] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.894611 1178 raft_consensus.cc:385] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.894656 1178 raft_consensus.cc:740] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.868170 1172 tablet_bootstrap.cc:492] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:26.891292 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 735) took 4807 ms. Trace:
I20260617 07:53:26.896687 1846 rpcz_store.cc:276] 0617 07:53:22.084237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.084297 (+ 60us) service_pool.cc:224] Handling call
0617 07:53:26.366437 (+4282140us) ts_tablet_manager.cc:1151] Deleting tablet df5bbdbcf3044128a4cb274f83d5d29b
0617 07:53:26.366472 (+ 35us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.848625 (+482153us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.866809 (+ 18184us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.891270 (+ 24461us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4281902}
I20260617 07:53:26.897320 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet df5bbdbcf3044128a4cb274f83d5d29b (table default.Table_aab2b789b2dc48719838e0704687a406 [id=e42c6141367a4922ace753fd8ccf8463]) successfully deleted
I20260617 07:53:26.897684 1846 tablet_replica.cc:333] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:26.900336 1846 raft_consensus.cc:2243] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:26.903894 1846 raft_consensus.cc:2272] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.904786 1846 ts_tablet_manager.cc:1916] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:26.904125 1178 consensus_queue.cc:260] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.906798 1178 ts_tablet_manager.cc:1434] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260617 07:53:26.907984 1178 tablet_bootstrap.cc:492] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.908910 1170 ts_tablet_manager.cc:1929] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:26.909651 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet e03a26e301e747febc4d5bafdc1a49c6 (table default.Table_e90ad53742c6427a87f6e2dfad5f9e54 [id=30f9fa100b704eb9bbc9a42cd664a4a5]) successfully deleted
I20260617 07:53:26.912621 1178 tablet_bootstrap.cc:654] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.914290 1171 tablet_bootstrap.cc:492] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.914487 1171 ts_tablet_manager.cc:1403] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.001s
I20260617 07:53:26.915396 1171 raft_consensus.cc:359] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.915649 1171 raft_consensus.cc:385] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.915752 1171 raft_consensus.cc:740] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.916055 887 tablet_service.cc:1511] Processing CreateTablet for tablet c1104053d2f346db8c2d115f2e59025b (DEFAULT_TABLE table=default.Table_7696e2ad0ad344399a63554bebb4c01b [id=d8292bb58b7a482c8da8e17a632c9604]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.916235 888 tablet_service.cc:1511] Processing CreateTablet for tablet 96479936187446439b68db81835801ba (DEFAULT_TABLE table=default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.916422 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1104053d2f346db8c2d115f2e59025b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.916615 894 tablet_service.cc:1511] Processing CreateTablet for tablet 29702371305a435b92fa3bb0956fce14 (DEFAULT_TABLE table=default.Table_1c2e353824df416c8aa1877db624a6fe [id=613a6c85fc354feca86a805cc86bf2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.916673 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9561a1b846a24b1abb0b16bb82b417ad (DEFAULT_TABLE table=default.Table_0e2e4f2458344f1c842bef1b61a48f91 [id=1c4a857722e24a77b7f42504c2346aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.916847 883 tablet_service.cc:1511] Processing CreateTablet for tablet 0030162ec9f840a59549649e9680a604 (DEFAULT_TABLE table=default.Table_3b2792fc15244bbf828a27c4156aca04 [id=57ccf11f50df47d68bb7fb2064782a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.916962 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29702371305a435b92fa3bb0956fce14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.917111 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0030162ec9f840a59549649e9680a604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.916682 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a61124fa6f846a6be1a208f2eaa7c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:26 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.917369 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96479936187446439b68db81835801ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.921360 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9561a1b846a24b1abb0b16bb82b417ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.921510 881 tablet_service.cc:1511] Processing CreateTablet for tablet 7a41b1609c574c74848daba422fa2c2c (DEFAULT_TABLE table=default.Table_ecf79d16ff9b4ab3839a33f052ed19fd [id=107a3afbcbc741f79e1d5ca2f6cfdfa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.921854 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a41b1609c574c74848daba422fa2c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.921955 884 tablet_service.cc:1511] Processing CreateTablet for tablet 35ab52c4bf1c4504a808d55198d44688 (DEFAULT_TABLE table=default.Table_b65ffd246e534b13b1963ce42362edb3 [id=2597faa18551439ca5948fe79679c626]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.922259 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ab52c4bf1c4504a808d55198d44688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.923780 2775 raft_consensus.cc:493] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.923889 2775 raft_consensus.cc:515] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.924479 2775 leader_election.cc:290] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.925278 2922 raft_consensus.cc:493] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.925377 2922 raft_consensus.cc:515] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.925984 882 tablet_service.cc:1511] Processing CreateTablet for tablet a0ef418967b34ad68a472ee9edc452a6 (DEFAULT_TABLE table=default.Table_fe72d813417e44f1af5c5a831d6db626 [id=46f1072e47fc406e89107cc58a4943fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.926245 2922 leader_election.cc:290] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.926353 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ef418967b34ad68a472ee9edc452a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.915777 879 tablet_service.cc:1558] Processing DeleteTablet for tablet d965aa4e8dc244cdb93dd15cdee9070c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:26.916055 886 tablet_service.cc:1511] Processing CreateTablet for tablet 73a2776154a34a7e9ef795e2e6bf95bd (DEFAULT_TABLE table=default.Table_4afb3bd966014d8dad4fc839499c4170 [id=3563b752a0e74d019042ae99be9632a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.927224 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a2776154a34a7e9ef795e2e6bf95bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.928095 2775 raft_consensus.cc:493] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.928201 2775 raft_consensus.cc:515] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.928787 2775 leader_election.cc:290] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:26.929597 1045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b93b31475c4f29a7fdc387ffbff0cd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:26.929981 889 tablet_service.cc:1511] Processing CreateTablet for tablet 465fe925861e4225b94990d568c56eb7 (DEFAULT_TABLE table=default.Table_fe7d438c96ae4f7d845929f138eef545 [id=5dfe9a566efd4a3b8b7f32cf0bd710a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.930305 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465fe925861e4225b94990d568c56eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.930341 1171 consensus_queue.cc:260] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.930934 1171 ts_tablet_manager.cc:1434] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20260617 07:53:26.931196 1171 tablet_bootstrap.cc:492] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:26.915584 885 tablet_service.cc:1511] Processing CreateTablet for tablet 6a25507fd659408599b6681ebc067406 (DEFAULT_TABLE table=default.Table_0e521eaa5cf042d4a77d12fe71871ae2 [id=42d571fe6ae74c2aaf4b09096ba31418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.931749 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a25507fd659408599b6681ebc067406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.932518 1171 tablet_bootstrap.cc:654] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:26.933972 896 tablet_service.cc:1511] Processing CreateTablet for tablet e9ce1ab3a01f48a4b744b2459b74ce33 (DEFAULT_TABLE table=default.Table_6af87dd49de84cf98ec173dc808e8c1f [id=1a88b95bc8bc4fcfb3173e4630ff0a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.934284 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ce1ab3a01f48a4b744b2459b74ce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.935274 1862 ts_tablet_manager.cc:1929] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:26.935355 1862 log.cc:1199] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/e9f8492f127243eca07b2ffbabddded5
I20260617 07:53:26.935622 1862 ts_tablet_manager.cc:1950] T e9f8492f127243eca07b2ffbabddded5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:26.937976 880 tablet_service.cc:1511] Processing CreateTablet for tablet fa54cca4112d46f8890bb7f83512f8c0 (DEFAULT_TABLE table=default.Table_96bbd20483414a0fb8cd5558573b1567 [id=a6f5a3e990cc41718d82384faa2fe22f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.938285 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa54cca4112d46f8890bb7f83512f8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.942431 890 tablet_service.cc:1511] Processing CreateTablet for tablet 8782bbb12c504b569995fb61f3571e02 (DEFAULT_TABLE table=default.Table_ed779c8a02e144ef81280862481c4efc [id=ddb966cd841d464dbef85e1b85b4f2a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.942744 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8782bbb12c504b569995fb61f3571e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.942811 2968 raft_consensus.cc:493] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:26.942948 2968 raft_consensus.cc:515] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.943596 2968 leader_election.cc:290] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:26.944463 716 leader_election.cc:343] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 6d8f144d04af4ea18f99aee3b82f4a28
W20260617 07:53:26.945575 713 leader_election.cc:343] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 6d8f144d04af4ea18f99aee3b82f4a28
I20260617 07:53:26.945690 713 leader_election.cc:304] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:26.945969 895 tablet_service.cc:1511] Processing CreateTablet for tablet a182ccfbf302402c9861c54dcac9e767 (DEFAULT_TABLE table=default.Table_d3613cd799784e968908338ef2f15b3b [id=1ab9f591a6b8482ba282ef37ebe4e02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.946305 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a182ccfbf302402c9861c54dcac9e767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.947456 2968 raft_consensus.cc:2749] T 6d8f144d04af4ea18f99aee3b82f4a28 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:26.916615 898 tablet_service.cc:1511] Processing CreateTablet for tablet 222c2596b6aa4cb18aa7a68657309545 (DEFAULT_TABLE table=default.Table_0e30edc72d824353b77f16a262127628 [id=816e133930cf46ac83f566c9cb93b4b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:26.950186 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222c2596b6aa4cb18aa7a68657309545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.954120 1862 tablet_replica.cc:333] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:26.954385 1862 raft_consensus.cc:2243] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:26.954668 1862 pending_rounds.cc:70] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: Trying to abort 1 pending ops.
I20260617 07:53:26.954789 1862 pending_rounds.cc:77] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297772773944438784 op_type: NO_OP noop_request { }
I20260617 07:53:26.954963 1862 raft_consensus.cc:2889] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 07:53:26.955168 1862 raft_consensus.cc:2272] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:26.959399 454 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_e91a294b722e4fa78fe4da45cb992b73 [id=829b5684836747b2aa4265ac17eccd80] alter complete (version 3)
I20260617 07:53:26.960958 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0b8d9a982e3f4e32b0be803ba561fde3" } new_table_name: "default.Table_9690441ca20a484789fef0743507116a" modify_external_catalogs: true
I20260617 07:53:26.963088 456 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_612c40ad98cf4d74b2c9482899daa7cb" } new_table_name: "default.Table_bb9764511f9f4b43b012ea7e50f604ac" modify_external_catalogs: true
I20260617 07:53:26.964771 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f0f68dcef34228a1b2a018e8aa329e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:17 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.964883 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 40900f4b7a604abd9b020c2b396fb942
I20260617 07:53:26.965011 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d94915d96694d6f9a86063640e5fe18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.965394 457 catalog_manager.cc:6784] ReplaceTablet: tablet 40900f4b7a604abd9b020c2b396fb942 deleted and replaced by tablet c50bac8eef6741269ba4466ecd5471ef
I20260617 07:53:26.966073 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8a8ef12b33d642e3b1255efde7e16ee8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.966552 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a8ef12b33d642e3b1255efde7e16ee8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.969039 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_9c248f404ed44b42b97f06999da76249"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:26.969655 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c248f404ed44b42b97f06999da76249 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:26.969735 742 tablet_service.cc:1558] Processing DeleteTablet for tablet 40900f4b7a604abd9b020c2b396fb942 with delete_type TABLET_DATA_DELETED (replaced by tablet c50bac8eef6741269ba4466ecd5471ef) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:26.969775 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 306742b9da81497991d58947bf3c1ebb with delete_type TABLET_DATA_DELETED (replaced by tablet c8848c0f52e34c118a9e1831b8c9a88e) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:26.988348 1171 tablet_bootstrap.cc:492] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:26.988581 1171 ts_tablet_manager.cc:1403] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.057s user 0.018s sys 0.017s
I20260617 07:53:26.989229 1171 raft_consensus.cc:359] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.989393 1171 raft_consensus.cc:385] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.989439 1171 raft_consensus.cc:740] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.989604 1171 consensus_queue.cc:260] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.990085 1171 ts_tablet_manager.cc:1434] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260617 07:53:26.990808 1178 tablet_bootstrap.cc:492] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:26.990922 1846 ts_tablet_manager.cc:1929] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:26.991083 1846 log.cc:1199] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/66140c5d364f453a8089f143cc96ede8
I20260617 07:53:26.991466 1846 ts_tablet_manager.cc:1950] T 66140c5d364f453a8089f143cc96ede8 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:26.992682 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737e9344fc824714a2c2596170637158" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:26.990962 1178 ts_tablet_manager.cc:1403] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.000s
I20260617 07:53:26.993017 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc904f5b6a9a4b68a785b91427838f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:26.993572 1178 raft_consensus.cc:359] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:26.993834 1178 raft_consensus.cc:385] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:26.993927 1178 raft_consensus.cc:740] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:26.994216 1178 consensus_queue.cc:260] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.001016 1178 ts_tablet_manager.cc:1434] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260617 07:53:27.001662 1178 tablet_bootstrap.cc:492] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:26.992939 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f1051b9dd04db5a8f1245242d39376" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:27.003888 1178 tablet_bootstrap.cc:654] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.004263 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 739) took 4907 ms. Trace:
I20260617 07:53:27.008260 1846 rpcz_store.cc:276] 0617 07:53:22.096292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.096337 (+ 45us) service_pool.cc:224] Handling call
0617 07:53:26.897637 (+4801300us) ts_tablet_manager.cc:1151] Deleting tablet 66140c5d364f453a8089f143cc96ede8
0617 07:53:26.897647 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.914708 (+ 17061us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.985635 (+ 70927us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.004245 (+ 18610us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4797099}
I20260617 07:53:27.010059 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 66140c5d364f453a8089f143cc96ede8 (table default.Table_bda16d6b118048ceb24acecf1a6864ce [id=2adce07b80e24a6eaf19d88d3444701d]) successfully deleted
I20260617 07:53:27.010586 1846 tablet_replica.cc:333] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:27.010888 1846 raft_consensus.cc:2243] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:27.011132 1846 raft_consensus.cc:2272] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:27.011734 1846 ts_tablet_manager.cc:1916] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.020588 1178 tablet_bootstrap.cc:492] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.020789 1178 ts_tablet_manager.cc:1403] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260617 07:53:27.021534 1178 raft_consensus.cc:359] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.021832 1178 raft_consensus.cc:385] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.021941 1178 raft_consensus.cc:740] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.022256 1178 consensus_queue.cc:260] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.023111 1178 ts_tablet_manager.cc:1434] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:27.023424 1178 tablet_bootstrap.cc:492] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.025825 1178 tablet_bootstrap.cc:654] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.029229 1014 tablet_service.cc:1558] Processing DeleteTablet for tablet ce7cb453c7b647f298a6ebe20fd0e45b with delete_type TABLET_DATA_DELETED (replaced by tablet 0b85d49f255940eeaf343bfcf71e00e9) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.029212 1045 raft_consensus.cc:2468] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:27.029405 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e8f7118aaf4c6a9b9caab5abc030fa with delete_type TABLET_DATA_DELETED (replaced by tablet 52af94bd46c941b8a27136ca0506e744) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.029644 1051 raft_consensus.cc:2468] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:27.029657 1050 raft_consensus.cc:2468] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:27.029376 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 40900f4b7a604abd9b020c2b396fb942 with delete_type TABLET_DATA_DELETED (replaced by tablet c50bac8eef6741269ba4466ecd5471ef) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.030102 851 leader_election.cc:304] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:27.030256 1170 log.cc:1199] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/e03a26e301e747febc4d5bafdc1a49c6
I20260617 07:53:27.030457 2775 raft_consensus.cc:2804] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:27.030534 2775 raft_consensus.cc:493] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:27.030592 2775 raft_consensus.cc:3060] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.030685 1170 ts_tablet_manager.cc:1950] T e03a26e301e747febc4d5bafdc1a49c6 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:27.033037 2775 raft_consensus.cc:515] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.034518 851 leader_election.cc:304] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:27.034749 851 leader_election.cc:304] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:27.035236 2709 raft_consensus.cc:2804] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:27.035308 2709 raft_consensus.cc:493] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:27.035365 2709 raft_consensus.cc:3060] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.041172 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b93b31475c4f29a7fdc387ffbff0cd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:27.041396 1050 raft_consensus.cc:3060] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.042171 2774 raft_consensus.cc:2804] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:27.042248 2774 raft_consensus.cc:493] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:27.042315 2774 raft_consensus.cc:3060] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.043284 2709 raft_consensus.cc:515] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.043776 2709 leader_election.cc:290] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.044450 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737e9344fc824714a2c2596170637158" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:27.044588 1051 raft_consensus.cc:3060] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.044759 1050 raft_consensus.cc:2468] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:27.046981 1051 raft_consensus.cc:2468] T 737e9344fc824714a2c2596170637158 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:27.047528 851 leader_election.cc:304] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:27.047772 851 leader_election.cc:304] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:27.048219 2710 raft_consensus.cc:2804] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:27.048311 2710 raft_consensus.cc:697] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:27.048511 2710 consensus_queue.cc:237] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.053220 2774 raft_consensus.cc:515] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.053843 2774 leader_election.cc:290] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.055370 2774 raft_consensus.cc:2804] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:27.055781 2774 raft_consensus.cc:697] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:27.056217 2774 consensus_queue.cc:237] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.059387 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f1051b9dd04db5a8f1245242d39376" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:27.059578 1051 raft_consensus.cc:3060] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.061911 1051 raft_consensus.cc:2468] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:27.033663 2775 leader_election.cc:290] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.062994 1171 tablet_bootstrap.cc:492] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:27.063917 2709 consensus_queue.cc:1048] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:27.072975 851 leader_election.cc:304] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:27.073429 2775 raft_consensus.cc:2804] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:27.073581 2775 raft_consensus.cc:697] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:27.073942 2775 consensus_queue.cc:237] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.085451 2968 raft_consensus.cc:493] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.085620 2968 raft_consensus.cc:515] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.086238 2968 leader_election.cc:290] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:27.087251 716 leader_election.cc:343] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 596ef68705c84791b54f07e03b219b4c
W20260617 07:53:27.088261 713 leader_election.cc:343] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 596ef68705c84791b54f07e03b219b4c
I20260617 07:53:27.088358 713 leader_election.cc:304] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.088755 2968 raft_consensus.cc:2749] T 596ef68705c84791b54f07e03b219b4c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:27.090085 455 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75149090e9ab4eed93bd635cde173000 consensus state has no leader
W20260617 07:53:27.094067 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89fe6f819bed46c189951747fc2a9560 consensus state has no leader
I20260617 07:53:27.098573 458 master_service.cc:960] ReplaceTablet: received request to replace tablet 3d248d3bce0c4c19a9c07e94f875730a from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:27.099352 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9c5fa2145a4b4a6bba8a236cd0573e66" } modify_external_catalogs: true
I20260617 07:53:27.099560 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_9c5fa2145a4b4a6bba8a236cd0573e66" } modify_external_catalogs: true
I20260617 07:53:27.029229 1846 ts_tablet_manager.cc:1929] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:27.102540 1846 log.cc:1199] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/6f2d9e473fd444efa6ab63cc51dbb2bd
I20260617 07:53:27.102960 1846 ts_tablet_manager.cc:1950] T 6f2d9e473fd444efa6ab63cc51dbb2bd P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:27.103717 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 741) took 4995 ms. Trace:
I20260617 07:53:27.103855 1846 rpcz_store.cc:276] 0617 07:53:22.108450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.108506 (+ 56us) service_pool.cc:224] Handling call
0617 07:53:27.010526 (+4902020us) ts_tablet_manager.cc:1151] Deleting tablet 6f2d9e473fd444efa6ab63cc51dbb2bd
0617 07:53:27.010542 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.014821 (+ 4279us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.029175 (+ 14354us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.103699 (+ 74524us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4901759}
I20260617 07:53:27.103996 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_69c3ba19e7584094b3015b54aa67d1e7" } modify_external_catalogs: true
I20260617 07:53:27.104215 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_69c3ba19e7584094b3015b54aa67d1e7" } modify_external_catalogs: true
I20260617 07:53:27.104444 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 742) took 4995 ms. Trace:
I20260617 07:53:27.104509 1846 rpcz_store.cc:276] 0617 07:53:22.108565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.108729 (+ 164us) service_pool.cc:224] Handling call
0617 07:53:27.104326 (+4995597us) ts_tablet_manager.cc:1151] Deleting tablet 18e866278bb64196ba96e7d870195362
0617 07:53:27.104336 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.104430 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4995423}
I20260617 07:53:27.104899 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 753) took 4931 ms. Trace:
I20260617 07:53:27.104959 1846 rpcz_store.cc:276] 0617 07:53:22.173394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.173443 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:27.104805 (+4931362us) ts_tablet_manager.cc:1151] Deleting tablet 9c86376216db4788b38bd55248e03f73
0617 07:53:27.104813 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.104887 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4931099}
I20260617 07:53:27.105320 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 752) took 4932 ms. Trace:
I20260617 07:53:27.105377 1846 rpcz_store.cc:276] 0617 07:53:22.173288 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.214296 (+ 41008us) service_pool.cc:224] Handling call
0617 07:53:27.105240 (+4890944us) ts_tablet_manager.cc:1151] Deleting tablet 6a6e2bb6577648d2ab958cfaa6f4a948
0617 07:53:27.105248 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.105308 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4890708}
I20260617 07:53:27.105633 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 6f2d9e473fd444efa6ab63cc51dbb2bd (table default.Table_378c24318c924a5e8dcfb5295dc43493 [id=daa30b155c944cb098436474cfd8321c]) successfully deleted
I20260617 07:53:27.105850 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 758) took 4627 ms. Trace:
I20260617 07:53:27.105911 1846 rpcz_store.cc:276] 0617 07:53:22.478872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:22.478963 (+ 91us) service_pool.cc:224] Handling call
0617 07:53:27.105769 (+4626806us) ts_tablet_manager.cc:1151] Deleting tablet f30f0bbfdf404569a417662861b06f73
0617 07:53:27.105777 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.105838 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4618201}
W20260617 07:53:27.105997 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 18e866278bb64196ba96e7d870195362 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18e866278bb64196ba96e7d870195362 already in progress: creating tablet
W20260617 07:53:27.106220 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 9c86376216db4788b38bd55248e03f73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c86376216db4788b38bd55248e03f73 already in progress: creating tablet
I20260617 07:53:27.106271 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 766) took 4046 ms. Trace:
W20260617 07:53:27.106437 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 6a6e2bb6577648d2ab958cfaa6f4a948 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a6e2bb6577648d2ab958cfaa6f4a948 already in progress: creating tablet
W20260617 07:53:27.106660 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f30f0bbfdf404569a417662861b06f73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f30f0bbfdf404569a417662861b06f73 already in progress: creating tablet
I20260617 07:53:27.107560 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 2735f7dd40e54aec9004b9b38702607c (table default.Table_804e7505dc3b49c9b60065387b8b5810 [id=d98cbc567cf246c98834f633ba6f8a9d]). Expected version 2 got 0
I20260617 07:53:27.120223 2968 raft_consensus.cc:493] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.120371 2968 raft_consensus.cc:515] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.120900 2968 leader_election.cc:290] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:27.122092 716 leader_election.cc:343] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 92e55be5f28740fba65c1199a571d97a
I20260617 07:53:27.122140 883 tablet_service.cc:1511] Processing CreateTablet for tablet 07fd74bf93f84665a43a66c9f401b487 (DEFAULT_TABLE table=default.Table_3f841679edc0410a9304de3797c3344e [id=512f6d9b248a4cae8f306c9544deb1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.122568 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fd74bf93f84665a43a66c9f401b487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.122623 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9657e0dd2a8459cb728bdfe8a68b840" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:27.122699 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70610822c57e45c7add7e1f5ce96d889" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:27.122818 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306742b9da81497991d58947bf3c1ebb" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:27.123210 713 leader_election.cc:343] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 92e55be5f28740fba65c1199a571d97a
I20260617 07:53:27.123296 713 leader_election.cc:304] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.123593 2968 raft_consensus.cc:2749] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.123611 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b06f77643dcb28f0c3136510253" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:27.124010 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4afe4a3d708447fa7ab8bf53614c4ba" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:27.124720 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b93b31475c4f29a7fdc387ffbff0cd" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:27.126012 895 tablet_service.cc:1511] Processing CreateTablet for tablet 1423177df804464ba83253b662c02c3c (DEFAULT_TABLE table=default.Table_dc7b26c228a74cf59483d84b3b7cd896 [id=7723e515b3e84a3c98fc2a9a31bcde7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.126350 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1423177df804464ba83253b662c02c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.126444 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f1051b9dd04db5a8f1245242d39376" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.126793 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737e9344fc824714a2c2596170637158" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.127300 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b93b31475c4f29a7fdc387ffbff0cd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.127806 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet e9f8492f127243eca07b2ffbabddded5 (table default.Table_77163a83bea3432b8b2ea745bef42ce8 [id=2cd57d521b8b4434b456c086f0e36de8]) successfully deleted
W20260617 07:53:27.128075 448 catalog_manager.cc:4994] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet 51e757e6f4ce4c6eb8223c4b6955245e because the tablet was not found. No further retry: Not found: Tablet not found: 51e757e6f4ce4c6eb8223c4b6955245e
I20260617 07:53:27.128086 898 tablet_service.cc:1511] Processing CreateTablet for tablet d95a7e6fda324402a7a59a335f876c08 (DEFAULT_TABLE table=default.Table_92b0d73b0ca04fd4bfb2980b6975bded [id=2bbb1b1be1b343e38b929eba3a4dc143]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:27.128299 448 catalog_manager.cc:5007] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): delete failed for tablet ef67fe2d23444f77bf415fc9aad1db62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef67fe2d23444f77bf415fc9aad1db62 already in progress: creating tablet
I20260617 07:53:27.128415 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95a7e6fda324402a7a59a335f876c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.128780 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 612) took 3375 ms. Trace:
I20260617 07:53:27.128868 1170 rpcz_store.cc:276] 0617 07:53:23.753411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.769604 (+ 16193us) service_pool.cc:224] Handling call
0617 07:53:26.664804 (+2895200us) ts_tablet_manager.cc:1151] Deleting tablet e03a26e301e747febc4d5bafdc1a49c6
0617 07:53:26.664814 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:26.677773 (+ 12959us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:26.908840 (+231067us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.128614 (+219774us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2894973}
I20260617 07:53:27.129015 889 tablet_service.cc:1511] Processing CreateTablet for tablet 741e986ebfb2428ba2bd08c145a6df61 (DEFAULT_TABLE table=default.Table_e8d5433908044c5fbf9c88d7390b18e4 [id=79ea96f126514fe4ae239d26cae2c51d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.129316 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741e986ebfb2428ba2bd08c145a6df61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.129537 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 626) took 3301 ms. Trace:
I20260617 07:53:27.129621 1170 rpcz_store.cc:276] 0617 07:53:23.827963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.829010 (+ 1047us) service_pool.cc:224] Handling call
0617 07:53:27.129428 (+3300418us) ts_tablet_manager.cc:1151] Deleting tablet e5544753b3144c1989f2ed99bffc2246
0617 07:53:27.129438 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.129522 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3285175}
I20260617 07:53:27.129771 896 tablet_service.cc:1511] Processing CreateTablet for tablet fc904f5b6a9a4b68a785b91427838f48 (DEFAULT_TABLE table=default.Table_eaa315a1ff0a47b2847c9e698da128eb [id=e91a97d0e77f48c294816c2837ff3f26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.130070 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc904f5b6a9a4b68a785b91427838f48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:27.130052 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e5544753b3144c1989f2ed99bffc2246 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5544753b3144c1989f2ed99bffc2246 already in progress: creating tablet
I20260617 07:53:27.130344 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 633) took 3201 ms. Trace:
I20260617 07:53:27.130414 1170 rpcz_store.cc:276] 0617 07:53:23.928691 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.928767 (+ 76us) service_pool.cc:224] Handling call
0617 07:53:27.130268 (+3201501us) ts_tablet_manager.cc:1151] Deleting tablet d965aa4e8dc244cdb93dd15cdee9070c
0617 07:53:27.130276 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.130328 (+ 52us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3201297}
I20260617 07:53:27.063858 1172 tablet_bootstrap.cc:654] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:27.130812 445 catalog_manager.cc:4994] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet d965aa4e8dc244cdb93dd15cdee9070c because the tablet was not found. No further retry: Not found: Tablet not found: d965aa4e8dc244cdb93dd15cdee9070c
I20260617 07:53:27.130817 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 40900f4b7a604abd9b020c2b396fb942 with delete_type TABLET_DATA_DELETED (replaced by tablet c50bac8eef6741269ba4466ecd5471ef) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:27.131075 1170 tablet_replica.cc:333] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:27.131265 1170 raft_consensus.cc:2243] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:27.131397 1170 raft_consensus.cc:2272] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:27.132479 1170 ts_tablet_manager.cc:1916] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.132534 1178 tablet_bootstrap.cc:492] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.132725 1178 ts_tablet_manager.cc:1403] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.109s user 0.005s sys 0.000s
I20260617 07:53:27.133457 1178 raft_consensus.cc:359] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.133826 1178 raft_consensus.cc:385] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.133940 1178 raft_consensus.cc:740] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.134218 1178 consensus_queue.cc:260] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.142381 1862 ts_tablet_manager.cc:1916] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.143388 1172 tablet_bootstrap.cc:492] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.143548 1172 ts_tablet_manager.cc:1403] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.275s user 0.005s sys 0.000s
I20260617 07:53:27.144351 1172 raft_consensus.cc:359] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.144560 1172 raft_consensus.cc:385] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.144634 1172 raft_consensus.cc:740] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.144853 1172 consensus_queue.cc:260] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.145409 1172 ts_tablet_manager.cc:1434] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 07:53:27.147879 1178 ts_tablet_manager.cc:1434] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260617 07:53:27.150329 1178 tablet_bootstrap.cc:492] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.153980 1172 tablet_bootstrap.cc:492] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.155807 1172 tablet_bootstrap.cc:654] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.164052 1178 tablet_bootstrap.cc:654] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.166958 1172 tablet_bootstrap.cc:492] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.167115 1172 ts_tablet_manager.cc:1403] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
I20260617 07:53:27.167896 1172 raft_consensus.cc:359] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.168072 1172 raft_consensus.cc:385] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.168133 1172 raft_consensus.cc:740] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.168367 1172 consensus_queue.cc:260] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.168936 1172 ts_tablet_manager.cc:1434] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:27.169696 1172 tablet_bootstrap.cc:492] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.171756 1172 tablet_bootstrap.cc:654] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.183171 2996 raft_consensus.cc:493] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.183311 2996 raft_consensus.cc:515] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.183884 2996 leader_election.cc:290] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.185082 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db4fdde370e4d30bbf14285923644a1" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:27.185354 1050 raft_consensus.cc:2468] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:27.185827 851 leader_election.cc:304] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:27.186257 2996 raft_consensus.cc:2804] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:27.186348 2996 raft_consensus.cc:493] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:27.186429 2996 raft_consensus.cc:3060] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.189127 1172 tablet_bootstrap.cc:492] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.189280 1172 ts_tablet_manager.cc:1403] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.005s
I20260617 07:53:27.189370 2996 raft_consensus.cc:515] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.189976 1172 raft_consensus.cc:359] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.190132 1172 raft_consensus.cc:385] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.190200 1172 raft_consensus.cc:740] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.190397 1172 consensus_queue.cc:260] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.190884 1172 ts_tablet_manager.cc:1434] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:27.191150 1172 tablet_bootstrap.cc:492] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.191082 1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db4fdde370e4d30bbf14285923644a1" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:27.190874 2996 leader_election.cc:290] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.191250 1050 raft_consensus.cc:3060] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.195003 1050 raft_consensus.cc:2468] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:27.195469 851 leader_election.cc:304] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:27.195727 2710 raft_consensus.cc:2804] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:27.195880 2710 raft_consensus.cc:697] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:27.196290 2710 consensus_queue.cc:237] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.196903 1172 tablet_bootstrap.cc:654] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.199085 2987 raft_consensus.cc:493] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b7080d37ca245fe914d3dc90f17e3ba)
I20260617 07:53:27.199229 2987 raft_consensus.cc:515] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.199836 2987 leader_election.cc:290] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:27.200165 1178 tablet_bootstrap.cc:492] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.200287 1178 ts_tablet_manager.cc:1403] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.004s
I20260617 07:53:27.200362 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770a5216299842b890d483ca37b0ee86" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:27.200891 986 leader_election.cc:343] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.200994 1178 raft_consensus.cc:359] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.201215 1178 raft_consensus.cc:385] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.201303 1178 raft_consensus.cc:740] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.201562 1178 consensus_queue.cc:260] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.203409 1178 ts_tablet_manager.cc:1434] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 07:53:27.204530 1171 tablet_bootstrap.cc:654] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.206190 1178 tablet_bootstrap.cc:492] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.207448 1178 tablet_bootstrap.cc:654] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.212779 1172 tablet_bootstrap.cc:492] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.212915 1172 ts_tablet_manager.cc:1403] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.004s
I20260617 07:53:27.213569 1172 raft_consensus.cc:359] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.213760 1172 raft_consensus.cc:385] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.213814 1172 raft_consensus.cc:740] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.214007 1172 consensus_queue.cc:260] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.214432 1172 ts_tablet_manager.cc:1434] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260617 07:53:27.214704 1172 tablet_bootstrap.cc:492] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.216845 1172 tablet_bootstrap.cc:654] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.220341 1178 tablet_bootstrap.cc:492] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.220567 1178 ts_tablet_manager.cc:1403] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.002s
I20260617 07:53:27.222309 1178 raft_consensus.cc:359] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.222600 1178 raft_consensus.cc:385] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.222718 1178 raft_consensus.cc:740] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.223076 1178 consensus_queue.cc:260] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.224895 1178 ts_tablet_manager.cc:1434] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 07:53:27.225600 1178 tablet_bootstrap.cc:492] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.227340 1178 tablet_bootstrap.cc:654] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.231575 1846 rpcz_store.cc:276] 0617 07:53:23.059732 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.070933 (+ 11201us) service_pool.cc:224] Handling call
0617 07:53:27.106189 (+4035256us) ts_tablet_manager.cc:1151] Deleting tablet 146d1b46891a416aafe55aa740e1569e
0617 07:53:27.106197 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.106259 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4035102}
W20260617 07:53:27.232146 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 146d1b46891a416aafe55aa740e1569e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 146d1b46891a416aafe55aa740e1569e already in progress: creating tablet
I20260617 07:53:27.232189 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 768) took 4172 ms. Trace:
I20260617 07:53:27.232256 1846 rpcz_store.cc:276] 0617 07:53:23.059895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.071121 (+ 11226us) service_pool.cc:224] Handling call
0617 07:53:27.232061 (+4160940us) ts_tablet_manager.cc:1151] Deleting tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1
0617 07:53:27.232071 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.232174 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4160820}
I20260617 07:53:27.232620 1846 tablet_replica.cc:333] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:27.232672 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25fc2eaa32e54f7088ecdeb9b2dfa9e1 already in progress: creating tablet
I20260617 07:53:27.233054 1846 raft_consensus.cc:2243] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:27.219647 2710 raft_consensus.cc:493] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.233588 2710 raft_consensus.cc:515] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.234148 2710 leader_election.cc:290] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:27.235622 851 leader_election.cc:343] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: d06187aa09fd4776a992a07405a10876
I20260617 07:53:27.236182 1846 raft_consensus.cc:2272] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:27.236893 1846 ts_tablet_manager.cc:1916] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.242591 1172 tablet_bootstrap.cc:492] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.242777 1172 ts_tablet_manager.cc:1403] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.003s
I20260617 07:53:27.243692 1172 raft_consensus.cc:359] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.243875 1172 raft_consensus.cc:385] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.243935 1172 raft_consensus.cc:740] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.244275 1172 consensus_queue.cc:260] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.244621 1178 tablet_bootstrap.cc:492] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.244812 1178 ts_tablet_manager.cc:1403] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
I20260617 07:53:27.245626 1172 ts_tablet_manager.cc:1434] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:27.245961 1178 raft_consensus.cc:359] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.246443 1178 raft_consensus.cc:385] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.246552 1178 raft_consensus.cc:740] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.246585 1172 tablet_bootstrap.cc:492] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.246861 1178 consensus_queue.cc:260] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.248065 1172 tablet_bootstrap.cc:654] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.253003 1178 ts_tablet_manager.cc:1434] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 07:53:27.254060 1178 tablet_bootstrap.cc:492] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.254400 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b93b31475c4f29a7fdc387ffbff0cd" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:27.256021 1178 tablet_bootstrap.cc:654] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.258405 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a3a4eb2e45ac47a7a0fef33dc402a4c2" } modify_external_catalogs: true
I20260617 07:53:27.258581 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_a3a4eb2e45ac47a7a0fef33dc402a4c2" } modify_external_catalogs: true
W20260617 07:53:27.259199 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b48d79739dac47b7b202c3652671e29b consensus state has no leader
I20260617 07:53:27.259554 454 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0e2e4f2458344f1c842bef1b61a48f91" } modify_external_catalogs: true
I20260617 07:53:27.259735 454 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_0e2e4f2458344f1c842bef1b61a48f91" } modify_external_catalogs: true
I20260617 07:53:27.260349 457 master_service.cc:960] ReplaceTablet: received request to replace tablet b1f095603e54419784d5a30a687da8b4 from {username='slave'} at 127.0.0.1:33390
W20260617 07:53:27.260694 456 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb8857a2de7b42dcb5a7d2027732cd3e consensus state has no leader
I20260617 07:53:27.260963 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c2b4123400f94ed9b7d9c4de82728499" } modify_external_catalogs: true
I20260617 07:53:27.261087 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c2b4123400f94ed9b7d9c4de82728499" } modify_external_catalogs: true
I20260617 07:53:27.265216 459 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 2ef4f711d1534713b3ebd0862db382a3 (table default.Table_4ff583bf5ea445799ee33a2608a696fb [id=bf0311e54f774b8587d35475393dfa69]). Expected version 1 got 0
I20260617 07:53:27.265764 1846 ts_tablet_manager.cc:1929] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:27.265882 1846 log.cc:1199] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/92e55be5f28740fba65c1199a571d97a
I20260617 07:53:27.266228 1846 ts_tablet_manager.cc:1950] T 92e55be5f28740fba65c1199a571d97a P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:27.267064 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 773) took 4093 ms. Trace:
I20260617 07:53:27.267390 460 catalog_manager.cc:5696] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:27.268316 1846 rpcz_store.cc:276] 0617 07:53:23.173623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.173683 (+ 60us) service_pool.cc:224] Handling call
0617 07:53:27.232580 (+4058897us) ts_tablet_manager.cc:1151] Deleting tablet 92e55be5f28740fba65c1199a571d97a
0617 07:53:27.232588 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.240443 (+ 7855us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.265692 (+ 25249us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.267044 (+ 1352us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4058718}
I20260617 07:53:27.268184 460 catalog_manager.cc:5696] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:27.268620 460 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:27.268728 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 775) took 4071 ms. Trace:
I20260617 07:53:27.268792 1846 rpcz_store.cc:276] 0617 07:53:23.197622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.197806 (+ 184us) service_pool.cc:224] Handling call
0617 07:53:27.268603 (+4070797us) ts_tablet_manager.cc:1151] Deleting tablet 2372cb9ae6e343be945b1e8d2db86894
0617 07:53:27.268614 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.268713 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4058024}
I20260617 07:53:27.268898 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 92e55be5f28740fba65c1199a571d97a (table default.Table_93a6fb533319471aa6c304e5fe867477 [id=061cdaef8556415dad01eccb24949518]) successfully deleted
I20260617 07:53:27.269093 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 776) took 4056 ms. Trace:
I20260617 07:53:27.269168 1846 rpcz_store.cc:276] 0617 07:53:23.212401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.212463 (+ 62us) service_pool.cc:224] Handling call
0617 07:53:27.269002 (+4056539us) ts_tablet_manager.cc:1151] Deleting tablet 7ca7af3d86d741f482a1f5f97de9c767
0617 07:53:27.269009 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.269079 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4056233}
W20260617 07:53:27.269374 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2372cb9ae6e343be945b1e8d2db86894 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2372cb9ae6e343be945b1e8d2db86894 already in progress: creating tablet
I20260617 07:53:27.269454 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 783) took 3889 ms. Trace:
I20260617 07:53:27.269520 1846 rpcz_store.cc:276] 0617 07:53:23.380043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.380125 (+ 82us) service_pool.cc:224] Handling call
0617 07:53:27.269368 (+3889243us) ts_tablet_manager.cc:1151] Deleting tablet a0f7775846454e96a9f433e84e90a229
0617 07:53:27.269376 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.269441 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3888977}
I20260617 07:53:27.269842 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 784) took 3783 ms. Trace:
I20260617 07:53:27.269904 1846 rpcz_store.cc:276] 0617 07:53:23.486250 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.486889 (+ 639us) service_pool.cc:224] Handling call
0617 07:53:27.269706 (+3782817us) ts_tablet_manager.cc:1151] Deleting tablet f5053b7c24964dee880890fbb803ce7b
0617 07:53:27.269750 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.269829 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3715822}
W20260617 07:53:27.270004 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 7ca7af3d86d741f482a1f5f97de9c767 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ca7af3d86d741f482a1f5f97de9c767 already in progress: creating tablet
W20260617 07:53:27.269995 3017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:53:27.270187 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 787) took 3611 ms. Trace:
W20260617 07:53:27.270248 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a0f7775846454e96a9f433e84e90a229 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0f7775846454e96a9f433e84e90a229 already in progress: creating tablet
I20260617 07:53:27.270251 1846 rpcz_store.cc:276] 0617 07:53:23.658645 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.658693 (+ 48us) service_pool.cc:224] Handling call
0617 07:53:27.270092 (+3611399us) ts_tablet_manager.cc:1151] Deleting tablet 0b479c2984934852a864699b66416538
0617 07:53:27.270112 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.270174 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3611223}
W20260617 07:53:27.270677 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f5053b7c24964dee880890fbb803ce7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5053b7c24964dee880890fbb803ce7b already in progress: creating tablet
I20260617 07:53:27.271792 2852 server_base.cc:1061] running on GCE node
I20260617 07:53:27.272387 1178 tablet_bootstrap.cc:492] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.272504 1178 ts_tablet_manager.cc:1403] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260617 07:53:27.273175 1178 raft_consensus.cc:359] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.273325 1178 raft_consensus.cc:385] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.273377 1178 raft_consensus.cc:740] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.274133 1178 consensus_queue.cc:260] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.275491 1178 ts_tablet_manager.cc:1434] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:27.276525 1178 tablet_bootstrap.cc:492] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.278112 1178 tablet_bootstrap.cc:654] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.279224 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 786) took 3620 ms. Trace:
I20260617 07:53:27.279361 1846 rpcz_store.cc:276] 0617 07:53:23.658536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.658851 (+ 315us) service_pool.cc:224] Handling call
0617 07:53:27.279116 (+3620265us) ts_tablet_manager.cc:1151] Deleting tablet 92d1398b4b604f75be1a3b46e5ac9b77
0617 07:53:27.279125 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.279209 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3620123}
I20260617 07:53:27.279877 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 788) took 3621 ms. Trace:
I20260617 07:53:27.280004 1846 rpcz_store.cc:276] 0617 07:53:23.658784 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.659025 (+ 241us) service_pool.cc:224] Handling call
0617 07:53:27.279784 (+3620759us) ts_tablet_manager.cc:1151] Deleting tablet 8d58c09bfda64ad2aa42ecfbd413c6ef
0617 07:53:27.279793 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.279862 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3620650}
I20260617 07:53:27.280485 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 789) took 3618 ms. Trace:
W20260617 07:53:27.280781 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 0b479c2984934852a864699b66416538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b479c2984934852a864699b66416538 already in progress: creating tablet
I20260617 07:53:27.280915 1846 rpcz_store.cc:276] 0617 07:53:23.661588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.661651 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:27.280397 (+3618746us) ts_tablet_manager.cc:1151] Deleting tablet 8607c3a4744a4eeb882f1e913875ee1f
0617 07:53:27.280406 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.280471 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3618541}
I20260617 07:53:27.281040 742 tablet_service.cc:1511] Processing CreateTablet for tablet c908826a279f4810b77ee64376af5683 (DEFAULT_TABLE table=default.Table_83b0a019b32c4c7fb0ff00b2f14a0c36 [id=d00d434ba5e74e38a3b1834d6c7432de]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:27.281138 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 92d1398b4b604f75be1a3b46e5ac9b77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92d1398b4b604f75be1a3b46e5ac9b77 already in progress: creating tablet
I20260617 07:53:27.281317 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 790) took 3617 ms. Trace:
W20260617 07:53:27.281347 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8d58c09bfda64ad2aa42ecfbd413c6ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d58c09bfda64ad2aa42ecfbd413c6ef already in progress: creating tablet
I20260617 07:53:27.281380 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c908826a279f4810b77ee64376af5683. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:27.281592 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 8607c3a4744a4eeb882f1e913875ee1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8607c3a4744a4eeb882f1e913875ee1f already in progress: creating tablet
I20260617 07:53:27.289316 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet fa6e25c657294fe2916fe1b121c1df9a
I20260617 07:53:27.290067 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 3d248d3bce0c4c19a9c07e94f875730a
I20260617 07:53:27.295754 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ad7effb065644f368e31c322fa41c3c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.296490 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad7effb065644f368e31c322fa41c3c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.299023 458 catalog_manager.cc:6784] ReplaceTablet: tablet 3d248d3bce0c4c19a9c07e94f875730a deleted and replaced by tablet 49c8b9292c344972b383246dc6659073
I20260617 07:53:27.299459 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_cfcc4a6ddcab401d90bf0cd84dbf4f1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.300078 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfcc4a6ddcab401d90bf0cd84dbf4f1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.302045 455 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_362c6ba80a5940979549809f18b8374a [id=9726df7d693441359861876ae1179b4d] alter complete (version 5)
I20260617 07:53:27.306288 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_7e41dec3a8cf40e6a6d41c1fa8d61fcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.306934 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e41dec3a8cf40e6a6d41c1fa8d61fcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.309049 1015 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f4a8b06f77643dcb28f0c3136510253 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:21 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.309366 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet fb74bb5046dc4bda98be3a9ba2f4a3c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.311522 1015 tablet_service.cc:1511] Processing CreateTablet for tablet 27048e7b45114626a8225629531acba3 (DEFAULT_TABLE table=default.Table_e5a4efb78d224baea198c245066b0ff1 [id=4366a33b91654cfd810fabdce9e4acbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.311901 1015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27048e7b45114626a8225629531acba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.314314 1016 tablet_service.cc:1511] Processing CreateTablet for tablet f508e4508a91489b9e5bb84112ab2843 (DEFAULT_TABLE table=default.Table_3e88b34d122b4cdc89a76f67615e2bb0 [id=8bb0398e39b44518bd465943eea0d0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.314781 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f508e4508a91489b9e5bb84112ab2843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.318033 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 04a72094621548cfb85116fd1be81b77 (DEFAULT_TABLE table=default.Table_8b18ee371b3345c597ad326b0645d2a9 [id=0654557d3f3d4e1dbef0de8577414b12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.318446 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a72094621548cfb85116fd1be81b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.323313 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_a537e86d9c8246e7927a69a64ae8f6f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.324314 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a537e86d9c8246e7927a69a64ae8f6f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.332862 741 tablet_service.cc:1558] Processing DeleteTablet for tablet eb75a965740344c2bd0b68a8dda28be5 with delete_type TABLET_DATA_DELETED (replaced by tablet a84c7a425c4e4bc0acd412f16cf2fa01) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.333010 744 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d248d3bce0c4c19a9c07e94f875730a with delete_type TABLET_DATA_DELETED (replaced by tablet 49c8b9292c344972b383246dc6659073) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.333207 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ca402543247461aa5384abb65fff364 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.333357 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 596ef68705c84791b54f07e03b219b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.334218 755 tablet_service.cc:1511] Processing CreateTablet for tablet f508e4508a91489b9e5bb84112ab2843 (DEFAULT_TABLE table=default.Table_3e88b34d122b4cdc89a76f67615e2bb0 [id=8bb0398e39b44518bd465943eea0d0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.334574 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f508e4508a91489b9e5bb84112ab2843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.334597 741 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb7e8f6f6784deea1065e9a11740375 (DEFAULT_TABLE table=default.Table_38930fa6fb03412e8256e4828be1254d [id=ac4d271398f440a9a92a91c528c83203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.334995 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb7e8f6f6784deea1065e9a11740375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.335692 756 tablet_service.cc:1558] Processing DeleteTablet for tablet fa6e25c657294fe2916fe1b121c1df9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.335842 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8f144d04af4ea18f99aee3b82f4a28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:06 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.336114 751 tablet_service.cc:1511] Processing CreateTablet for tablet be18d009636f4e4ba2fcb63c2656124c (DEFAULT_TABLE table=default.Table_a91055837a9343b382d1cfe2137d03db [id=2a5b4bf123974e7fbfddf975b173b392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.336383 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be18d009636f4e4ba2fcb63c2656124c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.337956 745 tablet_service.cc:1511] Processing CreateTablet for tablet 27048e7b45114626a8225629531acba3 (DEFAULT_TABLE table=default.Table_e5a4efb78d224baea198c245066b0ff1 [id=4366a33b91654cfd810fabdce9e4acbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.338280 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27048e7b45114626a8225629531acba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.341706 2968 raft_consensus.cc:493] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.341837 2968 raft_consensus.cc:515] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.341991 453 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ff67e763f24e4d6289ff0d3d3c8e8afc
I20260617 07:53:27.342442 2968 leader_election.cc:290] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.343324 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet fe8a11ed3c684ef8b4a159078fe87aa5
I20260617 07:53:27.343336 744 tablet_service.cc:1511] Processing CreateTablet for tablet 04a72094621548cfb85116fd1be81b77 (DEFAULT_TABLE table=default.Table_8b18ee371b3345c597ad326b0645d2a9 [id=0654557d3f3d4e1dbef0de8577414b12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.343654 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a72094621548cfb85116fd1be81b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.343971 457 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet b1f095603e54419784d5a30a687da8b4
I20260617 07:53:27.344594 456 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 8dead95cfb624c3ca99069465813fea6
W20260617 07:53:27.346899 716 leader_election.cc:343] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 7ca402543247461aa5384abb65fff364
I20260617 07:53:27.347307 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_338b17855e39481bb3d8bcdeb4a4f16c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.348054 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_338b17855e39481bb3d8bcdeb4a4f16c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.348513 453 catalog_manager.cc:5696] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:27.349123 453 catalog_manager.cc:5696] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130). New cstate: current_term: 1 leader_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } health_report { overall_health: UNKNOWN } } }
I20260617 07:53:27.349495 453 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_0a3622a666594847848eb4982fd1316a [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 3 got 0
W20260617 07:53:27.350023 986 consensus_peers.cc:597] T ad2e04c81f964fe1895219311eebdee4 P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260617 07:53:27.350183 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet fe8a11ed3c684ef8b4a159078fe87aa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.351418 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet b1f095603e54419784d5a30a687da8b4 with delete_type TABLET_DATA_DELETED (replaced by tablet bb990fb176ed4e0482b29beb5a737f6f) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:27.351513 713 leader_election.cc:343] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 7ca402543247461aa5384abb65fff364
I20260617 07:53:27.351631 713 leader_election.cc:304] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.352197 2968 raft_consensus.cc:2749] T 7ca402543247461aa5384abb65fff364 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.350013 457 catalog_manager.cc:6784] ReplaceTablet: tablet b1f095603e54419784d5a30a687da8b4 deleted and replaced by tablet bb990fb176ed4e0482b29beb5a737f6f
I20260617 07:53:27.352727 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ce78660edab64a4d973c183fa5f3e33e" } new_table_name: "default.Table_1148724613814fefa769b08ac6e91dfc" modify_external_catalogs: true
I20260617 07:53:27.353310 454 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 9561a1b846a24b1abb0b16bb82b417ad
I20260617 07:53:27.353420 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dead95cfb624c3ca99069465813fea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.353587 758 tablet_service.cc:1558] Processing DeleteTablet for tablet fe8a11ed3c684ef8b4a159078fe87aa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.353791 756 tablet_service.cc:1558] Processing DeleteTablet for tablet b1f095603e54419784d5a30a687da8b4 with delete_type TABLET_DATA_DELETED (replaced by tablet bb990fb176ed4e0482b29beb5a737f6f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.354370 454 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_2eb65c0d123846f1804e668fde8d23f5" } new_table_name: "default.Table_5f95da2dd14f40c0ae02b37bad9c8aa4" modify_external_catalogs: true
I20260617 07:53:27.351116 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_aecf0ee52058401e81f03706ef1cdb68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.354964 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aecf0ee52058401e81f03706ef1cdb68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.356204 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 9561a1b846a24b1abb0b16bb82b417ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.356947 751 tablet_service.cc:1558] Processing DeleteTablet for tablet ff67e763f24e4d6289ff0d3d3c8e8afc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.357436 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 9561a1b846a24b1abb0b16bb82b417ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.357896 742 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9cc1ec77a84113a6d38366c78d1cd3 (DEFAULT_TABLE table=default.Table_81bb1dfa2f954da1a4974542d74c7eed [id=77706cb8c4cd49b2806fb4dfb39750c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.358372 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9cc1ec77a84113a6d38366c78d1cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.331187 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb7e8f6f6784deea1065e9a11740375 (DEFAULT_TABLE table=default.Table_38930fa6fb03412e8256e4828be1254d [id=ac4d271398f440a9a92a91c528c83203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.362511 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb7e8f6f6784deea1065e9a11740375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.363647 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_1669fc1629774d918c478aa955e8df7e" } new_table_name: "default.Table_cd1a88789a1f4195b62e7192b9412ac1" modify_external_catalogs: true
I20260617 07:53:27.366250 2987 raft_consensus.cc:493] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.366422 2987 raft_consensus.cc:515] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.281380 1846 rpcz_store.cc:276] 0617 07:53:23.663452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.663503 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:27.281227 (+3617724us) ts_tablet_manager.cc:1151] Deleting tablet 12727ad13f0747ce8d9710a71ba2c075
0617 07:53:27.281239 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.281304 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768,"tablet-delete.queue_time_us":3617563}
I20260617 07:53:27.367244 2987 leader_election.cc:290] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:27.367580 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 12727ad13f0747ce8d9710a71ba2c075 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12727ad13f0747ce8d9710a71ba2c075 already in progress: creating tablet
I20260617 07:53:27.367656 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef4f711d1534713b3ebd0862db382a3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:27.368103 986 leader_election.cc:343] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.368254 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 791) took 3699 ms. Trace:
I20260617 07:53:27.368353 1846 rpcz_store.cc:276] 0617 07:53:23.668688 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.668739 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:27.367891 (+3699152us) ts_tablet_manager.cc:1151] Deleting tablet 213d76d2aa1a41d5951aa093d09d9ce6
0617 07:53:27.367901 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.367976 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3698096}
W20260617 07:53:27.368881 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 213d76d2aa1a41d5951aa093d09d9ce6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 213d76d2aa1a41d5951aa093d09d9ce6 already in progress: creating tablet
I20260617 07:53:27.369287 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 796) took 3620 ms. Trace:
I20260617 07:53:27.369383 1846 rpcz_store.cc:276] 0617 07:53:23.748877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.789608 (+ 40731us) service_pool.cc:224] Handling call
0617 07:53:27.369160 (+3579552us) ts_tablet_manager.cc:1151] Deleting tablet d3f843a058bd449796d59b89e2470d8c
0617 07:53:27.369172 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.369268 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3579357}
W20260617 07:53:27.369851 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d3f843a058bd449796d59b89e2470d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3f843a058bd449796d59b89e2470d8c already in progress: creating tablet
I20260617 07:53:27.370226 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 805) took 3578 ms. Trace:
I20260617 07:53:27.371222 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8aeeeb09183c4f838d93f7297398a094"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.372525 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aeeeb09183c4f838d93f7297398a094 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.373440 2987 raft_consensus.cc:493] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.373601 2987 raft_consensus.cc:515] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.374383 2987 leader_election.cc:290] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:27.375483 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet ff67e763f24e4d6289ff0d3d3c8e8afc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.393973 1018 tablet_service.cc:1511] Processing CreateTablet for tablet be18d009636f4e4ba2fcb63c2656124c (DEFAULT_TABLE table=default.Table_a91055837a9343b382d1cfe2137d03db [id=2a5b4bf123974e7fbfddf975b173b392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.394634 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be18d009636f4e4ba2fcb63c2656124c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.397011 1020 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d248d3bce0c4c19a9c07e94f875730a with delete_type TABLET_DATA_DELETED (replaced by tablet 49c8b9292c344972b383246dc6659073) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.398726 2710 consensus_queue.cc:1048] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:27.401592 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_afe555e36df0495081dd4d2f945c2db6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.402647 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afe555e36df0495081dd4d2f945c2db6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:27.405514 454 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72f1051b9dd04db5a8f1245242d39376 consensus state has no leader
I20260617 07:53:27.371564 744 tablet_service.cc:1511] Processing CreateTablet for tablet 2aaabc6fc4ed488186b71dbbb4d2ce52 (DEFAULT_TABLE table=default.Table_0ccedc77aa4847729517007c4a956aea [id=d15f01c09bf045a7a2e863dfce01d492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.405788 1846 rpcz_store.cc:276] 0617 07:53:23.791915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.791978 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:27.370104 (+3578126us) ts_tablet_manager.cc:1151] Deleting tablet 2c120eba06a549ef88ffa19998ab0f3d
0617 07:53:27.370116 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.370207 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3577934}
I20260617 07:53:27.406085 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaabc6fc4ed488186b71dbbb4d2ce52. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:27.406301 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 2c120eba06a549ef88ffa19998ab0f3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c120eba06a549ef88ffa19998ab0f3d already in progress: creating tablet
I20260617 07:53:27.408684 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 809) took 3614 ms. Trace:
I20260617 07:53:27.408757 1846 rpcz_store.cc:276] 0617 07:53:23.794099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.794150 (+ 51us) service_pool.cc:224] Handling call
0617 07:53:27.408554 (+3614404us) ts_tablet_manager.cc:1151] Deleting tablet e5544753b3144c1989f2ed99bffc2246
0617 07:53:27.408564 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.408668 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3614240}
W20260617 07:53:27.409159 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e5544753b3144c1989f2ed99bffc2246 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5544753b3144c1989f2ed99bffc2246 already in progress: creating tablet
I20260617 07:53:27.378187 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5224716de249e9be9d7239407579a9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.409668 1020 tablet_service.cc:1511] Processing CreateTablet for tablet 2aaabc6fc4ed488186b71dbbb4d2ce52 (DEFAULT_TABLE table=default.Table_0ccedc77aa4847729517007c4a956aea [id=d15f01c09bf045a7a2e863dfce01d492]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:27.410144 986 leader_election.cc:343] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.391047 748 tablet_service.cc:1511] Processing CreateTablet for tablet 012757b65e2c4bd2bdad596cb9b9ff93 (DEFAULT_TABLE table=default.Table_9743c949d80545a48ccfba13aca5060e [id=541e551a2dd34be7be6f80671af12672]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.412858 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012757b65e2c4bd2bdad596cb9b9ff93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.417515 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet fa6e25c657294fe2916fe1b121c1df9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.418021 1846 tablet_replica.cc:333] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:27.418517 1846 raft_consensus.cc:2243] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:27.424077 1846 raft_consensus.cc:2272] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:27.410151 1020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaabc6fc4ed488186b71dbbb4d2ce52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.426451 1846 ts_tablet_manager.cc:1916] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.435154 1178 tablet_bootstrap.cc:492] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.435293 1178 ts_tablet_manager.cc:1403] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.159s user 0.045s sys 0.037s
I20260617 07:53:27.436003 1178 raft_consensus.cc:359] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.436203 1178 raft_consensus.cc:385] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.436262 1178 raft_consensus.cc:740] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
W20260617 07:53:27.437774 448 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet eb8857a2de7b42dcb5a7d2027732cd3e (table default.Table_bb9764511f9f4b43b012ea7e50f604ac [id=4ce816902d4c4d0e99386c361100b94a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet eb8857a2de7b42dcb5a7d2027732cd3e consensus state has no leader
I20260617 07:53:27.438334 455 master_service.cc:960] ReplaceTablet: received request to replace tablet 07431acc9208489aaea2f8c4205e46a5 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:27.439342 1178 consensus_queue.cc:260] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.441818 1178 ts_tablet_manager.cc:1434] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 07:53:27.442281 1019 tablet_service.cc:1511] Processing CreateTablet for tablet c908826a279f4810b77ee64376af5683 (DEFAULT_TABLE table=default.Table_83b0a019b32c4c7fb0ff00b2f14a0c36 [id=d00d434ba5e74e38a3b1834d6c7432de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.442914 1019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c908826a279f4810b77ee64376af5683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.442832 1178 tablet_bootstrap.cc:492] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.444197 1025 tablet_service.cc:1511] Processing CreateTablet for tablet abad8ab0b08441f498fcb6ecb21916ae (DEFAULT_TABLE table=default.Table_489156baa9ad47d0b71d7437dec196cd [id=1d213a295f0a4198abdf9323e153d82d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.444739 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 97adbb30b01a4a7f90235bf0c5589c4e (DEFAULT_TABLE table=default.Table_47b539845ac346bf94ec809570b60ba6 [id=f335c49e0c864ab5ba78a0c98b1fa94c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.444866 1178 tablet_bootstrap.cc:654] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.444882 1014 tablet_service.cc:1511] Processing CreateTablet for tablet cb9c495f611444e4967060bdb5c66038 (DEFAULT_TABLE table=default.Table_475b62f628cb4fedb0a078c5d9d1c41c [id=e7fa0702db8047a49c13df26bcbd42cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.446520 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abad8ab0b08441f498fcb6ecb21916ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.447495 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9c495f611444e4967060bdb5c66038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.451421 1178 tablet_bootstrap.cc:492] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.451561 1178 ts_tablet_manager.cc:1403] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260617 07:53:27.452253 1178 raft_consensus.cc:359] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.452443 1178 raft_consensus.cc:385] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.452505 1178 raft_consensus.cc:740] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.452765 1178 consensus_queue.cc:260] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.453299 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97adbb30b01a4a7f90235bf0c5589c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.454248 1178 ts_tablet_manager.cc:1434] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:27.455132 1178 tablet_bootstrap.cc:492] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.456688 1178 tablet_bootstrap.cc:654] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:27.459375 446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 50246.6us
I20260617 07:53:27.462641 1022 tablet_service.cc:1511] Processing CreateTablet for tablet d004141fc3474e5698dbcdd675d1146b (DEFAULT_TABLE table=default.Table_9785506a8a56487581a2f11ab8cb65b4 [id=fa5fa0a6e8354cb8874b3f94674d7284]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:27.466406 2989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 07:53:27.468184 2852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 07:53:27.470695 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dead95cfb624c3ca99069465813fea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.470947 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d004141fc3474e5698dbcdd675d1146b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.473184 1026 tablet_service.cc:1511] Processing CreateTablet for tablet bd2623a9d807412fa46b435dfde3f762 (DEFAULT_TABLE table=default.Table_93379979809441178fa6c159c07f77ce [id=1ce585dfe5c64a0caed626f1f56a05f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.473510 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2623a9d807412fa46b435dfde3f762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.473994 2852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 07:53:27.476395 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737e9344fc824714a2c2596170637158" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:27.477393 1846 ts_tablet_manager.cc:1929] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:27.477535 1846 log.cc:1199] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/84f498f551ff4767bd16628b03f55ae2
I20260617 07:53:27.478088 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f1051b9dd04db5a8f1245242d39376" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:27.481570 2852 hybrid_clock.cc:648] HybridClock initialized: now 1781682807480935 us; error 626 us; skew 500 ppm
I20260617 07:53:27.482127 2852 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260617 07:53:27.463475 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f74171ee2674ec7922bb77c13050d93 consensus state has no leader
I20260617 07:53:27.490142 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f21698e19d7747f7b6f2df94219a9cfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.490828 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f21698e19d7747f7b6f2df94219a9cfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.492172 457 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_8f25b118b9a24509b2a36db020170b88" } new_table_name: "default.Table_1c1818b6fb1d44e5b85d618c514d3bbc" modify_external_catalogs: true
I20260617 07:53:27.492311 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d3613cd799784e968908338ef2f15b3b" } new_table_name: "default.Table_8b99ee068fe04ad48b9b65ff432bea10" modify_external_catalogs: true
I20260617 07:53:27.495972 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_f8ecae1ef59344198b15aa8e523bf576"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.496685 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8ecae1ef59344198b15aa8e523bf576 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.499003 2987 raft_consensus.cc:493] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.499138 2987 raft_consensus.cc:515] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.499696 2987 leader_election.cc:290] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:27.503350 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb74bb5046dc4bda98be3a9ba2f4a3c6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:27.507997 986 leader_election.cc:343] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.510687 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9cc1ec77a84113a6d38366c78d1cd3 (DEFAULT_TABLE table=default.Table_81bb1dfa2f954da1a4974542d74c7eed [id=77706cb8c4cd49b2806fb4dfb39750c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.512630 1021 tablet_service.cc:1511] Processing CreateTablet for tablet 012757b65e2c4bd2bdad596cb9b9ff93 (DEFAULT_TABLE table=default.Table_9743c949d80545a48ccfba13aca5060e [id=541e551a2dd34be7be6f80671af12672]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.513028 1021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012757b65e2c4bd2bdad596cb9b9ff93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.513103 2852 webserver.cc:533] Webserver started at http://127.0.105.189:38635/ using document root <none> and password file <none>
I20260617 07:53:27.514943 744 tablet_service.cc:1511] Processing CreateTablet for tablet abad8ab0b08441f498fcb6ecb21916ae (DEFAULT_TABLE table=default.Table_489156baa9ad47d0b71d7437dec196cd [id=1d213a295f0a4198abdf9323e153d82d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.515021 751 tablet_service.cc:1511] Processing CreateTablet for tablet fe8a11ed3c684ef8b4a159078fe87aa5 (DEFAULT_TABLE table=default.Table_69c3ba19e7584094b3015b54aa67d1e7 [id=534b385724054f8c8f1c00e2ebf039b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.514761 742 tablet_service.cc:1511] Processing CreateTablet for tablet 97adbb30b01a4a7f90235bf0c5589c4e (DEFAULT_TABLE table=default.Table_47b539845ac346bf94ec809570b60ba6 [id=f335c49e0c864ab5ba78a0c98b1fa94c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.515316 744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abad8ab0b08441f498fcb6ecb21916ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.515272 741 tablet_service.cc:1511] Processing CreateTablet for tablet bd2623a9d807412fa46b435dfde3f762 (DEFAULT_TABLE table=default.Table_93379979809441178fa6c159c07f77ce [id=1ce585dfe5c64a0caed626f1f56a05f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.516319 2968 raft_consensus.cc:493] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.516427 2968 raft_consensus.cc:515] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.517083 2968 leader_election.cc:290] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.517944 755 tablet_service.cc:1511] Processing CreateTablet for tablet d004141fc3474e5698dbcdd675d1146b (DEFAULT_TABLE table=default.Table_9785506a8a56487581a2f11ab8cb65b4 [id=fa5fa0a6e8354cb8874b3f94674d7284]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:27.518117 716 leader_election.cc:343] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: e9488e8a501e404f85540fb045d8916f
I20260617 07:53:27.518204 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 630e540a77374c11895ab5a0e394b3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.518500 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9cc1ec77a84113a6d38366c78d1cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.514761 748 tablet_service.cc:1511] Processing CreateTablet for tablet cb9c495f611444e4967060bdb5c66038 (DEFAULT_TABLE table=default.Table_475b62f628cb4fedb0a078c5d9d1c41c [id=e7fa0702db8047a49c13df26bcbd42cb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:27.519940 713 leader_election.cc:343] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: e9488e8a501e404f85540fb045d8916f
I20260617 07:53:27.520062 713 leader_election.cc:304] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.520521 2968 raft_consensus.cc:2749] T e9488e8a501e404f85540fb045d8916f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.520504 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 9a28168af90148d390604abe3b40da02 (DEFAULT_TABLE table=default.Table_10b6a1799bb344f0b323fa581c74c027 [id=8d68508480b94cc395ede9c752d52321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.520501 460 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6e1d6fa3d4c244b5a86ba8377b1367b6" } modify_external_catalogs: true
I20260617 07:53:27.520676 460 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_6e1d6fa3d4c244b5a86ba8377b1367b6" } modify_external_catalogs: true
I20260617 07:53:27.520838 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a28168af90148d390604abe3b40da02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.522284 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9c495f611444e4967060bdb5c66038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.522349 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 20436dbcc6794e6e81e2228bd0ed6bbe (DEFAULT_TABLE table=default.Table_bed6a31c5b494a2c9217775f1275b9c9 [id=3ba41d84834549bab8676d82af5370b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.522675 452 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_677aba508baf46ab8247a3d1b109fb23 [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 2 got 0
I20260617 07:53:27.525130 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6264adc3994c22864ea73106ba2320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.525386 756 tablet_service.cc:1558] Processing DeleteTablet for tablet e9488e8a501e404f85540fb045d8916f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.525444 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 77c3bf1860c34ee3821bf273234cb0a4 with delete_type TABLET_DATA_DELETED (replaced by tablet f395f963a5a5400a966a8d4cc62aadf1) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.525544 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 68b448c65e684f49bf142ce2b5084d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:15 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.525695 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f9bace06e34602acc7fcd7501b3671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.525864 750 tablet_service.cc:1558] Processing DeleteTablet for tablet c58bbdbf59c7426c8adbbbe3f0aafaed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.526144 747 tablet_service.cc:1511] Processing CreateTablet for tablet b60171338bfa49c99457eeb0d22ecc35 (DEFAULT_TABLE table=default.Table_0b7dbffe5422405dba60a8ad9491a5b7 [id=1ac1415ca01c4c18b42e98f9d42cfb8e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:27.526300 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13f5cf580e0541b487c799163b1bdd5e consensus state has no leader
I20260617 07:53:27.526465 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60171338bfa49c99457eeb0d22ecc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.527177 1029 tablet_service.cc:1511] Processing CreateTablet for tablet fe8a11ed3c684ef8b4a159078fe87aa5 (DEFAULT_TABLE table=default.Table_69c3ba19e7584094b3015b54aa67d1e7 [id=534b385724054f8c8f1c00e2ebf039b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.527495 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8a11ed3c684ef8b4a159078fe87aa5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:27.528365 988 leader_election.cc:343] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.528463 988 leader_election.cc:304] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:27.528678 742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97adbb30b01a4a7f90235bf0c5589c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.528904 2987 raft_consensus.cc:2749] T c9657e0dd2a8459cb728bdfe8a68b840 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.529466 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20436dbcc6794e6e81e2228bd0ed6bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.530139 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 4681e8e3f1174b299d89ec541ca8e6b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 531ccdf479814053b468a7d5802f5dde) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.530450 758 tablet_service.cc:1511] Processing CreateTablet for tablet 9a28168af90148d390604abe3b40da02 (DEFAULT_TABLE table=default.Table_10b6a1799bb344f0b323fa581c74c027 [id=8d68508480b94cc395ede9c752d52321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.530750 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a28168af90148d390604abe3b40da02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:27.532220 988 leader_election.cc:343] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.533800 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d004141fc3474e5698dbcdd675d1146b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.533944 756 tablet_service.cc:1511] Processing CreateTablet for tablet 706d533b026e44b6b344876046d92966 (DEFAULT_TABLE table=default.Table_b8df6bf2a67d44598b3472dd0031e570 [id=951e230ec1f84717b9ed7d19f4dfbc16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.534240 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706d533b026e44b6b344876046d92966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.537926 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8a11ed3c684ef8b4a159078fe87aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.526468 745 tablet_service.cc:1511] Processing CreateTablet for tablet 20436dbcc6794e6e81e2228bd0ed6bbe (DEFAULT_TABLE table=default.Table_bed6a31c5b494a2c9217775f1275b9c9 [id=3ba41d84834549bab8676d82af5370b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.538656 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20436dbcc6794e6e81e2228bd0ed6bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.539564 741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2623a9d807412fa46b435dfde3f762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.542533 2729 leader_election.cc:290] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:27.542824 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9a4021cad24b99b391e99e8b46cd9e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.545621 2852 fs_manager.cc:362] Metadata directory not provided
I20260617 07:53:27.546113 2852 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 07:53:27.549361 2775 raft_consensus.cc:493] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.549494 2775 raft_consensus.cc:515] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.550087 2775 leader_election.cc:290] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.551126 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3b2792fc15244bbf828a27c4156aca04" } modify_external_catalogs: true
I20260617 07:53:27.551820 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3b2792fc15244bbf828a27c4156aca04" } modify_external_catalogs: true
I20260617 07:53:27.553157 452 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5bd1190146104a0a8688fb382c963a75" } modify_external_catalogs: true
I20260617 07:53:27.553320 452 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_5bd1190146104a0a8688fb382c963a75" } modify_external_catalogs: true
W20260617 07:53:27.555487 852 leader_election.cc:343] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:27.556145 852 leader_election.cc:343] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:27.557358 852 leader_election.cc:343] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:27.557595 852 leader_election.cc:343] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:27.557879 852 leader_election.cc:343] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.561030 459 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d1830d0b4ae94729a8fbaa13068536d8" } modify_external_catalogs: true
I20260617 07:53:27.561192 459 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_d1830d0b4ae94729a8fbaa13068536d8" } modify_external_catalogs: true
I20260617 07:53:27.562541 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3edd5bcee7e04d8c8974fe2880a5d2d1" } modify_external_catalogs: true
I20260617 07:53:27.562666 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_3edd5bcee7e04d8c8974fe2880a5d2d1" } modify_external_catalogs: true
I20260617 07:53:27.563896 2852 fs_manager.cc:714] Time spent opening directory manager: real 0.015s user 0.004s sys 0.003s
I20260617 07:53:27.567101 455 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 07431acc9208489aaea2f8c4205e46a5
I20260617 07:53:27.567538 455 catalog_manager.cc:6784] ReplaceTablet: tablet 07431acc9208489aaea2f8c4205e46a5 deleted and replaced by tablet 435bf79fe29d4e81bf7e52e30649042f
I20260617 07:53:27.567839 1862 ts_tablet_manager.cc:1929] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:27.567938 1862 log.cc:1199] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/8a4f81daf583464e988521e189ca39b6
I20260617 07:53:27.569404 741 tablet_service.cc:1558] Processing DeleteTablet for tablet 07431acc9208489aaea2f8c4205e46a5 with delete_type TABLET_DATA_DELETED (replaced by tablet 435bf79fe29d4e81bf7e52e30649042f) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.570000 1846 ts_tablet_manager.cc:1950] T 84f498f551ff4767bd16628b03f55ae2 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:27.570921 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 814) took 3720 ms. Trace:
I20260617 07:53:27.571055 1862 ts_tablet_manager.cc:1950] T 8a4f81daf583464e988521e189ca39b6 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:27.571007 1846 rpcz_store.cc:276] 0617 07:53:23.850383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.862759 (+ 12376us) service_pool.cc:224] Handling call
0617 07:53:27.417971 (+3555212us) ts_tablet_manager.cc:1151] Deleting tablet 84f498f551ff4767bd16628b03f55ae2
0617 07:53:27.417981 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.432968 (+ 14987us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.477332 (+ 44364us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.570902 (+ 93570us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3527387}
I20260617 07:53:27.571699 1846 tablet_replica.cc:333] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:27.572022 1846 raft_consensus.cc:2243] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:27.572594 1846 raft_consensus.cc:2272] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:27.573504 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_36b7cbc42acd45fea0ab9e813f0b209e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:27.574077 1171 tablet_bootstrap.cc:492] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
W20260617 07:53:27.574142 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36b7cbc42acd45fea0ab9e813f0b209e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.574196 1171 ts_tablet_manager.cc:1403] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.511s user 0.002s sys 0.004s
I20260617 07:53:27.576613 1846 ts_tablet_manager.cc:1916] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:27.543326 986 leader_election.cc:343] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.544945 1172 tablet_bootstrap.cc:492] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.532343 988 leader_election.cc:304] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:27.553210 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b60171338bfa49c99457eeb0d22ecc35 (DEFAULT_TABLE table=default.Table_0b7dbffe5422405dba60a8ad9491a5b7 [id=1ac1415ca01c4c18b42e98f9d42cfb8e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:27.578627 988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:38879, user_credentials={real_user=slave}} blocked reactor thread for 46414.4us
I20260617 07:53:27.578704 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60171338bfa49c99457eeb0d22ecc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.578815 2987 raft_consensus.cc:2749] T 70610822c57e45c7add7e1f5ce96d889 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.578881 1016 tablet_service.cc:1558] Processing DeleteTablet for tablet 07431acc9208489aaea2f8c4205e46a5 with delete_type TABLET_DATA_DELETED (replaced by tablet 435bf79fe29d4e81bf7e52e30649042f) from {username='slave'} at 127.0.0.1:34090
W20260617 07:53:27.579597 988 leader_election.cc:343] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.579705 988 leader_election.cc:304] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:27.580078 2729 raft_consensus.cc:2749] T 306742b9da81497991d58947bf3c1ebb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.562330 1170 ts_tablet_manager.cc:1929] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:27.580533 1170 log.cc:1199] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/8a4f81daf583464e988521e189ca39b6
I20260617 07:53:27.580778 1172 ts_tablet_manager.cc:1403] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.334s user 0.008s sys 0.004s
I20260617 07:53:27.580861 1170 ts_tablet_manager.cc:1950] T 8a4f81daf583464e988521e189ca39b6 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:27.581446 765 raft_consensus.cc:3060] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.582383 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 84f498f551ff4767bd16628b03f55ae2 (table default.Table_187d6ce1f72947bead15cb026aa308cb [id=288a2e361ab149dca98dd515225f0ad7]) successfully deleted
I20260617 07:53:27.582458 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 634) took 3653 ms. Trace:
I20260617 07:53:27.581565 1172 raft_consensus.cc:359] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.586479 1172 raft_consensus.cc:385] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.586633 1172 raft_consensus.cc:740] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.586923 1172 consensus_queue.cc:260] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.587703 1172 ts_tablet_manager.cc:1434] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 07:53:27.588091 1172 tablet_bootstrap.cc:492] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.577044 1018 tablet_service.cc:1511] Processing CreateTablet for tablet 706d533b026e44b6b344876046d92966 (DEFAULT_TABLE table=default.Table_b8df6bf2a67d44598b3472dd0031e570 [id=951e230ec1f84717b9ed7d19f4dfbc16]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:27.580098 988 leader_election.cc:343] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.588989 988 leader_election.cc:304] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:27.589192 2987 raft_consensus.cc:2749] T 5f4a8b06f77643dcb28f0c3136510253 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:27.589393 988 leader_election.cc:343] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.589499 988 leader_election.cc:304] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:27.589687 2987 raft_consensus.cc:2749] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.590201 988 leader_election.cc:304] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:27.590322 745 tablet_service.cc:1511] Processing CreateTablet for tablet 6877fe69888d4b078dab6084d0b1db2d (DEFAULT_TABLE table=default.Table_e01ba3682fbb4093b41ced5b097b9547 [id=175f48d4e2524203aeb03f180d8e38ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.590515 2987 raft_consensus.cc:2749] T f1b93b31475c4f29a7fdc387ffbff0cd P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.590665 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6877fe69888d4b078dab6084d0b1db2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.590646 2987 consensus_queue.cc:1048] T f2d846e5951d400ebc4ba6552406c63c P dc3bec007846459a9da0c7b8211e477b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:27.591243 1014 tablet_service.cc:1511] Processing CreateTablet for tablet 6877fe69888d4b078dab6084d0b1db2d (DEFAULT_TABLE table=default.Table_e01ba3682fbb4093b41ced5b097b9547 [id=175f48d4e2524203aeb03f180d8e38ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.591514 1018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706d533b026e44b6b344876046d92966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.593045 1016 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb3224d80e64d908961fb81f3a71620 (DEFAULT_TABLE table=default.Table_a090d99b416c43b38cff612ba5c45a1b [id=3e81ce22566a4bc1ac168a0d0a996542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.593380 1016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb3224d80e64d908961fb81f3a71620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.593876 1014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6877fe69888d4b078dab6084d0b1db2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.596352 1178 tablet_bootstrap.cc:492] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.596468 1178 ts_tablet_manager.cc:1403] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.142s user 0.013s sys 0.026s
I20260617 07:53:27.597105 1178 raft_consensus.cc:359] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.597285 1178 raft_consensus.cc:385] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.597337 1178 raft_consensus.cc:740] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.597560 1178 consensus_queue.cc:260] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.598591 1178 ts_tablet_manager.cc:1434] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:27.598836 1178 tablet_bootstrap.cc:492] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.599989 751 tablet_service.cc:1511] Processing CreateTablet for tablet 765f4b147edc4386bb30df7ae1e635be (DEFAULT_TABLE table=default.Table_d0e5b3d77c244306b561180dd78f6fa2 [id=38620e8597df45ccae38a78ee86caee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.600317 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765f4b147edc4386bb30df7ae1e635be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:27.603914 851 leader_election.cc:343] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 05de71ea02df48ffacb369caa7f7d3de
W20260617 07:53:27.603427 852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:37545, user_credentials={real_user=slave}} blocked reactor thread for 45307.2us
W20260617 07:53:27.605185 852 leader_election.cc:343] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:27.605618 852 leader_election.cc:343] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.606500 1171 raft_consensus.cc:359] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.606698 1171 raft_consensus.cc:385] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.606765 1171 raft_consensus.cc:740] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.606237 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 765f4b147edc4386bb30df7ae1e635be (DEFAULT_TABLE table=default.Table_d0e5b3d77c244306b561180dd78f6fa2 [id=38620e8597df45ccae38a78ee86caee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.606896 745 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb3224d80e64d908961fb81f3a71620 (DEFAULT_TABLE table=default.Table_a090d99b416c43b38cff612ba5c45a1b [id=3e81ce22566a4bc1ac168a0d0a996542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.606998 1171 consensus_queue.cc:260] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.607347 745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb3224d80e64d908961fb81f3a71620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.607390 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765f4b147edc4386bb30df7ae1e635be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.611021 1171 ts_tablet_manager.cc:1434] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.037s user 0.000s sys 0.002s
W20260617 07:53:27.611378 457 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bbdd18c3c7994cc29c87313554f0f92c consensus state has no leader
I20260617 07:53:27.611646 1171 tablet_bootstrap.cc:492] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:27.613051 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_d76c74b0748b42ccb864977753755644"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:27.613212 1171 tablet_bootstrap.cc:654] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.613657 1178 tablet_bootstrap.cc:654] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:27.613682 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d76c74b0748b42ccb864977753755644 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.614966 3030 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 07:53:27.616621 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_6205379030d0456cb3b9f70e92aebe88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 07:53:27.617017 2852 fs_manager.cc:730] Time spent opening block manager: real 0.049s user 0.004s sys 0.003s
I20260617 07:53:27.617298 2968 raft_consensus.cc:493] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.617424 2968 raft_consensus.cc:515] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.618003 2968 leader_election.cc:290] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.617203 2852 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data,/tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
uuid: "29a94ff9f875443ab6aeac00922cda0d"
format_stamp: "Formatted at 2026-06-17 07:52:57 on dist-test-slave-v0n2"
I20260617 07:53:27.618360 2852 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260617 07:53:27.618789 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6205379030d0456cb3b9f70e92aebe88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:27.622363 852 leader_election.cc:343] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:27.624039 713 leader_election.cc:343] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: eb75a965740344c2bd0b68a8dda28be5
W20260617 07:53:27.629235 453 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a182ccfbf302402c9861c54dcac9e767 consensus state has no leader
W20260617 07:53:27.629582 716 leader_election.cc:343] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: eb75a965740344c2bd0b68a8dda28be5
I20260617 07:53:27.629753 716 leader_election.cc:304] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.630829 2968 raft_consensus.cc:2749] T eb75a965740344c2bd0b68a8dda28be5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.631557 453 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_06a54fcfd98445bbafab5f9750da86ea" } new_table_name: "default.Table_8ce2ede0406d49bc9d5e828d92c3d2e3" modify_external_catalogs: true
I20260617 07:53:27.641268 2968 raft_consensus.cc:493] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.641397 2968 raft_consensus.cc:515] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.642041 2968 leader_election.cc:290] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:27.643038 716 leader_election.cc:343] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 77c3bf1860c34ee3821bf273234cb0a4
W20260617 07:53:27.643139 713 leader_election.cc:343] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 77c3bf1860c34ee3821bf273234cb0a4
I20260617 07:53:27.643200 716 leader_election.cc:304] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.643586 2968 raft_consensus.cc:2749] T 77c3bf1860c34ee3821bf273234cb0a4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.646054 1846 ts_tablet_manager.cc:1929] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:27.646243 1846 log.cc:1199] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/95865af94c04410386d23cb369180611
I20260617 07:53:27.646711 1846 ts_tablet_manager.cc:1950] T 95865af94c04410386d23cb369180611 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:27.650734 1172 tablet_bootstrap.cc:654] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.654488 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 771) took 1555 ms. Trace:
I20260617 07:53:27.654883 1862 rpcz_store.cc:276] 0617 07:53:26.099023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:26.099336 (+ 313us) service_pool.cc:224] Handling call
0617 07:53:26.954086 (+854750us) ts_tablet_manager.cc:1151] Deleting tablet 8a4f81daf583464e988521e189ca39b6
0617 07:53:26.954092 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.564726 (+610634us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.567792 (+ 3066us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.654463 (+ 86671us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78259,"tablet-delete.queue_time_us":854654}
I20260617 07:53:27.655994 1862 tablet_replica.cc:333] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: stopping tablet replica
I20260617 07:53:27.656220 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_da11511f8bff415ba60b8da510997ead"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.657310 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da11511f8bff415ba60b8da510997ead in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.657894 1862 raft_consensus.cc:2243] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:27.658653 1178 tablet_bootstrap.cc:492] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.658826 1178 ts_tablet_manager.cc:1403] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.060s user 0.013s sys 0.007s
I20260617 07:53:27.660931 1178 raft_consensus.cc:359] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.661154 1178 raft_consensus.cc:385] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.661218 1178 raft_consensus.cc:740] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.661468 1178 consensus_queue.cc:260] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.662040 1178 ts_tablet_manager.cc:1434] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 07:53:27.662358 1178 tablet_bootstrap.cc:492] T 5578fd5cb3724ed5b92b313bd52889ad P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.664461 1178 tablet_bootstrap.cc:654] T 5578fd5cb3724ed5b92b313bd52889ad P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.670583 2968 raft_consensus.cc:493] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.670770 2968 raft_consensus.cc:515] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.671777 2968 leader_election.cc:290] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:27.672969 713 leader_election.cc:343] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: c58bbdbf59c7426c8adbbbe3f0aafaed
I20260617 07:53:27.673437 1172 tablet_bootstrap.cc:492] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.673616 1172 ts_tablet_manager.cc:1403] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.086s user 0.004s sys 0.000s
W20260617 07:53:27.673983 716 leader_election.cc:343] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: c58bbdbf59c7426c8adbbbe3f0aafaed
I20260617 07:53:27.674080 716 leader_election.cc:304] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.674468 2968 raft_consensus.cc:2749] T c58bbdbf59c7426c8adbbbe3f0aafaed P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.674592 1172 raft_consensus.cc:359] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.674844 1172 raft_consensus.cc:385] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.674921 1172 raft_consensus.cc:740] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.675175 1172 consensus_queue.cc:260] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.675678 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 815) took 3729 ms. Trace:
I20260617 07:53:27.675761 1846 rpcz_store.cc:276] 0617 07:53:23.945869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.946755 (+ 886us) service_pool.cc:224] Handling call
0617 07:53:27.571590 (+3624835us) ts_tablet_manager.cc:1151] Deleting tablet 95865af94c04410386d23cb369180611
0617 07:53:27.571602 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.613503 (+ 41901us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.645996 (+ 32493us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.675656 (+ 29660us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3624621}
I20260617 07:53:27.676251 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 95865af94c04410386d23cb369180611 (table default.Table_a9de59c0e19946de8df23f1869eab317 [id=9b3274df0c184a92af3bc0f10185e41e]) successfully deleted
I20260617 07:53:27.676292 2968 raft_consensus.cc:493] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.676401 2968 raft_consensus.cc:515] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.676738 1172 ts_tablet_manager.cc:1434] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:27.676990 1172 tablet_bootstrap.cc:492] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.677206 2968 leader_election.cc:290] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:27.677598 713 leader_election.cc:343] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 18f9bace06e34602acc7fcd7501b3671
W20260617 07:53:27.678134 716 leader_election.cc:343] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 18f9bace06e34602acc7fcd7501b3671
I20260617 07:53:27.678233 716 leader_election.cc:304] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.678960 2968 raft_consensus.cc:2749] T 18f9bace06e34602acc7fcd7501b3671 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.679351 1172 tablet_bootstrap.cc:654] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.659878 1862 raft_consensus.cc:2272] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:27.680438 1862 ts_tablet_manager.cc:1916] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.683712 460 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 70e4068fdcbb41de966bcc72a4d1d426
I20260617 07:53:27.685930 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 70e4068fdcbb41de966bcc72a4d1d426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.686574 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_2e513b708af241e6b2297b612a48c635"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.687330 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e513b708af241e6b2297b612a48c635 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.690042 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 0030162ec9f840a59549649e9680a604
I20260617 07:53:27.690804 458 master_service.cc:960] ReplaceTablet: received request to replace tablet ba4d0d6d8e39416d94ac817a3b116652 from {username='slave'} at 127.0.0.1:33390
I20260617 07:53:27.692448 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 0030162ec9f840a59549649e9680a604 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.678241 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 816) took 3686 ms. Trace:
I20260617 07:53:27.693205 1846 rpcz_store.cc:276] 0617 07:53:23.991389 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.991545 (+ 156us) service_pool.cc:224] Handling call
0617 07:53:27.676109 (+3684564us) ts_tablet_manager.cc:1151] Deleting tablet 770a5216299842b890d483ca37b0ee86
0617 07:53:27.676124 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.678226 (+ 2102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3684339}
W20260617 07:53:27.693625 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 770a5216299842b890d483ca37b0ee86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 770a5216299842b890d483ca37b0ee86 already in progress: creating tablet
I20260617 07:53:27.694738 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 0030162ec9f840a59549649e9680a604 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.695789 1172 tablet_bootstrap.cc:492] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.696667 1172 ts_tablet_manager.cc:1403] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.003s
I20260617 07:53:27.697950 1172 raft_consensus.cc:359] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.698297 2729 raft_consensus.cc:493] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.699631 2729 raft_consensus.cc:515] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.699509 1172 raft_consensus.cc:385] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.699929 1172 raft_consensus.cc:740] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.700155 1172 consensus_queue.cc:260] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.700850 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbbe7eb5181431290f57ed9128181a3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.701114 2729 leader_election.cc:290] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:27.701354 986 leader_election.cc:343] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.701179 1172 ts_tablet_manager.cc:1434] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:27.703333 1172 tablet_bootstrap.cc:492] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.703954 2729 raft_consensus.cc:493] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.704123 2729 raft_consensus.cc:515] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.704846 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet 70e4068fdcbb41de966bcc72a4d1d426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.705253 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 817) took 3711 ms. Trace:
I20260617 07:53:27.705539 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2304939c17648a6962f702524aa9b76" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.705755 2729 leader_election.cc:290] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:27.705999 2968 raft_consensus.cc:493] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 07:53:27.706043 986 leader_election.cc:343] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.706216 2968 raft_consensus.cc:515] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.704854 1172 tablet_bootstrap.cc:654] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.706987 2968 leader_election.cc:290] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:27.707468 716 leader_election.cc:343] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 4681e8e3f1174b299d89ec541ca8e6b3
W20260617 07:53:27.707991 713 leader_election.cc:343] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 4681e8e3f1174b299d89ec541ca8e6b3
I20260617 07:53:27.708082 713 leader_election.cc:304] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.708536 2968 raft_consensus.cc:2749] T 4681e8e3f1174b299d89ec541ca8e6b3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.710290 459 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet fac31abffeb3453f8f0eeed3542ee965
I20260617 07:53:27.712715 745 tablet_service.cc:1558] Processing DeleteTablet for tablet fac31abffeb3453f8f0eeed3542ee965 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.713171 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet fac31abffeb3453f8f0eeed3542ee965 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.718163 459 catalog_manager.cc:5788] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879) does not have the latest schema for tablet 216614d066e9446f91e53d2a382b5f6e (table default.Table_359c79d8b2804b5cb22c337bbf01b0e3 [id=d01892eee8954a04bf0e207993e6f950]). Expected version 1 got 0
I20260617 07:53:27.719182 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_c4040af1ae434f4daa66c3e47f38cc64" } new_table_name: "default.Table_7b149e5e428a4117898f9a91ebceaefe" modify_external_catalogs: true
I20260617 07:53:27.720681 1172 tablet_bootstrap.cc:492] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.720809 1172 ts_tablet_manager.cc:1403] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.001s
I20260617 07:53:27.721519 1172 raft_consensus.cc:359] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.721680 1172 raft_consensus.cc:385] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.721750 1172 raft_consensus.cc:740] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.721938 1172 consensus_queue.cc:260] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.722137 3041 raft_consensus.cc:493] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.705389 1846 rpcz_store.cc:276] 0617 07:53:23.993688 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.994255 (+ 567us) service_pool.cc:224] Handling call
0617 07:53:27.705115 (+3710860us) ts_tablet_manager.cc:1151] Deleting tablet f4d8542262864a0ab9d763528502bcbb
0617 07:53:27.705126 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.705231 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3710645}
I20260617 07:53:27.722226 3041 raft_consensus.cc:515] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:27.722678 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f4d8542262864a0ab9d763528502bcbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4d8542262864a0ab9d763528502bcbb already in progress: creating tablet
I20260617 07:53:27.722812 3041 leader_election.cc:290] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:27.723222 1846 tablet_replica.cc:333] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:27.723474 1846 raft_consensus.cc:2243] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:27.723708 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61124fa6f846a6be1a208f2eaa7c20" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.724157 1846 raft_consensus.cc:2272] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 07:53:27.724592 986 leader_election.cc:343] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.724864 1846 ts_tablet_manager.cc:1916] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.725098 1172 ts_tablet_manager.cc:1434] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 07:53:27.725369 1172 tablet_bootstrap.cc:492] T cc26e46cd03d47099015ddbac0d17688 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:27.727237 1050 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s user 0.096s sys 0.124s
W20260617 07:53:27.727362 1050 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s user 0.096s sys 0.124s
I20260617 07:53:27.728892 1172 tablet_bootstrap.cc:654] T cc26e46cd03d47099015ddbac0d17688 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.729669 2968 raft_consensus.cc:493] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.729810 2968 raft_consensus.cc:515] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.729883 452 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ce1cb2c879e6451886c55907678792de
I20260617 07:53:27.730888 2968 leader_election.cc:290] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:27.731995 716 leader_election.cc:343] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 630e540a77374c11895ab5a0e394b3bb
I20260617 07:53:27.732167 745 tablet_service.cc:1558] Processing DeleteTablet for tablet ce1cb2c879e6451886c55907678792de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
W20260617 07:53:27.733227 713 leader_election.cc:343] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 630e540a77374c11895ab5a0e394b3bb
I20260617 07:53:27.733287 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet ce1cb2c879e6451886c55907678792de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.733327 713 leader_election.cc:304] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.734279 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_1154ee77eaa9489b89ed7bda6047ab9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:27.734848 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1154ee77eaa9489b89ed7bda6047ab9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:27.736589 2968 raft_consensus.cc:2749] T 630e540a77374c11895ab5a0e394b3bb P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.737799 1170 rpcz_store.cc:276] 0617 07:53:23.928969 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.929040 (+ 71us) service_pool.cc:224] Handling call
0617 07:53:27.131024 (+3201984us) ts_tablet_manager.cc:1151] Deleting tablet 8a4f81daf583464e988521e189ca39b6
0617 07:53:27.131035 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.503110 (+372075us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.562275 (+ 59165us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.582443 (+ 20168us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3151541}
I20260617 07:53:27.738412 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 8a4f81daf583464e988521e189ca39b6 (table default.Table_7922639f29994091bdceabbc831c9a02 [id=04c31437a9c64c26bcd92c5749a6937a]) successfully deleted
I20260617 07:53:27.742331 2775 consensus_queue.cc:1048] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:27.744625 461 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet 3e5c409221fa4a069f2427150d4499da
I20260617 07:53:27.751482 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e5c409221fa4a069f2427150d4499da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:27.754993 2968 raft_consensus.cc:493] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.755348 2968 raft_consensus.cc:515] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
W20260617 07:53:27.757509 716 leader_election.cc:343] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 1f6264adc3994c22864ea73106ba2320
I20260617 07:53:27.758412 2968 leader_election.cc:290] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.760021 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e5c409221fa4a069f2427150d4499da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.760632 3049 tablet.cc:1724] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:27.762331 2852 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 07:53:27.763615 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 622) took 3937 ms. Trace:
W20260617 07:53:27.764987 713 leader_election.cc:343] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 1f6264adc3994c22864ea73106ba2320
I20260617 07:53:27.765110 713 leader_election.cc:304] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.765769 2852 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 07:53:27.766160 2852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 07:53:27.766328 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet 1382fc75785e4b07bf1688fa5385500a (table default.Table_0a3622a666594847848eb4982fd1316a [id=52357c6af1e04f2c82768cb39fe1be8d]). Expected version 3 got 0
I20260617 07:53:27.766916 2968 raft_consensus.cc:2749] T 1f6264adc3994c22864ea73106ba2320 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.767478 2775 consensus_queue.cc:1048] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:27.770587 2968 raft_consensus.cc:493] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.770808 2968 raft_consensus.cc:515] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.771775 461 catalog_manager.cc:5788] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497) does not have the latest schema for tablet ca400838f5214d1a8f57e72c5068f0f9 (table default.Table_1a37fbbe9740440a8c245559a94b7f5f [id=5fe1ae1bcfdb4d69b5aaa153dccbc1fa]). Expected version 1 got 0
I20260617 07:53:27.771929 2968 leader_election.cc:290] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:27.772717 713 leader_election.cc:343] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 68b448c65e684f49bf142ce2b5084d33
I20260617 07:53:27.763706 1170 rpcz_store.cc:276] 0617 07:53:23.826575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.867594 (+ 41019us) service_pool.cc:224] Handling call
0617 07:53:27.744434 (+3876840us) ts_tablet_manager.cc:1151] Deleting tablet 2c120eba06a549ef88ffa19998ab0f3d
0617 07:53:27.744444 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.763596 (+ 19152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3764310}
I20260617 07:53:27.774930 1170 tablet_replica.cc:333] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
W20260617 07:53:27.775123 716 leader_election.cc:343] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 68b448c65e684f49bf142ce2b5084d33
I20260617 07:53:27.775236 716 leader_election.cc:304] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.775457 2968 raft_consensus.cc:2749] T 68b448c65e684f49bf142ce2b5084d33 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.775179 1170 raft_consensus.cc:2243] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:27.780042 1170 raft_consensus.cc:2272] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:27.780812 1170 ts_tablet_manager.cc:1916] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.783847 461 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_fe8411e8dafb47529b9c43928203b95a" } new_table_name: "default.Table_a8c724d64e944e75b0fefd3fb6932e90" modify_external_catalogs: true
I20260617 07:53:27.784528 3039 tablet.cc:1724] T 8cf4025a0f784cc6868950e51a45da2e P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:27.785516 3034 tablet.cc:1724] T 8cf4025a0f784cc6868950e51a45da2e P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260617 07:53:27.785841 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 2c120eba06a549ef88ffa19998ab0f3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c120eba06a549ef88ffa19998ab0f3d already in progress: creating tablet
I20260617 07:53:27.786576 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet df5224716de249e9be9d7239407579a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.788707 1021 tablet_service.cc:1558] Processing DeleteTablet for tablet ed9a99cdcbb74a3fb74654a26716a1c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 57c83de284064dd4a14fcea5ce6b08ad) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.798831 3039 tablet.cc:1724] T 361845f7627b4b9f8481b4a66bc53e9c P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:27.805534 1171 tablet_bootstrap.cc:492] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:27.805821 1171 ts_tablet_manager.cc:1403] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.195s user 0.001s sys 0.004s
I20260617 07:53:27.806969 1171 raft_consensus.cc:359] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.808782 1178 tablet_bootstrap.cc:492] T 5578fd5cb3724ed5b92b313bd52889ad P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.808910 1178 ts_tablet_manager.cc:1403] T 5578fd5cb3724ed5b92b313bd52889ad P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.147s user 0.024s sys 0.014s
I20260617 07:53:27.809258 3054 raft_consensus.cc:493] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.811805 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet adbbe7eb5181431290f57ed9128181a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:27.812588 3051 tablet.cc:1724] T 1382fc75785e4b07bf1688fa5385500a P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:27.822395 3041 raft_consensus.cc:493] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.822561 3041 raft_consensus.cc:515] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.823297 3041 leader_election.cc:290] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:27.809635 1178 raft_consensus.cc:359] T 5578fd5cb3724ed5b92b313bd52889ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.830713 1178 raft_consensus.cc:385] T 5578fd5cb3724ed5b92b313bd52889ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.830807 1178 raft_consensus.cc:740] T 5578fd5cb3724ed5b92b313bd52889ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.831053 1178 consensus_queue.cc:260] T 5578fd5cb3724ed5b92b313bd52889ad P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.831594 1178 ts_tablet_manager.cc:1434] T 5578fd5cb3724ed5b92b313bd52889ad P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260617 07:53:27.831931 1178 tablet_bootstrap.cc:492] T 5f8602b87a20455884c16196a901d335 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.833585 1178 tablet_bootstrap.cc:654] T 5f8602b87a20455884c16196a901d335 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.836179 1178 tablet_bootstrap.cc:492] T 5f8602b87a20455884c16196a901d335 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.836359 1178 ts_tablet_manager.cc:1403] T 5f8602b87a20455884c16196a901d335 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260617 07:53:27.837291 1178 raft_consensus.cc:359] T 5f8602b87a20455884c16196a901d335 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.837505 1178 raft_consensus.cc:385] T 5f8602b87a20455884c16196a901d335 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.837574 1178 raft_consensus.cc:740] T 5f8602b87a20455884c16196a901d335 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.837836 1178 consensus_queue.cc:260] T 5f8602b87a20455884c16196a901d335 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.838461 1178 ts_tablet_manager.cc:1434] T 5f8602b87a20455884c16196a901d335 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 07:53:27.838754 1178 tablet_bootstrap.cc:492] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.824661 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca400838f5214d1a8f57e72c5068f0f9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:27.840081 986 leader_election.cc:343] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.841383 1178 tablet_bootstrap.cc:654] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.836103 3054 raft_consensus.cc:515] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.842496 3054 leader_election.cc:290] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.843019 1171 raft_consensus.cc:385] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.843257 1171 raft_consensus.cc:740] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
W20260617 07:53:27.843405 716 leader_election.cc:343] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: a02dbb70eec84932917ef282fdae0bd7
W20260617 07:53:27.843918 713 leader_election.cc:343] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a02dbb70eec84932917ef282fdae0bd7
I20260617 07:53:27.844059 713 leader_election.cc:304] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:27.844265 1178 tablet_bootstrap.cc:492] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:27.844420 1178 ts_tablet_manager.cc:1403] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260617 07:53:27.844461 3054 raft_consensus.cc:2749] T a02dbb70eec84932917ef282fdae0bd7 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:27.845319 1178 raft_consensus.cc:359] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.845527 1178 raft_consensus.cc:385] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.846107 1178 raft_consensus.cc:740] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.846290 1178 consensus_queue.cc:260] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.843736 1171 consensus_queue.cc:260] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.847630 1178 ts_tablet_manager.cc:1434] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:27.848210 1178 tablet_bootstrap.cc:492] T 9618a5c0c9dd4c368f5763c434f70da5 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:27.850160 455 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 361845f7627b4b9f8481b4a66bc53e9c (table default.Table_677aba508baf46ab8247a3d1b109fb23 [id=f00addaaab9440a3a70bf54d62a94cd3]). Expected version 2 got 0
I20260617 07:53:27.850703 1178 tablet_bootstrap.cc:654] T 9618a5c0c9dd4c368f5763c434f70da5 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.856654 1862 ts_tablet_manager.cc:1929] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:27.876034 1846 ts_tablet_manager.cc:1929] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:27.876487 1846 log.cc:1199] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/7f7611958cf143438497c93f5f2bc098
I20260617 07:53:27.876950 1846 ts_tablet_manager.cc:1950] T 7f7611958cf143438497c93f5f2bc098 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:27.877815 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 818) took 3769 ms. Trace:
I20260617 07:53:27.900993 1862 log.cc:1199] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-1/wal/wals/75f32eb8ec894e029a428bbd62caa0f5
I20260617 07:53:27.901518 1862 ts_tablet_manager.cc:1950] T 75f32eb8ec894e029a428bbd62caa0f5 P 8b7080d37ca245fe914d3dc90f17e3ba: Deleting consensus metadata
I20260617 07:53:27.902364 1862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37622 (request call id 773) took 1802 ms. Trace:
I20260617 07:53:27.900846 2774 raft_consensus.cc:493] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.902628 2774 raft_consensus.cc:515] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.903625 896 tablet_service.cc:1511] Processing CreateTablet for tablet 012757b65e2c4bd2bdad596cb9b9ff93 (DEFAULT_TABLE table=default.Table_9743c949d80545a48ccfba13aca5060e [id=541e551a2dd34be7be6f80671af12672]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.903793 2774 leader_election.cc:290] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.904042 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012757b65e2c4bd2bdad596cb9b9ff93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.859901 1171 ts_tablet_manager.cc:1434] T d3ffa2d61d5942b19aff2b2cf2b1e0b3 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.054s user 0.002s sys 0.000s
I20260617 07:53:27.904687 1171 tablet_bootstrap.cc:492] T 9436fb7fca094eaab925748e254b1a62 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:27.906334 1171 tablet_bootstrap.cc:654] T 9436fb7fca094eaab925748e254b1a62 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.908171 1172 tablet_bootstrap.cc:492] T cc26e46cd03d47099015ddbac0d17688 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.908349 1172 ts_tablet_manager.cc:1403] T cc26e46cd03d47099015ddbac0d17688 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.183s user 0.028s sys 0.064s
I20260617 07:53:27.909075 1172 raft_consensus.cc:359] T cc26e46cd03d47099015ddbac0d17688 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.909294 1172 raft_consensus.cc:385] T cc26e46cd03d47099015ddbac0d17688 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.909379 1172 raft_consensus.cc:740] T cc26e46cd03d47099015ddbac0d17688 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.909623 1172 consensus_queue.cc:260] T cc26e46cd03d47099015ddbac0d17688 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.910125 1172 ts_tablet_manager.cc:1434] T cc26e46cd03d47099015ddbac0d17688 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:27.910394 1172 tablet_bootstrap.cc:492] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.911877 1172 tablet_bootstrap.cc:654] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.911442 1862 rpcz_store.cc:276] 0617 07:53:26.099669 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:26.099713 (+ 44us) service_pool.cc:224] Handling call
0617 07:53:27.655945 (+1556232us) ts_tablet_manager.cc:1151] Deleting tablet 75f32eb8ec894e029a428bbd62caa0f5
0617 07:53:27.655955 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.712139 (+ 56184us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.856597 (+144458us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.902345 (+ 45748us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1556112}
I20260617 07:53:27.918341 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b1b128ce484d9ab371fa3c5edc6ea6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b" is_pre_election: true
I20260617 07:53:27.918596 1046 raft_consensus.cc:2468] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 0.
I20260617 07:53:27.919032 851 leader_election.cc:304] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:27.919834 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9cc1ec77a84113a6d38366c78d1cd3 (DEFAULT_TABLE table=default.Table_81bb1dfa2f954da1a4974542d74c7eed [id=77706cb8c4cd49b2806fb4dfb39750c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.920177 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9cc1ec77a84113a6d38366c78d1cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.920565 2987 raft_consensus.cc:493] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.920666 2987 raft_consensus.cc:515] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.921289 2987 leader_election.cc:290] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:27.923307 1172 tablet_bootstrap.cc:492] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.923497 1172 ts_tablet_manager.cc:1403] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.004s
I20260617 07:53:27.924466 1172 raft_consensus.cc:359] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.925071 1172 raft_consensus.cc:385] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.925273 1172 raft_consensus.cc:740] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.925940 1170 ts_tablet_manager.cc:1929] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:27.925660 1172 consensus_queue.cc:260] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.890959 766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db4fdde370e4d30bbf14285923644a1" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:27.892922 765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db4fdde370e4d30bbf14285923644a1" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.893810 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06187aa09fd4776a992a07405a10876" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.926437 896 tablet_service.cc:1511] Processing CreateTablet for tablet c908826a279f4810b77ee64376af5683 (DEFAULT_TABLE table=default.Table_83b0a019b32c4c7fb0ff00b2f14a0c36 [id=d00d434ba5e74e38a3b1834d6c7432de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.896741 779 raft_consensus.cc:3060] T f14a3cb5e50b42b18ffda6f38cdfdd73 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.926810 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c908826a279f4810b77ee64376af5683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.926904 1172 ts_tablet_manager.cc:1434] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:27.927232 1172 tablet_bootstrap.cc:492] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.896922 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05de71ea02df48ffacb369caa7f7d3de" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.898766 768 raft_consensus.cc:3060] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.931139 1172 tablet_bootstrap.cc:654] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.931247 2774 raft_consensus.cc:2804] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 07:53:27.931324 2774 raft_consensus.cc:493] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 07:53:27.931376 2774 raft_consensus.cc:3060] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:27.934713 2774 raft_consensus.cc:515] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.935878 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9a99cdcbb74a3fb74654a26716a1c9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:27.937060 986 leader_election.cc:343] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:27.941743 898 tablet_service.cc:1558] Processing DeleteTablet for tablet fa6e25c657294fe2916fe1b121c1df9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:27.941932 1172 tablet_bootstrap.cc:492] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.942056 1172 ts_tablet_manager.cc:1403] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.002s
I20260617 07:53:27.942772 1172 raft_consensus.cc:359] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.942926 1172 raft_consensus.cc:385] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.942982 1172 raft_consensus.cc:740] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.943158 1172 consensus_queue.cc:260] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.945216 1172 ts_tablet_manager.cc:1434] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 07:53:27.945492 1172 tablet_bootstrap.cc:492] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.948491 1172 tablet_bootstrap.cc:654] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.954308 1172 tablet_bootstrap.cc:492] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:27.954490 1172 ts_tablet_manager.cc:1403] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260617 07:53:27.955485 1172 raft_consensus.cc:359] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.955670 1172 raft_consensus.cc:385] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.955725 1172 raft_consensus.cc:740] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.955916 1172 consensus_queue.cc:260] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.959223 2987 raft_consensus.cc:493] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:27.959399 2987 raft_consensus.cc:515] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:27.960001 2987 leader_election.cc:290] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:27.960796 1172 ts_tablet_manager.cc:1434] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 07:53:27.961498 1172 tablet_bootstrap.cc:492] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:27.962257 1171 tablet_bootstrap.cc:492] T 9436fb7fca094eaab925748e254b1a62 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:27.962407 1171 ts_tablet_manager.cc:1403] T 9436fb7fca094eaab925748e254b1a62 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.000s
I20260617 07:53:27.963006 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d248d3bce0c4c19a9c07e94f875730a with delete_type TABLET_DATA_DELETED (replaced by tablet 49c8b9292c344972b383246dc6659073) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:27.963141 1171 raft_consensus.cc:359] T 9436fb7fca094eaab925748e254b1a62 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.963410 1171 raft_consensus.cc:385] T 9436fb7fca094eaab925748e254b1a62 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:27.963469 1171 raft_consensus.cc:740] T 9436fb7fca094eaab925748e254b1a62 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:27.963719 1171 consensus_queue.cc:260] T 9436fb7fca094eaab925748e254b1a62 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:27.964110 772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c76bfcbd22e4bfb97346a1b56f68dab" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:27.964623 1172 tablet_bootstrap.cc:654] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.965874 1846 rpcz_store.cc:276] 0617 07:53:24.108347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.108399 (+ 52us) service_pool.cc:224] Handling call
0617 07:53:27.723168 (+3614769us) ts_tablet_manager.cc:1151] Deleting tablet 7f7611958cf143438497c93f5f2bc098
0617 07:53:27.723179 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.865142 (+141963us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.875971 (+ 10829us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.877788 (+ 1817us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3591580}
I20260617 07:53:27.966490 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 7f7611958cf143438497c93f5f2bc098 (table default.Table_63ca0f0334524b60a193ce1677ca2ee1 [id=64ebbbaabc4e462f81869b6ff888991a]) successfully deleted
I20260617 07:53:27.966796 898 tablet_service.cc:1511] Processing CreateTablet for tablet be18d009636f4e4ba2fcb63c2656124c (DEFAULT_TABLE table=default.Table_a91055837a9343b382d1cfe2137d03db [id=2a5b4bf123974e7fbfddf975b173b392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.926100 1170 log.cc:1199] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/f4d8542262864a0ab9d763528502bcbb
I20260617 07:53:27.967438 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be18d009636f4e4ba2fcb63c2656124c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.967515 1170 ts_tablet_manager.cc:1950] T f4d8542262864a0ab9d763528502bcbb P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:27.968385 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 636) took 3968 ms. Trace:
I20260617 07:53:27.968510 1170 rpcz_store.cc:276] 0617 07:53:23.999677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.000710 (+ 1033us) service_pool.cc:224] Handling call
0617 07:53:27.774606 (+3773896us) ts_tablet_manager.cc:1151] Deleting tablet f4d8542262864a0ab9d763528502bcbb
0617 07:53:27.774616 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.864449 (+ 89833us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.925885 (+ 61436us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:27.968365 (+ 42480us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3766079}
I20260617 07:53:27.968916 1170 tablet_replica.cc:333] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:27.969135 1170 raft_consensus.cc:2243] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:27.969364 1170 raft_consensus.cc:2272] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:27.969972 1170 ts_tablet_manager.cc:1916] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.972369 3039 tablet.cc:1724] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:27.973601 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 819) took 3865 ms. Trace:
I20260617 07:53:27.973778 1846 rpcz_store.cc:276] 0617 07:53:24.108652 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.108713 (+ 61us) service_pool.cc:224] Handling call
0617 07:53:27.973472 (+3864759us) ts_tablet_manager.cc:1151] Deleting tablet 345770b456d64fedba27347674a70900
0617 07:53:27.973484 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.973584 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3840407}
W20260617 07:53:27.974308 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 345770b456d64fedba27347674a70900 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 345770b456d64fedba27347674a70900 already in progress: creating tablet
I20260617 07:53:27.974732 1171 ts_tablet_manager.cc:1434] T 9436fb7fca094eaab925748e254b1a62 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260617 07:53:27.973682 2774 leader_election.cc:290] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Requested vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
I20260617 07:53:27.975452 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 823) took 3846 ms. Trace:
I20260617 07:53:27.975577 1846 rpcz_store.cc:276] 0617 07:53:24.129457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.129512 (+ 55us) service_pool.cc:224] Handling call
0617 07:53:27.975334 (+3845822us) ts_tablet_manager.cc:1151] Deleting tablet e62175d5cc854d45838454043220954e
0617 07:53:27.975347 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.975436 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3841317}
W20260617 07:53:27.976015 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet e62175d5cc854d45838454043220954e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e62175d5cc854d45838454043220954e already in progress: creating tablet
I20260617 07:53:27.975210 1171 tablet_bootstrap.cc:492] T 1b8ffe940130474ca09d3680e470918a P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:27.976300 895 tablet_service.cc:1511] Processing CreateTablet for tablet f508e4508a91489b9e5bb84112ab2843 (DEFAULT_TABLE table=default.Table_3e88b34d122b4cdc89a76f67615e2bb0 [id=8bb0398e39b44518bd465943eea0d0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.976693 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f508e4508a91489b9e5bb84112ab2843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:27.977875 1171 tablet_bootstrap.cc:654] T 1b8ffe940130474ca09d3680e470918a P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:27.982980 3039 tablet.cc:1719] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7: Skipping requested alter to schema version 2, tablet already version 2
I20260617 07:53:27.983958 3039 tablet.cc:1724] T 24066965db7141a6a970ec08f835a820 P 6438857e0a7741ceaadf84cb9dc979e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:27.993669 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 834) took 3546 ms. Trace:
I20260617 07:53:27.993865 1846 rpcz_store.cc:276] 0617 07:53:24.446772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.449763 (+ 2991us) service_pool.cc:224] Handling call
0617 07:53:27.993545 (+3543782us) ts_tablet_manager.cc:1151] Deleting tablet d4afe4a3d708447fa7ab8bf53614c4ba
0617 07:53:27.993555 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:27.993651 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3543627}
I20260617 07:53:27.994001 895 tablet_service.cc:1511] Processing CreateTablet for tablet 27048e7b45114626a8225629531acba3 (DEFAULT_TABLE table=default.Table_e5a4efb78d224baea198c245066b0ff1 [id=4366a33b91654cfd810fabdce9e4acbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:27.994428 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27048e7b45114626a8225629531acba3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 07:53:27.994529 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d4afe4a3d708447fa7ab8bf53614c4ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4afe4a3d708447fa7ab8bf53614c4ba already in progress: creating tablet
I20260617 07:53:27.995136 1846 tablet_replica.cc:333] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:27.995368 1846 raft_consensus.cc:2243] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:27.995563 1846 raft_consensus.cc:2272] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:27.996100 1846 ts_tablet_manager.cc:1916] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:27.973167 1046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b1b128ce484d9ab371fa3c5edc6ea6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3bec007846459a9da0c7b8211e477b"
I20260617 07:53:27.999835 1046 raft_consensus.cc:3060] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Advancing to term 1
I20260617 07:53:28.002410 1046 raft_consensus.cc:2468] T 25b1b128ce484d9ab371fa3c5edc6ea6 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b7080d37ca245fe914d3dc90f17e3ba in term 1.
I20260617 07:53:28.003082 851 leader_election.cc:304] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b; no voters:
I20260617 07:53:28.003479 2709 raft_consensus.cc:2804] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260617 07:53:28.003618 2709 raft_consensus.cc:697] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [term 1 LEADER]: Becoming Leader. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Running, Role: LEADER
I20260617 07:53:28.003876 2709 consensus_queue.cc:237] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.005087 2775 consensus_queue.cc:1048] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:28.009835 1171 tablet_bootstrap.cc:492] T 1b8ffe940130474ca09d3680e470918a P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:28.010010 1171 ts_tablet_manager.cc:1403] T 1b8ffe940130474ca09d3680e470918a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.002s
I20260617 07:53:28.010855 1171 raft_consensus.cc:359] T 1b8ffe940130474ca09d3680e470918a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.011061 1171 raft_consensus.cc:385] T 1b8ffe940130474ca09d3680e470918a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.011133 1171 raft_consensus.cc:740] T 1b8ffe940130474ca09d3680e470918a P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.015756 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet f4d8542262864a0ab9d763528502bcbb (table default.Table_1349be0f5c284db08f696236a83d4fcd [id=ba6bd5b57bfc49f6a91b95badafdcb03]) successfully deleted
W20260617 07:53:28.019863 986 leader_election.cc:343] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.022804 889 tablet_service.cc:1511] Processing CreateTablet for tablet 04a72094621548cfb85116fd1be81b77 (DEFAULT_TABLE table=default.Table_8b18ee371b3345c597ad326b0645d2a9 [id=0654557d3f3d4e1dbef0de8577414b12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.023188 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a72094621548cfb85116fd1be81b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.029213 1171 consensus_queue.cc:260] T 1b8ffe940130474ca09d3680e470918a P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.029796 1171 ts_tablet_manager.cc:1434] T 1b8ffe940130474ca09d3680e470918a P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260617 07:53:28.030081 1171 tablet_bootstrap.cc:492] T 5942eea42c7541349ad7b6560e6777c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:28.031446 883 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1d9ce2ab5b428893719d9acd272d88 with delete_type TABLET_DATA_DELETED (replaced by tablet 20cfb1ae290f43cbadead54c8f692f21) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.031620 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8cd6ff8fa44536acdd84a107ab1525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:08 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.031797 889 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb7e8f6f6784deea1065e9a11740375 (DEFAULT_TABLE table=default.Table_38930fa6fb03412e8256e4828be1254d [id=ac4d271398f440a9a92a91c528c83203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.032197 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb7e8f6f6784deea1065e9a11740375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.036080 2774 raft_consensus.cc:493] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:28.036273 2774 raft_consensus.cc:515] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.037292 2774 leader_election.cc:290] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:28.037691 851 leader_election.cc:343] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: a1e064b5bc93442f83aeffa88861d818
I20260617 07:53:28.041380 1172 tablet_bootstrap.cc:492] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:28.041509 1172 ts_tablet_manager.cc:1403] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.080s user 0.011s sys 0.027s
I20260617 07:53:28.043280 890 tablet_service.cc:1558] Processing DeleteTablet for tablet e897b111e65c497591c7daaa81d783c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:12 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.043905 1172 raft_consensus.cc:359] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.044127 1172 raft_consensus.cc:385] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.044205 1172 raft_consensus.cc:740] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.044448 1172 consensus_queue.cc:260] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.045085 1172 ts_tablet_manager.cc:1434] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260617 07:53:28.047017 1172 tablet_bootstrap.cc:492] T 2d9656e092de4f6e9858d387428fed39 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:28.054845 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 05de71ea02df48ffacb369caa7f7d3de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.056867 1846 ts_tablet_manager.cc:1929] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.058667 1170 ts_tablet_manager.cc:1929] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 07:53:28.059373 1171 tablet_bootstrap.cc:654] T 5942eea42c7541349ad7b6560e6777c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.063678 1846 log.cc:1199] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/121339ab4842432e9fb7bc357750f8ad
I20260617 07:53:28.063876 1170 log.cc:1199] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/770a5216299842b890d483ca37b0ee86
I20260617 07:53:28.065251 1846 ts_tablet_manager.cc:1950] T 121339ab4842432e9fb7bc357750f8ad P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:28.067211 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 835) took 3505 ms. Trace:
I20260617 07:53:28.068442 890 tablet_service.cc:1558] Processing DeleteTablet for tablet ff67e763f24e4d6289ff0d3d3c8e8afc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.069986 1846 rpcz_store.cc:276] 0617 07:53:24.561454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.561525 (+ 71us) service_pool.cc:224] Handling call
0617 07:53:27.995095 (+3433570us) ts_tablet_manager.cc:1151] Deleting tablet 121339ab4842432e9fb7bc357750f8ad
0617 07:53:27.995103 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.038417 (+ 43314us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.056799 (+ 18382us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.067192 (+ 10393us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3426101}
I20260617 07:53:28.071026 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 121339ab4842432e9fb7bc357750f8ad (table default.Table_50c9e41224614d21a12eac5dea96559c [id=121feb8666fe4cb5b796fecf0bf1f8b0]) successfully deleted
I20260617 07:53:28.073551 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 838) took 3302 ms. Trace:
I20260617 07:53:28.075706 1846 rpcz_store.cc:276] 0617 07:53:24.771152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.798297 (+ 27145us) service_pool.cc:224] Handling call
0617 07:53:28.073417 (+3275120us) ts_tablet_manager.cc:1151] Deleting tablet 56e089af99464471b4d5482c3364d20f
0617 07:53:28.073429 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.073533 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3274846}
W20260617 07:53:28.076707 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 56e089af99464471b4d5482c3364d20f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56e089af99464471b4d5482c3364d20f already in progress: creating tablet
W20260617 07:53:28.079773 986 consensus_peers.cc:597] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260617 07:53:28.080183 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 839) took 3222 ms. Trace:
I20260617 07:53:28.080993 1846 rpcz_store.cc:276] 0617 07:53:24.857272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.857736 (+ 464us) service_pool.cc:224] Handling call
0617 07:53:28.080037 (+3222301us) ts_tablet_manager.cc:1151] Deleting tablet b62ae096bfd347029ef8d7f0462dd111
0617 07:53:28.080049 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.080163 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3222068}
I20260617 07:53:28.081673 890 tablet_service.cc:1558] Processing DeleteTablet for tablet fe8a11ed3c684ef8b4a159078fe87aa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
W20260617 07:53:28.081983 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet b62ae096bfd347029ef8d7f0462dd111 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b62ae096bfd347029ef8d7f0462dd111 already in progress: creating tablet
I20260617 07:53:28.082551 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 840) took 3221 ms. Trace:
I20260617 07:53:28.083200 1846 rpcz_store.cc:276] 0617 07:53:24.860986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.862471 (+ 1485us) service_pool.cc:224] Handling call
0617 07:53:28.082443 (+3219972us) ts_tablet_manager.cc:1151] Deleting tablet a4a35e3b7bb74667aa498c58a856cacc
0617 07:53:28.082452 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.082536 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3219780}
I20260617 07:53:28.083906 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ab3610ee6f424b3d9c5926cd42334949"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:28.084072 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet a4a35e3b7bb74667aa498c58a856cacc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4a35e3b7bb74667aa498c58a856cacc already in progress: creating tablet
I20260617 07:53:28.084525 1846 tablet_replica.cc:333] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:28.084511 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab3610ee6f424b3d9c5926cd42334949 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:28.084733 1846 raft_consensus.cc:2243] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.084874 1846 raft_consensus.cc:2272] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.085384 1846 ts_tablet_manager.cc:1916] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.085902 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_ee9ce25bddd5451e87f091f85ff8afd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:28.086505 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee9ce25bddd5451e87f091f85ff8afd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:28.088864 890 tablet_service.cc:1558] Processing DeleteTablet for tablet b1f095603e54419784d5a30a687da8b4 with delete_type TABLET_DATA_DELETED (replaced by tablet bb990fb176ed4e0482b29beb5a737f6f) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.089383 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dead95cfb624c3ca99069465813fea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.089463 1178 tablet_bootstrap.cc:492] T 9618a5c0c9dd4c368f5763c434f70da5 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:28.089572 1178 ts_tablet_manager.cc:1403] T 9618a5c0c9dd4c368f5763c434f70da5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.241s user 0.042s sys 0.070s
I20260617 07:53:28.089771 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 9561a1b846a24b1abb0b16bb82b417ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.090329 1178 raft_consensus.cc:359] T 9618a5c0c9dd4c368f5763c434f70da5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.090348 890 tablet_service.cc:1511] Processing CreateTablet for tablet 2aaabc6fc4ed488186b71dbbb4d2ce52 (DEFAULT_TABLE table=default.Table_0ccedc77aa4847729517007c4a956aea [id=d15f01c09bf045a7a2e863dfce01d492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.090466 1178 raft_consensus.cc:385] T 9618a5c0c9dd4c368f5763c434f70da5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.090507 1178 raft_consensus.cc:740] T 9618a5c0c9dd4c368f5763c434f70da5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.090689 1178 consensus_queue.cc:260] T 9618a5c0c9dd4c368f5763c434f70da5 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.090822 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaabc6fc4ed488186b71dbbb4d2ce52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.091276 1178 ts_tablet_manager.cc:1434] T 9618a5c0c9dd4c368f5763c434f70da5 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 07:53:28.091542 1178 tablet_bootstrap.cc:492] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:28.093962 1178 tablet_bootstrap.cc:654] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.103096 1178 tablet_bootstrap.cc:492] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:28.103319 1178 ts_tablet_manager.cc:1403] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.001s
I20260617 07:53:28.104349 882 tablet_service.cc:1511] Processing CreateTablet for tablet d004141fc3474e5698dbcdd675d1146b (DEFAULT_TABLE table=default.Table_9785506a8a56487581a2f11ab8cb65b4 [id=fa5fa0a6e8354cb8874b3f94674d7284]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.104522 898 tablet_service.cc:1511] Processing CreateTablet for tablet bd2623a9d807412fa46b435dfde3f762 (DEFAULT_TABLE table=default.Table_93379979809441178fa6c159c07f77ce [id=1ce585dfe5c64a0caed626f1f56a05f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.104349 896 tablet_service.cc:1511] Processing CreateTablet for tablet abad8ab0b08441f498fcb6ecb21916ae (DEFAULT_TABLE table=default.Table_489156baa9ad47d0b71d7437dec196cd [id=1d213a295f0a4198abdf9323e153d82d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.104820 883 tablet_service.cc:1558] Processing DeleteTablet for tablet 737e9344fc824714a2c2596170637158 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:11 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.105000 884 tablet_service.cc:1558] Processing DeleteTablet for tablet d06187aa09fd4776a992a07405a10876 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:20 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.105141 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db4fdde370e4d30bbf14285923644a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.105187 1178 raft_consensus.cc:359] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.105353 1178 raft_consensus.cc:385] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.105396 1178 raft_consensus.cc:740] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.105582 1178 consensus_queue.cc:260] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.105638 880 tablet_service.cc:1511] Processing CreateTablet for tablet fe8a11ed3c684ef8b4a159078fe87aa5 (DEFAULT_TABLE table=default.Table_69c3ba19e7584094b3015b54aa67d1e7 [id=534b385724054f8c8f1c00e2ebf039b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.105791 887 tablet_service.cc:1511] Processing CreateTablet for tablet 20436dbcc6794e6e81e2228bd0ed6bbe (DEFAULT_TABLE table=default.Table_bed6a31c5b494a2c9217775f1275b9c9 [id=3ba41d84834549bab8676d82af5370b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.106120 1178 ts_tablet_manager.cc:1434] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260617 07:53:28.106201 888 tablet_service.cc:1511] Processing CreateTablet for tablet 6877fe69888d4b078dab6084d0b1db2d (DEFAULT_TABLE table=default.Table_e01ba3682fbb4093b41ced5b097b9547 [id=175f48d4e2524203aeb03f180d8e38ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.106287 881 tablet_service.cc:1511] Processing CreateTablet for tablet 9a28168af90148d390604abe3b40da02 (DEFAULT_TABLE table=default.Table_10b6a1799bb344f0b323fa581c74c027 [id=8d68508480b94cc395ede9c752d52321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.106323 884 tablet_service.cc:1511] Processing CreateTablet for tablet 706d533b026e44b6b344876046d92966 (DEFAULT_TABLE table=default.Table_b8df6bf2a67d44598b3472dd0031e570 [id=951e230ec1f84717b9ed7d19f4dfbc16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.106729 886 tablet_service.cc:1511] Processing CreateTablet for tablet b60171338bfa49c99457eeb0d22ecc35 (DEFAULT_TABLE table=default.Table_0b7dbffe5422405dba60a8ad9491a5b7 [id=1ac1415ca01c4c18b42e98f9d42cfb8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.106789 1178 tablet_bootstrap.cc:492] T 488cc3a082b14dee8f70153e6f2925a4 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:28.107012 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb3224d80e64d908961fb81f3a71620 (DEFAULT_TABLE table=default.Table_a090d99b416c43b38cff612ba5c45a1b [id=3e81ce22566a4bc1ac168a0d0a996542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.107060 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 07431acc9208489aaea2f8c4205e46a5 with delete_type TABLET_DATA_DELETED (replaced by tablet 435bf79fe29d4e81bf7e52e30649042f) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.104744 882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d004141fc3474e5698dbcdd675d1146b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.109154 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6877fe69888d4b078dab6084d0b1db2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.109330 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60171338bfa49c99457eeb0d22ecc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.109484 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb3224d80e64d908961fb81f3a71620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.109634 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2623a9d807412fa46b435dfde3f762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.110532 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abad8ab0b08441f498fcb6ecb21916ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.113668 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20436dbcc6794e6e81e2228bd0ed6bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.114149 883 tablet_service.cc:1511] Processing CreateTablet for tablet 765f4b147edc4386bb30df7ae1e635be (DEFAULT_TABLE table=default.Table_d0e5b3d77c244306b561180dd78f6fa2 [id=38620e8597df45ccae38a78ee86caee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.114305 881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a28168af90148d390604abe3b40da02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.114522 883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765f4b147edc4386bb30df7ae1e635be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.118026 880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8a11ed3c684ef8b4a159078fe87aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.119748 1178 tablet_bootstrap.cc:654] T 488cc3a082b14dee8f70153e6f2925a4 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.121361 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706d533b026e44b6b344876046d92966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.131681 1846 ts_tablet_manager.cc:1929] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.131785 1846 log.cc:1199] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/65bf5384ec244d36ba3d4e781c5eb8a3
I20260617 07:53:28.132154 1846 ts_tablet_manager.cc:1950] T 65bf5384ec244d36ba3d4e781c5eb8a3 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:28.132860 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 841) took 3244 ms. Trace:
I20260617 07:53:28.132946 1846 rpcz_store.cc:276] 0617 07:53:24.888596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.888649 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:28.084475 (+3195826us) ts_tablet_manager.cc:1151] Deleting tablet 65bf5384ec244d36ba3d4e781c5eb8a3
0617 07:53:28.084486 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.126692 (+ 42206us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.131635 (+ 4943us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.132841 (+ 1206us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3195576}
I20260617 07:53:28.133251 1846 tablet_replica.cc:333] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:28.133414 1846 raft_consensus.cc:2243] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.133433 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 65bf5384ec244d36ba3d4e781c5eb8a3 (table default.Table_0b705f18dfe34487821e76d515b4a2be [id=d3c16f845bc84f5f916ae4a5cf3e8254]) successfully deleted
I20260617 07:53:28.133526 1846 raft_consensus.cc:2272] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.133996 1846 ts_tablet_manager.cc:1916] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.134012 890 tablet_service.cc:1511] Processing CreateTablet for tablet cb9c495f611444e4967060bdb5c66038 (DEFAULT_TABLE table=default.Table_475b62f628cb4fedb0a078c5d9d1c41c [id=e7fa0702db8047a49c13df26bcbd42cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 07:53:28.134362 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9c495f611444e4967060bdb5c66038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.139433 1846 ts_tablet_manager.cc:1929] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.139534 1846 log.cc:1199] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/60d1b4975077493eb6919b23d6523d3d
I20260617 07:53:28.139832 1846 ts_tablet_manager.cc:1950] T 60d1b4975077493eb6919b23d6523d3d P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:28.140470 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 842) took 3251 ms. Trace:
I20260617 07:53:28.140544 1846 rpcz_store.cc:276] 0617 07:53:24.888735 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.888939 (+ 204us) service_pool.cc:224] Handling call
0617 07:53:28.133209 (+3244270us) ts_tablet_manager.cc:1151] Deleting tablet 60d1b4975077493eb6919b23d6523d3d
0617 07:53:28.133217 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.136811 (+ 3594us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.139391 (+ 2580us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.140451 (+ 1060us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3244060}
I20260617 07:53:28.143657 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 60d1b4975077493eb6919b23d6523d3d (table default.Table_d199dae87e49454e8a74b84f1e0e28df [id=db2d3339eca0486bae7ce80d2f36323b]) successfully deleted
I20260617 07:53:28.144886 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_209e033a163941d68e2e45e3c8fea390"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:28.145695 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_209e033a163941d68e2e45e3c8fea390 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 07:53:28.147578 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 843) took 3247 ms. Trace:
I20260617 07:53:28.147655 1846 rpcz_store.cc:276] 0617 07:53:24.899887 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.899936 (+ 49us) service_pool.cc:224] Handling call
0617 07:53:28.147415 (+3247479us) ts_tablet_manager.cc:1151] Deleting tablet b7d4fc81456445518c1158f912dd2f8f
0617 07:53:28.147427 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.147553 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3247227}
I20260617 07:53:28.148610 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 844) took 3229 ms. Trace:
I20260617 07:53:28.148694 1846 rpcz_store.cc:276] 0617 07:53:24.918930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.918989 (+ 59us) service_pool.cc:224] Handling call
0617 07:53:28.148509 (+3229520us) ts_tablet_manager.cc:1151] Deleting tablet 047da1717bf545a9b3a23a9d9136f66f
0617 07:53:28.148517 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.148595 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3229322}
I20260617 07:53:28.149479 1846 tablet_replica.cc:333] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:28.149904 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet b7d4fc81456445518c1158f912dd2f8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7d4fc81456445518c1158f912dd2f8f already in progress: creating tablet
I20260617 07:53:28.149672 1846 raft_consensus.cc:2243] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 07:53:28.150231 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 047da1717bf545a9b3a23a9d9136f66f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 047da1717bf545a9b3a23a9d9136f66f already in progress: creating tablet
I20260617 07:53:28.150267 1846 raft_consensus.cc:2272] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.153957 458 catalog_manager.cc:5983] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: Sending DeleteTablet for 3 replicas of tablet ba4d0d6d8e39416d94ac817a3b116652
I20260617 07:53:28.154454 458 catalog_manager.cc:6784] ReplaceTablet: tablet ba4d0d6d8e39416d94ac817a3b116652 deleted and replaced by tablet ed9f7cdc2b594800beafbe322aed04e3
I20260617 07:53:28.155483 1846 ts_tablet_manager.cc:1916] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.158833 745 tablet_service.cc:1558] Processing DeleteTablet for tablet ba4d0d6d8e39416d94ac817a3b116652 with delete_type TABLET_DATA_DELETED (replaced by tablet ed9f7cdc2b594800beafbe322aed04e3) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:28.165933 1846 ts_tablet_manager.cc:1929] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.166054 1846 log.cc:1199] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/037539021d1743bb9a66403b8a01662f
I20260617 07:53:28.166363 1846 ts_tablet_manager.cc:1950] T 037539021d1743bb9a66403b8a01662f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:28.167070 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 845) took 3178 ms. Trace:
I20260617 07:53:28.167150 1846 rpcz_store.cc:276] 0617 07:53:24.988711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.988774 (+ 63us) service_pool.cc:224] Handling call
0617 07:53:28.149437 (+3160663us) ts_tablet_manager.cc:1151] Deleting tablet 037539021d1743bb9a66403b8a01662f
0617 07:53:28.149445 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.162926 (+ 13481us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.165885 (+ 2959us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.167050 (+ 1165us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3116236}
I20260617 07:53:28.167574 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 037539021d1743bb9a66403b8a01662f (table default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]) successfully deleted
I20260617 07:53:28.172585 1846 tablet_replica.cc:333] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:28.172807 1846 raft_consensus.cc:2243] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.172964 1846 raft_consensus.cc:2272] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.173451 1846 ts_tablet_manager.cc:1916] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.173530 1171 tablet_bootstrap.cc:492] T 5942eea42c7541349ad7b6560e6777c8 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:28.173645 1171 ts_tablet_manager.cc:1403] T 5942eea42c7541349ad7b6560e6777c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.144s user 0.005s sys 0.010s
I20260617 07:53:28.174307 1171 raft_consensus.cc:359] T 5942eea42c7541349ad7b6560e6777c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.174454 1171 raft_consensus.cc:385] T 5942eea42c7541349ad7b6560e6777c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.174496 1171 raft_consensus.cc:740] T 5942eea42c7541349ad7b6560e6777c8 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.174672 1171 consensus_queue.cc:260] T 5942eea42c7541349ad7b6560e6777c8 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.175088 1171 ts_tablet_manager.cc:1434] T 5942eea42c7541349ad7b6560e6777c8 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260617 07:53:28.175341 1171 tablet_bootstrap.cc:492] T c9657e0dd2a8459cb728bdfe8a68b840 P 8b7080d37ca245fe914d3dc90f17e3ba: Bootstrap starting.
I20260617 07:53:28.176864 1171 tablet_bootstrap.cc:654] T c9657e0dd2a8459cb728bdfe8a68b840 P 8b7080d37ca245fe914d3dc90f17e3ba: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.179234 1846 ts_tablet_manager.cc:1929] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.179350 1846 log.cc:1199] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/4de8df5e15cb43c0b95ec5af3110db66
I20260617 07:53:28.179714 1846 ts_tablet_manager.cc:1950] T 4de8df5e15cb43c0b95ec5af3110db66 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:28.180357 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 846) took 3015 ms. Trace:
I20260617 07:53:28.180467 1846 rpcz_store.cc:276] 0617 07:53:25.165169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.165544 (+ 375us) service_pool.cc:224] Handling call
0617 07:53:28.172518 (+3006974us) ts_tablet_manager.cc:1151] Deleting tablet 4de8df5e15cb43c0b95ec5af3110db66
0617 07:53:28.172533 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.176256 (+ 3723us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.179178 (+ 2922us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.180333 (+ 1155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3006760}
I20260617 07:53:28.180913 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 4de8df5e15cb43c0b95ec5af3110db66 (table default.Table_da5430a09e3e44e48bafd3678bf638a2 [id=27e37deb26df4bb28507736f1decf709]) successfully deleted
I20260617 07:53:28.186347 458 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_fe72d813417e44f1af5c5a831d6db626" } new_table_name: "default.Table_cc128105dcac4e68a70551b901dc41cc" modify_external_catalogs: true
I20260617 07:53:28.189687 1846 tablet_replica.cc:333] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:28.189961 1846 raft_consensus.cc:2243] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.190117 1846 raft_consensus.cc:2272] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.190819 1050 raft_consensus.cc:1275] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Refusing update from remote peer 8b7080d37ca245fe914d3dc90f17e3ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 07:53:28.191095 2987 raft_consensus.cc:493] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:28.191223 2987 raft_consensus.cc:515] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.191740 2987 leader_election.cc:290] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:28.192417 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet ba4d0d6d8e39416d94ac817a3b116652 with delete_type TABLET_DATA_DELETED (replaced by tablet ed9f7cdc2b594800beafbe322aed04e3) from {username='slave'} at 127.0.0.1:34090
I20260617 07:53:28.192605 1170 ts_tablet_manager.cc:1950] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:28.192900 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "561c8bf9e5c840628ab1c8cf91dc2d93" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:28.193068 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 635) took 4193 ms. Trace:
W20260617 07:53:28.193431 986 leader_election.cc:343] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.193145 1170 rpcz_store.cc:276] 0617 07:53:23.999337 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:23.999430 (+ 93us) service_pool.cc:224] Handling call
0617 07:53:27.968872 (+3969442us) ts_tablet_manager.cc:1151] Deleting tablet 770a5216299842b890d483ca37b0ee86
0617 07:53:27.968881 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.024407 (+ 55526us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.058617 (+ 34210us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.193054 (+134437us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3959788}
I20260617 07:53:28.195442 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 637) took 3872 ms. Trace:
I20260617 07:53:28.195389 2709 consensus_queue.cc:1048] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:28.195503 1170 rpcz_store.cc:276] 0617 07:53:24.323187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.323245 (+ 58us) service_pool.cc:224] Handling call
0617 07:53:28.195332 (+3872087us) ts_tablet_manager.cc:1151] Deleting tablet 345770b456d64fedba27347674a70900
0617 07:53:28.195341 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.195428 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3871870}
I20260617 07:53:28.195624 2922 consensus_queue.cc:1048] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:28.195735 1170 tablet_replica.cc:333] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:28.195845 2709 consensus_queue.cc:1048] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 07:53:28.195906 1170 raft_consensus.cc:2243] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.196038 1170 raft_consensus.cc:2272] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.196374 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 770a5216299842b890d483ca37b0ee86 (table default.Table_3ee4b4c000fd46a6b571c382ac2b7134 [id=dd897f18c75c4eb3a3e593672b437bd6]) successfully deleted
I20260617 07:53:28.196621 1170 ts_tablet_manager.cc:1916] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 07:53:28.196702 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 345770b456d64fedba27347674a70900 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 345770b456d64fedba27347674a70900 already in progress: creating tablet
I20260617 07:53:28.197989 1172 tablet_bootstrap.cc:654] T 2d9656e092de4f6e9858d387428fed39 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.199815 2987 raft_consensus.cc:493] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:28.199930 2987 raft_consensus.cc:515] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.200431 2987 leader_election.cc:290] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:28.201597 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b36c91191445478055b78830be9450" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:28.205358 1170 ts_tablet_manager.cc:1929] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 07:53:28.206225 986 leader_election.cc:343] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.210209 882 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e064b5bc93442f83aeffa88861d818 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:19 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.210443 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 70e4068fdcbb41de966bcc72a4d1d426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.210618 880 tablet_service.cc:1558] Processing DeleteTablet for tablet fac31abffeb3453f8f0eeed3542ee965 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.210861 880 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e5c409221fa4a069f2427150d4499da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.210994 891 tablet_service.cc:1558] Processing DeleteTablet for tablet d3ffa2d61d5942b19aff2b2cf2b1e0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:13 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.211088 884 tablet_service.cc:1558] Processing DeleteTablet for tablet ce1cb2c879e6451886c55907678792de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.211264 882 tablet_service.cc:1558] Processing DeleteTablet for tablet 0030162ec9f840a59549649e9680a604 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:27 UTC) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.225965 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ba4d0d6d8e39416d94ac817a3b116652 with delete_type TABLET_DATA_DELETED (replaced by tablet ed9f7cdc2b594800beafbe322aed04e3) from {username='slave'} at 127.0.0.1:37622
I20260617 07:53:28.226564 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef4f711d1534713b3ebd0862db382a3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.227072 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5224716de249e9be9d7239407579a9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.228487 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb74bb5046dc4bda98be3a9ba2f4a3c6" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.229154 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9a4021cad24b99b391e99e8b46cd9e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.235000 1178 tablet_bootstrap.cc:492] T 488cc3a082b14dee8f70153e6f2925a4 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:28.235150 1178 ts_tablet_manager.cc:1403] T 488cc3a082b14dee8f70153e6f2925a4 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.129s user 0.013s sys 0.044s
I20260617 07:53:28.235831 1178 raft_consensus.cc:359] T 488cc3a082b14dee8f70153e6f2925a4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.235987 1178 raft_consensus.cc:385] T 488cc3a082b14dee8f70153e6f2925a4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.236032 1178 raft_consensus.cc:740] T 488cc3a082b14dee8f70153e6f2925a4 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.236246 1178 consensus_queue.cc:260] T 488cc3a082b14dee8f70153e6f2925a4 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.238045 1178 ts_tablet_manager.cc:1434] T 488cc3a082b14dee8f70153e6f2925a4 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 07:53:28.205459 1170 log.cc:1199] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/beb8fbb44e6147be8c9605be886a8aea
I20260617 07:53:28.240271 1170 ts_tablet_manager.cc:1950] T beb8fbb44e6147be8c9605be886a8aea P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:28.243955 1172 tablet_bootstrap.cc:492] T 2d9656e092de4f6e9858d387428fed39 P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:28.244089 1172 ts_tablet_manager.cc:1403] T 2d9656e092de4f6e9858d387428fed39 P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.197s user 0.006s sys 0.003s
I20260617 07:53:28.244021 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbbe7eb5181431290f57ed9128181a3" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.248857 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2304939c17648a6962f702524aa9b76" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.249224 2729 raft_consensus.cc:493] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:28.249338 2729 raft_consensus.cc:515] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.249953 2729 leader_election.cc:290] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:28.250245 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48c2b2b8d7246ff8466337e104017f4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:28.250499 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61124fa6f846a6be1a208f2eaa7c20" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.250731 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca400838f5214d1a8f57e72c5068f0f9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.250982 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9a99cdcbb74a3fb74654a26716a1c9" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.250988 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "561c8bf9e5c840628ab1c8cf91dc2d93" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.251129 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c76bfcbd22e4bfb97346a1b56f68dab" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.251296 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37b36c91191445478055b78830be9450" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:28.251770 986 leader_election.cc:343] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.251942 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48c2b2b8d7246ff8466337e104017f4" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.253337 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 638) took 3929 ms. Trace:
I20260617 07:53:28.254931 1170 rpcz_store.cc:276] 0617 07:53:24.323610 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.323672 (+ 62us) service_pool.cc:224] Handling call
0617 07:53:28.195698 (+3872026us) ts_tablet_manager.cc:1151] Deleting tablet beb8fbb44e6147be8c9605be886a8aea
0617 07:53:28.195705 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.202795 (+ 7090us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.205316 (+ 2521us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.253319 (+ 48003us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3871870}
I20260617 07:53:28.255741 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet beb8fbb44e6147be8c9605be886a8aea (table default.Table_f8e68ee7c0bf43b08f9c84454484121d [id=2ce20b981b024427aca662385456a101]) successfully deleted
I20260617 07:53:28.256211 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 642) took 3913 ms. Trace:
I20260617 07:53:28.256582 1170 rpcz_store.cc:276] 0617 07:53:24.343044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.343101 (+ 57us) service_pool.cc:224] Handling call
0617 07:53:28.256090 (+3912989us) ts_tablet_manager.cc:1151] Deleting tablet e62175d5cc854d45838454043220954e
0617 07:53:28.256100 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.256184 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3912603}
W20260617 07:53:28.257192 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet e62175d5cc854d45838454043220954e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e62175d5cc854d45838454043220954e already in progress: creating tablet
I20260617 07:53:28.257642 1170 tablet_replica.cc:333] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:28.258009 1170 raft_consensus.cc:2243] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.258378 1170 raft_consensus.cc:2272] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.259207 1170 ts_tablet_manager.cc:1916] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.264644 1846 ts_tablet_manager.cc:1916] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.270679 1170 ts_tablet_manager.cc:1929] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.271811 1170 log.cc:1199] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/d4afe4a3d708447fa7ab8bf53614c4ba
I20260617 07:53:28.272270 1170 ts_tablet_manager.cc:1950] T d4afe4a3d708447fa7ab8bf53614c4ba P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:28.273751 3085 mvcc.cc:204] Tried to move back new op lower bound from 7297772782007721984 to 7297772777777270784. Current Snapshot: MvccSnapshot[applied={T|T < 7297772782007721984}]
I20260617 07:53:28.273691 3049 tablet.cc:1724] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:28.274996 3051 tablet.cc:1724] T 72f1051b9dd04db5a8f1245242d39376 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:28.285835 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 8a4f81daf583464e988521e189ca39b6 (table default.Table_7922639f29994091bdceabbc831c9a02 [id=04c31437a9c64c26bcd92c5749a6937a]) successfully deleted
I20260617 07:53:28.288002 768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b1b128ce484d9ab371fa3c5edc6ea6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7"
I20260617 07:53:28.288610 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b1b128ce484d9ab371fa3c5edc6ea6" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:28.289075 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e064b5bc93442f83aeffa88861d818" candidate_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:28.291591 988 leader_election.cc:343] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 770a5216299842b890d483ca37b0ee86
I20260617 07:53:28.291738 988 leader_election.cc:304] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:28.291893 988 raft_consensus.cc:2686] T 770a5216299842b890d483ca37b0ee86 P dc3bec007846459a9da0c7b8211e477b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 07:53:28.292501 2729 raft_consensus.cc:493] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:28.292635 2729 raft_consensus.cc:515] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
W20260617 07:53:28.292728 988 leader_election.cc:343] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.292809 988 leader_election.cc:304] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.293095 2987 raft_consensus.cc:2749] T 2ef4f711d1534713b3ebd0862db382a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:28.293244 2729 leader_election.cc:290] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:28.293701 988 leader_election.cc:343] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.293816 988 leader_election.cc:304] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.293987 2729 raft_consensus.cc:2749] T df5224716de249e9be9d7239407579a9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.294428 988 leader_election.cc:343] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.294529 988 leader_election.cc:304] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.294703 2729 raft_consensus.cc:2749] T fb74bb5046dc4bda98be3a9ba2f4a3c6 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.294961 988 leader_election.cc:343] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.295058 988 leader_election.cc:304] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.295042 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8bd5b4bc49d6bb080362e684ee5e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
I20260617 07:53:28.295253 2729 raft_consensus.cc:2749] T 1a9a4021cad24b99b391e99e8b46cd9e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.295548 986 leader_election.cc:343] T 903a8bd5b4bc49d6bb080362e684ee5e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:28.295917 988 leader_election.cc:343] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.296007 988 leader_election.cc:304] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.296183 2729 raft_consensus.cc:2749] T adbbe7eb5181431290f57ed9128181a3 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:28.296360 1172 raft_consensus.cc:359] T 2d9656e092de4f6e9858d387428fed39 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.296571 1172 raft_consensus.cc:385] T 2d9656e092de4f6e9858d387428fed39 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 07:53:28.296551 988 leader_election.cc:343] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.296679 1172 raft_consensus.cc:740] T 2d9656e092de4f6e9858d387428fed39 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.296707 988 leader_election.cc:304] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.296964 2729 raft_consensus.cc:2749] T d2304939c17648a6962f702524aa9b76 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.297207 988 leader_election.cc:343] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.297302 988 leader_election.cc:304] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.297241 1172 consensus_queue.cc:260] T 2d9656e092de4f6e9858d387428fed39 P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.297624 2729 raft_consensus.cc:2749] T 2a61124fa6f846a6be1a208f2eaa7c20 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.297928 988 leader_election.cc:343] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.298027 988 leader_election.cc:304] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
W20260617 07:53:28.298105 3087 log.cc:927] Time spent T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260617 07:53:28.298202 2729 raft_consensus.cc:2749] T ca400838f5214d1a8f57e72c5068f0f9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:28.298368 889 tablet_service.cc:1511] Processing CreateTablet for tablet 97adbb30b01a4a7f90235bf0c5589c4e (DEFAULT_TABLE table=default.Table_47b539845ac346bf94ec809570b60ba6 [id=f335c49e0c864ab5ba78a0c98b1fa94c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 07:53:28.298678 988 leader_election.cc:343] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.298774 988 leader_election.cc:304] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.298942 2729 raft_consensus.cc:2749] T ed9a99cdcbb74a3fb74654a26716a1c9 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.299237 988 leader_election.cc:343] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.299278 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97adbb30b01a4a7f90235bf0c5589c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 07:53:28.299332 988 leader_election.cc:304] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.299507 2729 raft_consensus.cc:2749] T 561c8bf9e5c840628ab1c8cf91dc2d93 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.299814 988 leader_election.cc:343] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.299908 988 leader_election.cc:304] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.300078 2729 raft_consensus.cc:2749] T 8c76bfcbd22e4bfb97346a1b56f68dab P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.300413 988 leader_election.cc:343] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.300511 988 leader_election.cc:304] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.300704 2729 raft_consensus.cc:2749] T 37b36c91191445478055b78830be9450 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.301158 988 leader_election.cc:343] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.301297 988 leader_election.cc:304] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc3bec007846459a9da0c7b8211e477b; no voters: 6438857e0a7741ceaadf84cb9dc979e7, 8b7080d37ca245fe914d3dc90f17e3ba
I20260617 07:53:28.301513 2729 raft_consensus.cc:2749] T e48c2b2b8d7246ff8466337e104017f4 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:28.273399 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 653) took 3745 ms. Trace:
I20260617 07:53:28.303403 1170 rpcz_store.cc:276] 0617 07:53:24.528424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.528708 (+ 284us) service_pool.cc:224] Handling call
0617 07:53:28.257599 (+3728891us) ts_tablet_manager.cc:1151] Deleting tablet d4afe4a3d708447fa7ab8bf53614c4ba
0617 07:53:28.257608 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.262664 (+ 5056us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.270631 (+ 7967us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.273382 (+ 2751us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3728733}
I20260617 07:53:28.304358 1172 ts_tablet_manager.cc:1434] T 2d9656e092de4f6e9858d387428fed39 P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260617 07:53:28.304952 1172 tablet_bootstrap.cc:492] T eafcf54494f244f1b978b4b5e39d93bd P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:28.307607 1172 tablet_bootstrap.cc:654] T eafcf54494f244f1b978b4b5e39d93bd P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.309520 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet d4afe4a3d708447fa7ab8bf53614c4ba (table default.Table_7074bb8dadc643a6bdbd6cc8f86f4032 [id=28ca3bcf4d34455bb2121bd1a7e1254e]) successfully deleted
I20260617 07:53:28.311233 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 657) took 3343 ms. Trace:
W20260617 07:53:28.311547 852 consensus_peers.cc:597] T 1382fc75785e4b07bf1688fa5385500a P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:28.312165 1170 rpcz_store.cc:276] 0617 07:53:24.969048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.969101 (+ 53us) service_pool.cc:224] Handling call
0617 07:53:28.311062 (+3341961us) ts_tablet_manager.cc:1151] Deleting tablet 56e089af99464471b4d5482c3364d20f
0617 07:53:28.311075 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.311211 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3341779}
W20260617 07:53:28.313942 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 56e089af99464471b4d5482c3364d20f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56e089af99464471b4d5482c3364d20f already in progress: creating tablet
W20260617 07:53:28.314683 852 consensus_peers.cc:597] T 2f8cd6ff8fa44536acdd84a107ab1525 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:28.315227 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 658) took 3346 ms. Trace:
I20260617 07:53:28.315868 1170 rpcz_store.cc:276] 0617 07:53:24.969188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.969310 (+ 122us) service_pool.cc:224] Handling call
0617 07:53:28.314526 (+3345216us) ts_tablet_manager.cc:1151] Deleting tablet b62ae096bfd347029ef8d7f0462dd111
0617 07:53:28.314540 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.315190 (+ 650us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3345104}
W20260617 07:53:28.317502 852 leader_election.cc:343] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:28.318096 852 leader_election.cc:343] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.318203 852 leader_election.cc:304] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:28.319507 2709 raft_consensus.cc:2749] T d06187aa09fd4776a992a07405a10876 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:28.320080 1178 tablet_bootstrap.cc:492] T 3fe290e33b5145b6a2831de3d37599b9 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:28.321903 1178 tablet_bootstrap.cc:654] T 3fe290e33b5145b6a2831de3d37599b9 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
W20260617 07:53:28.320451 852 leader_election.cc:343] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.322783 852 leader_election.cc:304] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:28.323256 2709 raft_consensus.cc:2749] T 05de71ea02df48ffacb369caa7f7d3de P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.327863 852 leader_election.cc:343] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:28.331388 852 consensus_peers.cc:597] T cd9777d3619743cf8df19cf93f97f50a P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:28.332579 852 consensus_peers.cc:597] T 216614d066e9446f91e53d2a382b5f6e P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:28.333623 459 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_71adaf9340434984a17d180f03ab2392" } new_table_name: "default.Table_9120bc092f224ca89e4017a90f7b3897" modify_external_catalogs: true
I20260617 07:53:28.342893 1178 tablet_bootstrap.cc:492] T 3fe290e33b5145b6a2831de3d37599b9 P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:28.343048 1178 ts_tablet_manager.cc:1403] T 3fe290e33b5145b6a2831de3d37599b9 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.002s
I20260617 07:53:28.343880 1178 raft_consensus.cc:359] T 3fe290e33b5145b6a2831de3d37599b9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.344049 1178 raft_consensus.cc:385] T 3fe290e33b5145b6a2831de3d37599b9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.344103 1178 raft_consensus.cc:740] T 3fe290e33b5145b6a2831de3d37599b9 P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.344290 1178 consensus_queue.cc:260] T 3fe290e33b5145b6a2831de3d37599b9 P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.344750 1178 ts_tablet_manager.cc:1434] T 3fe290e33b5145b6a2831de3d37599b9 P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 07:53:28.345022 1178 tablet_bootstrap.cc:492] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:28.347342 1178 tablet_bootstrap.cc:654] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.329828 2729 raft_consensus.cc:493] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:28.348114 2729 raft_consensus.cc:515] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.348531 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 660) took 3379 ms. Trace:
I20260617 07:53:28.348925 2729 leader_election.cc:290] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
W20260617 07:53:28.349263 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet b62ae096bfd347029ef8d7f0462dd111 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b62ae096bfd347029ef8d7f0462dd111 already in progress: creating tablet
I20260617 07:53:28.349342 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3460a7f9f9bf4ea4950f878a56cfc13e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:28.350005 986 leader_election.cc:343] T 3460a7f9f9bf4ea4950f878a56cfc13e P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.348644 1170 rpcz_store.cc:276] 0617 07:53:24.969367 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.969433 (+ 66us) service_pool.cc:224] Handling call
0617 07:53:28.348346 (+3378913us) ts_tablet_manager.cc:1151] Deleting tablet a4a35e3b7bb74667aa498c58a856cacc
0617 07:53:28.348364 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.348507 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3378803}
W20260617 07:53:28.350611 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet a4a35e3b7bb74667aa498c58a856cacc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4a35e3b7bb74667aa498c58a856cacc already in progress: creating tablet
I20260617 07:53:28.350816 1170 tablet_replica.cc:333] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:28.351138 1170 raft_consensus.cc:2243] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.351346 1170 raft_consensus.cc:2272] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.352154 1170 ts_tablet_manager.cc:1916] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.354614 1172 tablet_bootstrap.cc:492] T eafcf54494f244f1b978b4b5e39d93bd P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:28.354756 1172 ts_tablet_manager.cc:1403] T eafcf54494f244f1b978b4b5e39d93bd P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.000s
I20260617 07:53:28.355463 1172 raft_consensus.cc:359] T eafcf54494f244f1b978b4b5e39d93bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.355633 1172 raft_consensus.cc:385] T eafcf54494f244f1b978b4b5e39d93bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.355695 1172 raft_consensus.cc:740] T eafcf54494f244f1b978b4b5e39d93bd P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.355904 1172 consensus_queue.cc:260] T eafcf54494f244f1b978b4b5e39d93bd P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.356323 1172 ts_tablet_manager.cc:1434] T eafcf54494f244f1b978b4b5e39d93bd P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260617 07:53:28.356714 1172 tablet_bootstrap.cc:492] T 283c08c31718433e83f0cedd799215fe P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
I20260617 07:53:28.358368 1172 tablet_bootstrap.cc:654] T 283c08c31718433e83f0cedd799215fe P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.361846 1170 ts_tablet_manager.cc:1929] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.362058 1170 log.cc:1199] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/b7d4fc81456445518c1158f912dd2f8f
I20260617 07:53:28.362541 1170 ts_tablet_manager.cc:1950] T b7d4fc81456445518c1158f912dd2f8f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:28.363620 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 662) took 3394 ms. Trace:
I20260617 07:53:28.363849 1170 rpcz_store.cc:276] 0617 07:53:24.969507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.969549 (+ 42us) service_pool.cc:224] Handling call
0617 07:53:28.350741 (+3381192us) ts_tablet_manager.cc:1151] Deleting tablet b7d4fc81456445518c1158f912dd2f8f
0617 07:53:28.350755 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.357618 (+ 6863us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.361768 (+ 4150us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.363593 (+ 1825us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3381088}
I20260617 07:53:28.364634 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 663) took 3395 ms. Trace:
I20260617 07:53:28.364815 1170 rpcz_store.cc:276] 0617 07:53:24.969582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.969658 (+ 76us) service_pool.cc:224] Handling call
0617 07:53:28.364479 (+3394821us) ts_tablet_manager.cc:1151] Deleting tablet 047da1717bf545a9b3a23a9d9136f66f
0617 07:53:28.364492 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.364614 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3394686}
I20260617 07:53:28.365489 1170 tablet_replica.cc:333] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:28.365769 1170 raft_consensus.cc:2243] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.366498 1170 raft_consensus.cc:2272] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.367223 1170 ts_tablet_manager.cc:1916] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.367646 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet b7d4fc81456445518c1158f912dd2f8f (table default.Table_acb19b0a19f54fe9a4be9d22be8f44b7 [id=18b40cd6665e42f793ddb27a1dacbe73]) successfully deleted
W20260617 07:53:28.368016 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 047da1717bf545a9b3a23a9d9136f66f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 047da1717bf545a9b3a23a9d9136f66f already in progress: creating tablet
I20260617 07:53:28.378615 1170 ts_tablet_manager.cc:1929] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.378865 1170 log.cc:1199] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/8db4fdde370e4d30bbf14285923644a1
I20260617 07:53:28.379405 1170 ts_tablet_manager.cc:1950] T 8db4fdde370e4d30bbf14285923644a1 P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
W20260617 07:53:28.380065 852 consensus_peers.cc:597] T f1b93b31475c4f29a7fdc387ffbff0cd P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 07:53:28.380226 852 leader_election.cc:343] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:28.380517 852 consensus_peers.cc:597] T e897b111e65c497591c7daaa81d783c7 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:28.380507 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 661) took 3411 ms. Trace:
I20260617 07:53:28.380731 1170 rpcz_store.cc:276] 0617 07:53:24.969438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:24.969804 (+ 366us) service_pool.cc:224] Handling call
0617 07:53:28.365425 (+3395621us) ts_tablet_manager.cc:1151] Deleting tablet 8db4fdde370e4d30bbf14285923644a1
0617 07:53:28.365438 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.374590 (+ 9152us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.378544 (+ 3954us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.380481 (+ 1937us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3395518}
I20260617 07:53:28.381556 1170 tablet_replica.cc:333] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:28.381809 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 8db4fdde370e4d30bbf14285923644a1 (table default.Table_9f97b99a0ab74a3782a8dfa84db280cc [id=813f40f457074561b406da3616edb14c]) successfully deleted
I20260617 07:53:28.381990 1170 raft_consensus.cc:2243] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 1 LEADER]: Raft consensus shutting down.
I20260617 07:53:28.382360 1170 raft_consensus.cc:2272] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.383090 1170 ts_tablet_manager.cc:1916] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.386248 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_8937a2f0060d4fac97b6a0d897c5fac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 07:53:28.386987 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8937a2f0060d4fac97b6a0d897c5fac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 07:53:28.388659 852 leader_election.cc:343] T 25b1b128ce484d9ab371fa3c5edc6ea6 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:28.388943 852 leader_election.cc:343] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260617 07:53:28.389011 852 leader_election.cc:304] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b7080d37ca245fe914d3dc90f17e3ba; no voters: 6438857e0a7741ceaadf84cb9dc979e7, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:28.388964 3049 tablet.cc:1724] T 2735f7dd40e54aec9004b9b38702607c P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260617 07:53:28.389308 852 consensus_peers.cc:597] T 72f1051b9dd04db5a8f1245242d39376 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:28.389357 2996 raft_consensus.cc:2749] T a1e064b5bc93442f83aeffa88861d818 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 07:53:28.389415 852 consensus_peers.cc:597] T 737e9344fc824714a2c2596170637158 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:28.397471 1170 ts_tablet_manager.cc:1929] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 07:53:28.397651 1170 log.cc:1199] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-2/wal/wals/037539021d1743bb9a66403b8a01662f
I20260617 07:53:28.398213 3051 tablet.cc:1724] T 2735f7dd40e54aec9004b9b38702607c P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 07:53:28.398106 1170 ts_tablet_manager.cc:1950] T 037539021d1743bb9a66403b8a01662f P dc3bec007846459a9da0c7b8211e477b: Deleting consensus metadata
I20260617 07:53:28.401558 1846 ts_tablet_manager.cc:1929] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.401674 1846 log.cc:1199] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/98f7c3f6260c4db690de1a5081bb2493
I20260617 07:53:28.405754 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 664) took 3381 ms. Trace:
I20260617 07:53:28.405818 1846 ts_tablet_manager.cc:1950] T 98f7c3f6260c4db690de1a5081bb2493 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:28.405947 1170 rpcz_store.cc:276] 0617 07:53:25.024652 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.024706 (+ 54us) service_pool.cc:224] Handling call
0617 07:53:28.381491 (+3356785us) ts_tablet_manager.cc:1151] Deleting tablet 037539021d1743bb9a66403b8a01662f
0617 07:53:28.381505 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.388235 (+ 6730us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.397406 (+ 9171us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.405695 (+ 8289us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3356613}
I20260617 07:53:28.406559 445 catalog_manager.cc:5027] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): tablet 037539021d1743bb9a66403b8a01662f (table default.Table_aedfbb83a89a41f3baded7b851c5f75b [id=c3cfb784cf954d0986cdc4bff0e26f5a]) successfully deleted
I20260617 07:53:28.406594 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 847) took 3224 ms. Trace:
I20260617 07:53:28.406688 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 671) took 2929 ms. Trace:
I20260617 07:53:28.406673 1846 rpcz_store.cc:276] 0617 07:53:25.181857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.182009 (+ 152us) service_pool.cc:224] Handling call
0617 07:53:28.189405 (+3007396us) ts_tablet_manager.cc:1151] Deleting tablet 98f7c3f6260c4db690de1a5081bb2493
0617 07:53:28.189629 (+ 224us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.339642 (+150013us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.401504 (+ 61862us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.406571 (+ 5067us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3007230}
I20260617 07:53:28.407043 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 98f7c3f6260c4db690de1a5081bb2493 (table default.Table_010f16ad25e74ae9a880163fe9e08de8 [id=94a23a9e1e434285acc94bced26578f6]) successfully deleted
I20260617 07:53:28.407183 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 853) took 2940 ms. Trace:
I20260617 07:53:28.406773 1170 rpcz_store.cc:276] 0617 07:53:25.477700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.477902 (+ 202us) service_pool.cc:224] Handling call
0617 07:53:28.406544 (+2928642us) ts_tablet_manager.cc:1151] Deleting tablet c6b85e7ed0a64c128de5cc48c4d4435f
0617 07:53:28.406557 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.406670 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2928451}
I20260617 07:53:28.407259 1846 rpcz_store.cc:276] 0617 07:53:25.466422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.467951 (+ 1529us) service_pool.cc:224] Handling call
0617 07:53:28.407071 (+2939120us) ts_tablet_manager.cc:1151] Deleting tablet 71446fc29bd5413fbfe0f6ecc6c54ada
0617 07:53:28.407081 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.407167 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2938944}
W20260617 07:53:28.407687 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 71446fc29bd5413fbfe0f6ecc6c54ada because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71446fc29bd5413fbfe0f6ecc6c54ada already in progress: creating tablet
I20260617 07:53:28.407748 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 854) took 2938 ms. Trace:
I20260617 07:53:28.407825 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 670) took 2930 ms. Trace:
I20260617 07:53:28.407805 1846 rpcz_store.cc:276] 0617 07:53:25.468847 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.478096 (+ 9249us) service_pool.cc:224] Handling call
0617 07:53:28.407641 (+2929545us) ts_tablet_manager.cc:1151] Deleting tablet c6b85e7ed0a64c128de5cc48c4d4435f
0617 07:53:28.407651 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.407734 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2929309}
W20260617 07:53:28.408039 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c6b85e7ed0a64c128de5cc48c4d4435f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6b85e7ed0a64c128de5cc48c4d4435f already in progress: creating tablet
I20260617 07:53:28.408214 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 860) took 2863 ms. Trace:
I20260617 07:53:28.408130 1170 rpcz_store.cc:276] 0617 07:53:25.477531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.477620 (+ 89us) service_pool.cc:224] Handling call
0617 07:53:28.407716 (+2930096us) ts_tablet_manager.cc:1151] Deleting tablet 71446fc29bd5413fbfe0f6ecc6c54ada
0617 07:53:28.407725 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.407809 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2929478}
W20260617 07:53:28.408324 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c6b85e7ed0a64c128de5cc48c4d4435f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6b85e7ed0a64c128de5cc48c4d4435f already in progress: creating tablet
I20260617 07:53:28.408284 1846 rpcz_store.cc:276] 0617 07:53:25.544588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.545934 (+ 1346us) service_pool.cc:224] Handling call
0617 07:53:28.408119 (+2862185us) ts_tablet_manager.cc:1151] Deleting tablet c31e808cf0604b3099230d8c2e0d609e
0617 07:53:28.408128 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.408199 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2861839}
W20260617 07:53:28.408622 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet c31e808cf0604b3099230d8c2e0d609e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c31e808cf0604b3099230d8c2e0d609e already in progress: creating tablet
I20260617 07:53:28.408669 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 677) took 2863 ms. Trace:
I20260617 07:53:28.408710 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 861) took 2800 ms. Trace:
I20260617 07:53:28.408773 1846 rpcz_store.cc:276] 0617 07:53:25.608231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.608586 (+ 355us) service_pool.cc:224] Handling call
0617 07:53:28.408600 (+2800014us) ts_tablet_manager.cc:1151] Deleting tablet cc8bf9876afc48bf81bf3020701a2939
0617 07:53:28.408611 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.408696 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2799832}
I20260617 07:53:28.408733 1170 rpcz_store.cc:276] 0617 07:53:25.545637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.545687 (+ 50us) service_pool.cc:224] Handling call
0617 07:53:28.408573 (+2862886us) ts_tablet_manager.cc:1151] Deleting tablet c31e808cf0604b3099230d8c2e0d609e
0617 07:53:28.408581 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.408653 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2862639}
W20260617 07:53:28.408905 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet 71446fc29bd5413fbfe0f6ecc6c54ada because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71446fc29bd5413fbfe0f6ecc6c54ada already in progress: creating tablet
W20260617 07:53:28.409154 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet c31e808cf0604b3099230d8c2e0d609e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c31e808cf0604b3099230d8c2e0d609e already in progress: creating tablet
I20260617 07:53:28.409194 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 862) took 2800 ms. Trace:
I20260617 07:53:28.409205 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 678) took 2860 ms. Trace:
I20260617 07:53:28.409250 1846 rpcz_store.cc:276] 0617 07:53:25.608402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.608804 (+ 402us) service_pool.cc:224] Handling call
0617 07:53:28.409096 (+2800292us) ts_tablet_manager.cc:1151] Deleting tablet ded53073ce884013b1b0ab3cd23849e1
0617 07:53:28.409105 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.409180 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2800141}
W20260617 07:53:28.409549 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet cc8bf9876afc48bf81bf3020701a2939 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc8bf9876afc48bf81bf3020701a2939 already in progress: creating tablet
I20260617 07:53:28.409286 1170 rpcz_store.cc:276] 0617 07:53:25.548501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.548561 (+ 60us) service_pool.cc:224] Handling call
0617 07:53:28.409114 (+2860553us) ts_tablet_manager.cc:1151] Deleting tablet cc8bf9876afc48bf81bf3020701a2939
0617 07:53:28.409122 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.409190 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2860337}
W20260617 07:53:28.409798 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet ded53073ce884013b1b0ab3cd23849e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ded53073ce884013b1b0ab3cd23849e1 already in progress: creating tablet
I20260617 07:53:28.410063 1170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34090 (request call id 679) took 2859 ms. Trace:
W20260617 07:53:28.410100 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet cc8bf9876afc48bf81bf3020701a2939 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc8bf9876afc48bf81bf3020701a2939 already in progress: creating tablet
I20260617 07:53:28.410296 1170 rpcz_store.cc:276] 0617 07:53:25.550671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.553448 (+ 2777us) service_pool.cc:224] Handling call
0617 07:53:28.409939 (+2856491us) ts_tablet_manager.cc:1151] Deleting tablet ded53073ce884013b1b0ab3cd23849e1
0617 07:53:28.409951 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.410044 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2856324}
W20260617 07:53:28.410780 445 catalog_manager.cc:5007] TS dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): delete failed for tablet ded53073ce884013b1b0ab3cd23849e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ded53073ce884013b1b0ab3cd23849e1 already in progress: creating tablet
I20260617 07:53:28.410842 1170 tablet_replica.cc:333] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b: stopping tablet replica
I20260617 07:53:28.411134 1170 raft_consensus.cc:2243] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.411343 1170 raft_consensus.cc:2272] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.416399 1170 ts_tablet_manager.cc:1916] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.422911 3049 tablet.cc:1724] T ddd63aa802164f25aca72bea45ea3b96 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 07:53:28.423164 461 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c2bae0d7dfe4512b1674796e5dacf27 consensus state has no leader
I20260617 07:53:28.423672 3051 tablet.cc:1724] T ddd63aa802164f25aca72bea45ea3b96 P dc3bec007846459a9da0c7b8211e477b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 07:53:28.427551 461 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_90a4260ed99e4d37bf5eb8b28ca1a897" } modify_external_catalogs: true
I20260617 07:53:28.427793 461 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_90a4260ed99e4d37bf5eb8b28ca1a897" } modify_external_catalogs: true
I20260617 07:53:28.434482 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 864) took 2676 ms. Trace:
I20260617 07:53:28.434589 1846 rpcz_store.cc:276] 0617 07:53:25.758072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.758432 (+ 360us) service_pool.cc:224] Handling call
0617 07:53:28.434329 (+2675897us) ts_tablet_manager.cc:1151] Deleting tablet 3ec0ac6bf0cf445293553691d902033b
0617 07:53:28.434342 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.434455 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2675710}
W20260617 07:53:28.435024 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet 3ec0ac6bf0cf445293553691d902033b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ec0ac6bf0cf445293553691d902033b already in progress: creating tablet
I20260617 07:53:28.435119 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 866) took 2676 ms. Trace:
I20260617 07:53:28.435179 1846 rpcz_store.cc:276] 0617 07:53:25.758222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.759021 (+ 799us) service_pool.cc:224] Handling call
0617 07:53:28.435012 (+2675991us) ts_tablet_manager.cc:1151] Deleting tablet f659b794a08745d2a111016332e604b8
0617 07:53:28.435022 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.435103 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2675823}
I20260617 07:53:28.435556 1846 tablet_replica.cc:333] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
W20260617 07:53:28.435551 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet f659b794a08745d2a111016332e604b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f659b794a08745d2a111016332e604b8 already in progress: creating tablet
I20260617 07:53:28.435761 1846 raft_consensus.cc:2243] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.435920 1846 raft_consensus.cc:2272] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.436405 1846 ts_tablet_manager.cc:1916] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.439378 2729 raft_consensus.cc:493] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:28.439517 2729 raft_consensus.cc:515] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.440092 2729 leader_election.cc:290] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545), 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879)
I20260617 07:53:28.440446 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cbfa2a77d848fa924d633727e88618" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6438857e0a7741ceaadf84cb9dc979e7" is_pre_election: true
W20260617 07:53:28.441061 986 leader_election.cc:343] T c6cbfa2a77d848fa924d633727e88618 P dc3bec007846459a9da0c7b8211e477b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260617 07:53:28.448529 851 consensus_peers.cc:597] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Couldn't send request to peer dc3bec007846459a9da0c7b8211e477b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8db4fdde370e4d30bbf14285923644a1. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:28.451542 1178 tablet_bootstrap.cc:492] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 6438857e0a7741ceaadf84cb9dc979e7: No bootstrap required, opened a new log
I20260617 07:53:28.451690 1178 ts_tablet_manager.cc:1403] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent bootstrapping tablet: real 0.107s user 0.002s sys 0.018s
I20260617 07:53:28.452939 3049 tablet.cc:1724] T 8cf4025a0f784cc6868950e51a45da2e P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 07:53:28.453142 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cbfa2a77d848fa924d633727e88618" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.453855 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903a8bd5b4bc49d6bb080362e684ee5e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
I20260617 07:53:28.454227 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3460a7f9f9bf4ea4950f878a56cfc13e" candidate_uuid: "dc3bec007846459a9da0c7b8211e477b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" is_pre_election: true
W20260617 07:53:28.455140 447 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet b48d79739dac47b7b202c3652671e29b (table default.Table_9690441ca20a484789fef0743507116a [id=e07ad02342964d70a634be50704f82fd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b48d79739dac47b7b202c3652671e29b consensus state has no leader
I20260617 07:53:28.458278 1172 tablet_bootstrap.cc:492] T 283c08c31718433e83f0cedd799215fe P dc3bec007846459a9da0c7b8211e477b: No bootstrap required, opened a new log
I20260617 07:53:28.458427 1172 ts_tablet_manager.cc:1403] T 283c08c31718433e83f0cedd799215fe P dc3bec007846459a9da0c7b8211e477b: Time spent bootstrapping tablet: real 0.102s user 0.012s sys 0.003s
I20260617 07:53:28.465934 1172 raft_consensus.cc:359] T 283c08c31718433e83f0cedd799215fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.466125 1172 raft_consensus.cc:385] T 283c08c31718433e83f0cedd799215fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.466187 1172 raft_consensus.cc:740] T 283c08c31718433e83f0cedd799215fe P dc3bec007846459a9da0c7b8211e477b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3bec007846459a9da0c7b8211e477b, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.467108 456 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_8e65059cd2404d328ae4a38e6c883053 [id=bf143b9baca647f0b25452d16dff2ae6] alter complete (version 3)
I20260617 07:53:28.467921 1172 consensus_queue.cc:260] T 283c08c31718433e83f0cedd799215fe P dc3bec007846459a9da0c7b8211e477b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } }
I20260617 07:53:28.468524 456 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_50024b66fbc145d990cf71324a0afe35" } modify_external_catalogs: true
I20260617 07:53:28.468740 456 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_50024b66fbc145d990cf71324a0afe35" } modify_external_catalogs: true
W20260617 07:53:28.471171 852 consensus_peers.cc:597] T 8db4fdde370e4d30bbf14285923644a1 P 8b7080d37ca245fe914d3dc90f17e3ba -> Peer 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): Couldn't send request to peer 6438857e0a7741ceaadf84cb9dc979e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 07:53:28.474068 457 catalog_manager.cc:6241] T 00000000000000000000000000000000 P becdd6b4fad846399c95f04697e01d0f: default.Table_0a3622a666594847848eb4982fd1316a [id=52357c6af1e04f2c82768cb39fe1be8d] alter complete (version 3)
I20260617 07:53:28.483541 1178 raft_consensus.cc:359] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.483733 1178 raft_consensus.cc:385] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.483777 1178 raft_consensus.cc:740] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6438857e0a7741ceaadf84cb9dc979e7, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.483986 1178 consensus_queue.cc:260] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 6438857e0a7741ceaadf84cb9dc979e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.484724 1178 ts_tablet_manager.cc:1434] T 35120ce002f24f2bb1ea0fdc59fbfc9d P 6438857e0a7741ceaadf84cb9dc979e7: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20260617 07:53:28.484977 1178 tablet_bootstrap.cc:492] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 6438857e0a7741ceaadf84cb9dc979e7: Bootstrap starting.
I20260617 07:53:28.491276 1178 tablet_bootstrap.cc:654] T 0be19ece3a0a4a51abad7b8e2f3b2420 P 6438857e0a7741ceaadf84cb9dc979e7: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.496686 1170 ts_tablet_manager.cc:1929] T 4e8e9692227147d6a8c6854133941b44 P dc3bec007846459a9da0c7b8211e477b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.500491 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9ace137c4e496fafac4e729718577f with delete_type TABLET_DATA_DELETED (replaced by tablet 2a61124fa6f846a6be1a208f2eaa7c20) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:28.500491 745 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f8602b87a20455884c16196a901d335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:14 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:28.500672 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 5578fd5cb3724ed5b92b313bd52889ad with delete_type TABLET_DATA_DELETED (replaced by tablet 01abd7aed0fd4d2b90db9f40029b5b37) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:28.500806 741 tablet_service.cc:1558] Processing DeleteTablet for tablet a02dbb70eec84932917ef282fdae0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 07:53:07 UTC) from {username='slave'} at 127.0.0.1:49012
I20260617 07:53:28.503703 1171 tablet_bootstrap.cc:492] T c9657e0dd2a8459cb728bdfe8a68b840 P 8b7080d37ca245fe914d3dc90f17e3ba: No bootstrap required, opened a new log
I20260617 07:53:28.503902 1171 ts_tablet_manager.cc:1403] T c9657e0dd2a8459cb728bdfe8a68b840 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent bootstrapping tablet: real 0.329s user 0.005s sys 0.007s
I20260617 07:53:28.504554 1846 ts_tablet_manager.cc:1929] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 07:53:28.504714 1846 log.cc:1199] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting WAL directory at /tmp/dist-test-taskYlbqAx/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781682776283335-422-0/minicluster-data/ts-0/wal/wals/3fcf87953dc14bf190ac74101547e52f
I20260617 07:53:28.505040 1846 ts_tablet_manager.cc:1950] T 3fcf87953dc14bf190ac74101547e52f P 6438857e0a7741ceaadf84cb9dc979e7: Deleting consensus metadata
I20260617 07:53:28.505522 1171 raft_consensus.cc:359] T c9657e0dd2a8459cb728bdfe8a68b840 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.505879 1171 raft_consensus.cc:385] T c9657e0dd2a8459cb728bdfe8a68b840 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 07:53:28.506318 1171 raft_consensus.cc:740] T c9657e0dd2a8459cb728bdfe8a68b840 P 8b7080d37ca245fe914d3dc90f17e3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7080d37ca245fe914d3dc90f17e3ba, State: Initialized, Role: FOLLOWER
I20260617 07:53:28.506958 1171 consensus_queue.cc:260] T c9657e0dd2a8459cb728bdfe8a68b840 P 8b7080d37ca245fe914d3dc90f17e3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.507501 1171 ts_tablet_manager.cc:1434] T c9657e0dd2a8459cb728bdfe8a68b840 P 8b7080d37ca245fe914d3dc90f17e3ba: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 07:53:28.507731 3054 raft_consensus.cc:493] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 07:53:28.507844 3054 raft_consensus.cc:515] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6438857e0a7741ceaadf84cb9dc979e7" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 37545 } } peers { permanent_uuid: "8b7080d37ca245fe914d3dc90f17e3ba" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 38879 } } peers { permanent_uuid: "dc3bec007846459a9da0c7b8211e477b" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 36497 } }
I20260617 07:53:28.508414 3054 leader_election.cc:290] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879), dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497)
W20260617 07:53:28.510210 716 leader_election.cc:343] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): Not found: Tablet not found: 4d9ace137c4e496fafac4e729718577f
W20260617 07:53:28.511274 713 leader_election.cc:343] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc3bec007846459a9da0c7b8211e477b (127.0.105.131:36497): Not found: Tablet not found: 4d9ace137c4e496fafac4e729718577f
I20260617 07:53:28.511397 713 leader_election.cc:304] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6438857e0a7741ceaadf84cb9dc979e7; no voters: 8b7080d37ca245fe914d3dc90f17e3ba, dc3bec007846459a9da0c7b8211e477b
I20260617 07:53:28.511837 3054 raft_consensus.cc:2749] T 4d9ace137c4e496fafac4e729718577f P 6438857e0a7741ceaadf84cb9dc979e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 07:53:28.516270 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 872) took 2612 ms. Trace:
I20260617 07:53:28.520524 1846 rpcz_store.cc:276] 0617 07:53:25.903981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.904569 (+ 588us) service_pool.cc:224] Handling call
0617 07:53:28.435510 (+2530941us) ts_tablet_manager.cc:1151] Deleting tablet 3fcf87953dc14bf190ac74101547e52f
0617 07:53:28.435520 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.463070 (+ 27550us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.504493 (+ 41423us) tablet_metadata.cc:665] Metadata flushed
0617 07:53:28.516250 (+ 11757us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2504947}
I20260617 07:53:28.523554 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 873) took 2544 ms. Trace:
I20260617 07:53:28.524835 1846 rpcz_store.cc:276] 0617 07:53:25.979276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:25.979348 (+ 72us) service_pool.cc:224] Handling call
0617 07:53:28.523430 (+2544082us) ts_tablet_manager.cc:1151] Deleting tablet d7b981da1d2e4862824e933dc8babefc
0617 07:53:28.523440 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.523538 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2543890}
I20260617 07:53:28.526957 1846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49012 (request call id 876) took 2417 ms. Trace:
I20260617 07:53:28.527908 1846 rpcz_store.cc:276] 0617 07:53:26.109148 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 07:53:26.111700 (+ 2552us) service_pool.cc:224] Handling call
0617 07:53:28.526842 (+2415142us) ts_tablet_manager.cc:1151] Deleting tablet ef67fe2d23444f77bf415fc9aad1db62
0617 07:53:28.526853 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 07:53:28.526942 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2372758}
I20260617 07:53:28.530161 448 catalog_manager.cc:5027] TS 8b7080d37ca245fe914d3dc90f17e3ba (127.0.105.130:38879): tablet 75f32eb8ec894e029a428bbd62caa0f5 (table default.Table_deda97e12ba647f29d61a0ab49f6d3a7 [id=07f503d6e3f34dbc9eacdead783c4e9e]) successfully deleted
I20260617 07:53:28.530879 1846 tablet_replica.cc:333] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7: stopping tablet replica
I20260617 07:53:28.531641 1846 raft_consensus.cc:2243] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 07:53:28.532866 1846 raft_consensus.cc:2272] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 07:53:28.533746 1846 ts_tablet_manager.cc:1916] T 75f32eb8ec894e029a428bbd62caa0f5 P 6438857e0a7741ceaadf84cb9dc979e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 07:53:28.540458 3049 tablet.cc:1724] T c019792d23484fb789378bf377547415 P 8b7080d37ca245fe914d3dc90f17e3ba: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260617 07:53:28.544835 458 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0ef418967b34ad68a472ee9edc452a6 consensus state has no leader
I20260617 07:53:28.496786 1172 ts_tablet_manager.cc:1434] T 283c08c31718433e83f0cedd799215fe P dc3bec007846459a9da0c7b8211e477b: Time spent starting tablet: real 0.038s user 0.003s sys 0.000s
I20260617 07:53:28.545953 1172 tablet_bootstrap.cc:492] T d5f158254bd34f1dbc5c9e3e92baa360 P dc3bec007846459a9da0c7b8211e477b: Bootstrap starting.
W20260617 07:53:28.545962 459 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7ce4223941643feabfb199c5f0de122 consensus state has no leader
I20260617 07:53:28.547891 1172 tablet_bootstrap.cc:654] T d5f158254bd34f1dbc5c9e3e92baa360 P dc3bec007846459a9da0c7b8211e477b: Neither blocks nor log segments found. Creating new log.
I20260617 07:53:28.548209 457 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ed21cebfa20b4c13af92240c4698a476" } modify_external_catalogs: true
I20260617 07:53:28.548398 457 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_ed21cebfa20b4c13af92240c4698a476" } modify_external_catalogs: true
W20260617 07:53:28.548767 446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:36505, user_credentials={real_user=slave}} blocked reactor thread for 48663.5us
I20260617 07:53:28.549320 446 catalog_manager.cc:5027] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): tablet 3fcf87953dc14bf190ac74101547e52f (table default.Table_4eb17dccfecb4f6b87322057782dd4f6 [id=c917ccc3950449deb18b07ae25f940d7]) successfully deleted
W20260617 07:53:28.549571 446 catalog_manager.cc:5007] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545): delete failed for tablet d7b981da1d2e4862824e933dc8babefc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7b981da1d2e4862824e933dc8babefc already in progress: creating tablet
I20260617 07:53:28.551903 454 catalog_manager.cc:5788] TS 6438857e0a7741ceaadf84cb9dc979e7 (127.0.105.129:37545) does not have the latest schema for tablet 3fe290e33b5145b6a2831de3d37599b9 (table default.Table_db43d16997784003860b863b8476cc86 [id=4f545023638349f686a11acaade9abfe]). Expected version 1 got 0
I20260617 07:53:28.556478 453 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_49d8c7380b994564bafb7bb0440015b1" } modify_external_catalogs: true
I20260617 07:53:28.556725 453 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_49d8c7380b994564bafb7bb0440015b1" } modify_external_catalogs: true
I20260617 07:53:28.557384 458 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_269e9513ae2943ddaf7ee4ecc2a21ab2" } modify_external_catalogs: true
I20260617 07:53:28.557616 458 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33390:
table { table_name: "default.Table_269e9513ae2943ddaf7ee4ecc2a21ab2" } modify_external_catalogs: true
I20260617 07:53:28.558265 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33390:
name: "default.Table_d4547702c06c4632a2afc8af101fcadc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"